Jul 07 23:11:25.156565 ip-10-0-143-195 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 07 23:11:25.156577 ip-10-0-143-195 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 07 23:11:25.156586 ip-10-0-143-195 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 07 23:11:25.156894 ip-10-0-143-195 systemd[1]: Failed to start Kubernetes Kubelet. Jul 07 23:11:35.406391 ip-10-0-143-195 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 07 23:11:35.406409 ip-10-0-143-195 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 2971205a0cac4bafb9b5ac72a8738845 -- Jul 07 23:13:37.324906 ip-10-0-143-195 systemd[1]: Starting Kubernetes Kubelet... Jul 07 23:13:37.699398 ip-10-0-143-195 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 23:13:37.699398 ip-10-0-143-195 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 23:13:37.699398 ip-10-0-143-195 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 23:13:37.699398 ip-10-0-143-195 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 23:13:37.699398 ip-10-0-143-195 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 23:13:37.701730 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.701581 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 23:13:37.707402 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707382 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 23:13:37.707402 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707403 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 23:13:37.707552 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707408 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 23:13:37.707552 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707413 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 23:13:37.707552 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707418 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 23:13:37.707552 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707430 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 23:13:37.707552 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707435 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 23:13:37.707552 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707439 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 23:13:37.707552 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707443 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 23:13:37.707552 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707447 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 23:13:37.707552 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707451 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 23:13:37.707552 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707455 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 23:13:37.707552 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707459 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 23:13:37.707552 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707463 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 23:13:37.707552 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707469 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 23:13:37.707552 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707475 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 23:13:37.707552 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707480 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 23:13:37.707552 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707484 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 23:13:37.707552 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707489 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 23:13:37.707552 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707493 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 23:13:37.707552 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707498 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 23:13:37.708357 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707501 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 23:13:37.708357 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707505 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 23:13:37.708357 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707512 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 23:13:37.708357 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707518 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 23:13:37.708357 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707523 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 23:13:37.708357 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707528 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 23:13:37.708357 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707532 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 23:13:37.708357 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707537 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 23:13:37.708357 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707541 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 23:13:37.708357 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707545 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 23:13:37.708357 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707549 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 23:13:37.708357 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707554 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 23:13:37.708357 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707579 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 23:13:37.708357 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707584 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 23:13:37.708357 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707588 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 23:13:37.708357 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707592 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 23:13:37.708357 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707597 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 23:13:37.708357 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707601 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 23:13:37.708357 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707605 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 23:13:37.708357 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707609 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 23:13:37.709262 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707613 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 23:13:37.709262 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707618 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 23:13:37.709262 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707623 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 23:13:37.709262 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707627 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 23:13:37.709262 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707631 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 23:13:37.709262 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707635 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 23:13:37.709262 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707639 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 23:13:37.709262 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707643 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 23:13:37.709262 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707648 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 23:13:37.709262 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707652 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 23:13:37.709262 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707656 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 23:13:37.709262 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707661 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 23:13:37.709262 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707664 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 23:13:37.709262 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707669 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 23:13:37.709262 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707674 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 23:13:37.709262 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707678 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 23:13:37.709262 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707683 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 23:13:37.709262 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707687 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 23:13:37.709262 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707691 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 23:13:37.710035 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707695 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 23:13:37.710035 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707700 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 23:13:37.710035 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707704 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 23:13:37.710035 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707709 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 23:13:37.710035 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707713 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 07 23:13:37.710035 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707718 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 23:13:37.710035 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707722 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 23:13:37.710035 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707729 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 23:13:37.710035 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707733 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 23:13:37.710035 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707737 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 23:13:37.710035 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707742 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 23:13:37.710035 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707746 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 23:13:37.710035 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707751 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 23:13:37.710035 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707755 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 23:13:37.710035 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707759 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 23:13:37.710035 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707763 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 23:13:37.710035 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707767 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 23:13:37.710035 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707772 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 23:13:37.710035 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707776 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 23:13:37.710035 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707781 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 23:13:37.710759 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707785 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 23:13:37.710759 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707789 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 23:13:37.710759 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707793 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 23:13:37.710759 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707797 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 23:13:37.710759 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707801 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 23:13:37.710759 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707805 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 23:13:37.710759 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707811 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 23:13:37.710759 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707815 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 23:13:37.710759 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707819 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 23:13:37.710759 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707823 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 23:13:37.710759 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707827 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 23:13:37.710759 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707833 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 23:13:37.710759 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707839 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 23:13:37.710759 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707844 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 23:13:37.710759 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707847 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 23:13:37.710759 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707851 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 23:13:37.710759 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707856 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 23:13:37.710759 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707861 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 23:13:37.710759 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.707865 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 23:13:37.710759 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709103 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 07 23:13:37.711466 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709112 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 23:13:37.711466 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709117 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 23:13:37.711466 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709122 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 23:13:37.711466 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709129 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 23:13:37.711466 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709134 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 23:13:37.711466 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709140 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 23:13:37.711466 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709144 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 23:13:37.711466 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709148 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 23:13:37.711466 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709153 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 23:13:37.711466 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709157 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 23:13:37.711466 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709161 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 23:13:37.711466 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709165 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 23:13:37.711466 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709169 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 23:13:37.711466 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709173 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 23:13:37.711466 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709177 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 23:13:37.711466 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709182 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 23:13:37.711466 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709186 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 23:13:37.711466 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709190 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 23:13:37.711466 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709194 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 23:13:37.712302 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709199 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 23:13:37.712302 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709203 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 23:13:37.712302 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709207 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 23:13:37.712302 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709211 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 23:13:37.712302 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709216 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 23:13:37.712302 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709220 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 23:13:37.712302 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709226 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 23:13:37.712302 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709231 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 23:13:37.712302 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709236 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 23:13:37.712302 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709241 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 23:13:37.712302 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709245 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 23:13:37.712302 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709249 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 23:13:37.712302 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709254 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 23:13:37.712302 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709258 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 23:13:37.712302 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709261 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 23:13:37.712302 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709265 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 23:13:37.712302 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709269 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 23:13:37.712302 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709274 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 23:13:37.712302 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709278 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 23:13:37.713157 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709283 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 23:13:37.713157 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709287 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 23:13:37.713157 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709291 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 23:13:37.713157 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709295 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 23:13:37.713157 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709299 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 23:13:37.713157 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709304 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 23:13:37.713157 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709308 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 23:13:37.713157 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709312 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 23:13:37.713157 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709316 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 23:13:37.713157 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709320 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 23:13:37.713157 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709324 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 23:13:37.713157 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709328 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 23:13:37.713157 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709333 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 23:13:37.713157 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709337 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 23:13:37.713157 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709342 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 23:13:37.713157 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709346 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 23:13:37.713157 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709351 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 23:13:37.713157 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709355 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 23:13:37.713157 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709359 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 23:13:37.713157 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709363 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 23:13:37.713953 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709367 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 23:13:37.713953 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709372 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 23:13:37.713953 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709376 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 23:13:37.713953 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709381 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 23:13:37.713953 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709385 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 23:13:37.713953 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709389 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 23:13:37.713953 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709393 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 23:13:37.713953 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709397 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 23:13:37.713953 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709401 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 23:13:37.713953 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709407 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 23:13:37.713953 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709413 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 23:13:37.713953 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709420 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 23:13:37.713953 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709425 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 23:13:37.713953 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709430 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 23:13:37.713953 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709435 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 23:13:37.713953 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709439 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 23:13:37.713953 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709444 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 23:13:37.713953 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709449 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 23:13:37.713953 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709454 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 23:13:37.713953 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709458 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 23:13:37.714496 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709462 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 23:13:37.714496 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709469 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 23:13:37.714496 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709474 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 23:13:37.714496 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709479 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 23:13:37.714496 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709484 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 23:13:37.714496 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709489 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 23:13:37.714496 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709494 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 23:13:37.714496 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709498 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 23:13:37.714496 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709503 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 23:13:37.714496 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709507 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 23:13:37.714496 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709511 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 23:13:37.714496 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709516 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 23:13:37.714496 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709520 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 23:13:37.714496 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709524 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 23:13:37.714496 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709529 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 23:13:37.714496 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709533 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 23:13:37.714496 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709537 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 23:13:37.714496 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709541 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 23:13:37.714496 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709545 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 23:13:37.715083 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.709549 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 23:13:37.715083 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711663 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 23:13:37.715083 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711676 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 23:13:37.715083 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711681 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 23:13:37.715083 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711687 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 23:13:37.715083 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711694 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 23:13:37.715083 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711700 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 23:13:37.715083 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711704 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 23:13:37.715083 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711709 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 23:13:37.715083 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711713 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 23:13:37.715083 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711717 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 23:13:37.715083 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711721 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 07 23:13:37.715083 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711725 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 23:13:37.715083 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711729 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 23:13:37.715083 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711733 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 23:13:37.715083 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711737 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 23:13:37.715083 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711742 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 23:13:37.715083 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711747 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 23:13:37.715083 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711751 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 23:13:37.715083 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711755 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 23:13:37.715769 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711759 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 23:13:37.715769 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711764 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 23:13:37.715769 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711768 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 23:13:37.715769 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711772 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 23:13:37.715769 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711777 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 23:13:37.715769 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711780 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 23:13:37.715769 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711784 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 23:13:37.715769 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711788 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 23:13:37.715769 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711793 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 23:13:37.715769 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711797 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 23:13:37.715769 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711801 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 23:13:37.715769 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711805 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 23:13:37.715769 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711809 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 23:13:37.715769 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711823 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 23:13:37.715769 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711827 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 23:13:37.715769 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711831 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 23:13:37.715769 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711835 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 23:13:37.715769 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711840 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 23:13:37.715769 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711854 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 23:13:37.715769 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711859 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 23:13:37.716256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711862 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 23:13:37.716256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711867 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 23:13:37.716256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711871 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 23:13:37.716256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711875 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 23:13:37.716256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711879 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 23:13:37.716256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711883 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 23:13:37.716256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711887 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 23:13:37.716256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711891 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 23:13:37.716256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711895 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 23:13:37.716256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711899 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 23:13:37.716256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711903 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 23:13:37.716256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711907 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 23:13:37.716256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711911 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 23:13:37.716256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711916 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 23:13:37.716256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711919 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 23:13:37.716256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711925 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 23:13:37.716256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711929 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 23:13:37.716256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711933 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 23:13:37.716256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711937 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 23:13:37.716843 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711943 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 23:13:37.716843 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711948 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 23:13:37.716843 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711952 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 23:13:37.716843 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711956 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 23:13:37.716843 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711960 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 23:13:37.716843 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711964 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 23:13:37.716843 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711969 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 23:13:37.716843 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711973 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 23:13:37.716843 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711977 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 23:13:37.716843 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711984 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 23:13:37.716843 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711988 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 23:13:37.716843 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711992 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 23:13:37.716843 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.711996 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 23:13:37.716843 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.712000 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 23:13:37.716843 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.712004 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 23:13:37.716843 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.712008 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 23:13:37.716843 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.712012 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 23:13:37.716843 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.712016 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 23:13:37.716843 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.712022 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 23:13:37.717296 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.712027 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 23:13:37.717296 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.712032 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 23:13:37.717296 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.712037 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 23:13:37.717296 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.712042 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 23:13:37.717296 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.712046 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 23:13:37.717296 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.712050 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 23:13:37.717296 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.712055 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 23:13:37.717296 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.712059 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 23:13:37.717296 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.712063 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 23:13:37.717296 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.712067 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 23:13:37.717296 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.712072 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 23:13:37.717296 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.712076 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 23:13:37.717296 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.712080 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 23:13:37.717296 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.712084 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 23:13:37.717296 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.712088 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 23:13:37.717296 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.712092 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 23:13:37.717296 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.712096 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 23:13:37.717296 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.712100 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 23:13:37.717296 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.712104 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 23:13:37.717296 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.712108 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 23:13:37.717821 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.712112 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 23:13:37.717821 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.712117 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 23:13:37.717821 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712213 2564 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 23:13:37.717821 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712225 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 23:13:37.717821 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712235 2564 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 23:13:37.717821 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712242 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 23:13:37.717821 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712249 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 23:13:37.717821 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712255 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 23:13:37.717821 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712261 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 23:13:37.717821 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712269 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 23:13:37.717821 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712274 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 23:13:37.717821 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712280 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 23:13:37.717821 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712286 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 23:13:37.717821 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712291 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 23:13:37.717821 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712296 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 23:13:37.717821 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712300 2564 flags.go:64] FLAG: --cgroup-root="" Jul 07 23:13:37.717821 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712305 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 23:13:37.717821 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712309 2564 flags.go:64] FLAG: --client-ca-file="" Jul 07 23:13:37.717821 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712314 2564 flags.go:64] FLAG: --cloud-provider="external" Jul 07 23:13:37.717821 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712318 2564 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 23:13:37.717821 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712325 2564 flags.go:64] FLAG: --cluster-domain="" Jul 07 23:13:37.717821 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712329 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 23:13:37.717821 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712334 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 23:13:37.717821 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712339 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 23:13:37.718399 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712344 2564 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 23:13:37.718399 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712350 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 23:13:37.718399 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712354 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 23:13:37.718399 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712359 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 23:13:37.718399 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712365 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 23:13:37.718399 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712369 2564 flags.go:64] FLAG: --contention-profiling="false" Jul 07 23:13:37.718399 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712373 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 23:13:37.718399 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712381 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 23:13:37.718399 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712386 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 23:13:37.718399 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712391 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 23:13:37.718399 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712398 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 23:13:37.718399 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712403 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 23:13:37.718399 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712407 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 23:13:37.718399 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712412 2564 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 23:13:37.718399 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712417 2564 flags.go:64] FLAG: --enable-server="true" Jul 07 23:13:37.718399 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712421 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 23:13:37.718399 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712429 2564 flags.go:64] FLAG: --event-burst="100" Jul 07 23:13:37.718399 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712434 2564 flags.go:64] FLAG: --event-qps="50" Jul 07 23:13:37.718399 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712438 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 23:13:37.718399 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712443 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 23:13:37.718399 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712447 2564 flags.go:64] FLAG: --eviction-hard="" Jul 07 23:13:37.718399 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712453 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 23:13:37.718399 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712457 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 23:13:37.718399 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712462 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 23:13:37.718399 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712467 2564 flags.go:64] FLAG: --eviction-soft="" Jul 07 23:13:37.719116 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712471 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 23:13:37.719116 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712476 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 23:13:37.719116 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712481 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 23:13:37.719116 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712485 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 23:13:37.719116 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712490 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 23:13:37.719116 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712494 2564 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 23:13:37.719116 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712498 2564 flags.go:64] FLAG: --feature-gates="" Jul 07 23:13:37.719116 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712504 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 23:13:37.719116 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712509 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 23:13:37.719116 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712514 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 23:13:37.719116 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712518 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 23:13:37.719116 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712523 2564 flags.go:64] FLAG: --healthz-port="10248" Jul 07 23:13:37.719116 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712528 2564 flags.go:64] FLAG: --help="false" Jul 07 23:13:37.719116 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712532 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-143-195.ec2.internal" Jul 07 23:13:37.719116 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712548 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 23:13:37.719116 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712553 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 23:13:37.719116 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712575 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 23:13:37.719116 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712580 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 23:13:37.719116 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712586 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 23:13:37.719116 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712590 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 23:13:37.719116 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712595 2564 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 23:13:37.719116 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712599 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 23:13:37.719116 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712604 2564 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 23:13:37.719818 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712610 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 23:13:37.719818 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712615 2564 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 23:13:37.719818 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712619 2564 flags.go:64] FLAG: --kube-reserved="" Jul 07 23:13:37.719818 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712646 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 23:13:37.719818 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712652 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 23:13:37.719818 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712657 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 23:13:37.719818 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712662 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 23:13:37.719818 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712667 2564 flags.go:64] FLAG: --lock-file="" Jul 07 23:13:37.719818 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712672 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 23:13:37.719818 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712678 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 23:13:37.719818 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712683 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 23:13:37.719818 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712697 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 23:13:37.719818 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712703 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 23:13:37.719818 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712707 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 23:13:37.719818 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712712 2564 flags.go:64] FLAG: --logging-format="text" Jul 07 23:13:37.719818 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712717 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 23:13:37.719818 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712722 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 23:13:37.719818 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712726 2564 flags.go:64] FLAG: --manifest-url="" Jul 07 23:13:37.719818 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712731 2564 flags.go:64] FLAG: --manifest-url-header="" Jul 07 23:13:37.719818 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712737 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 23:13:37.719818 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712742 2564 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 23:13:37.719818 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712748 2564 flags.go:64] FLAG: --max-pods="110" Jul 07 23:13:37.719818 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712753 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 23:13:37.719818 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712761 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 23:13:37.719818 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712766 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 23:13:37.720445 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712770 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 23:13:37.720445 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712775 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 23:13:37.720445 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712779 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 23:13:37.720445 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712784 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 23:13:37.720445 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712795 2564 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 23:13:37.720445 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712800 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 23:13:37.720445 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712805 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 23:13:37.720445 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712811 2564 flags.go:64] FLAG: --pod-cidr="" Jul 07 23:13:37.720445 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712816 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 23:13:37.720445 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712825 2564 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 23:13:37.720445 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712829 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 23:13:37.720445 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712834 2564 flags.go:64] FLAG: --pods-per-core="0" Jul 07 23:13:37.720445 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712839 2564 flags.go:64] FLAG: --port="10250" Jul 07 23:13:37.720445 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712844 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 23:13:37.720445 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712848 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0300a5d548480fea0" Jul 07 23:13:37.720445 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712853 2564 flags.go:64] FLAG: --qos-reserved="" Jul 07 23:13:37.720445 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712859 2564 flags.go:64] FLAG: --read-only-port="10255" Jul 07 23:13:37.720445 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712863 2564 flags.go:64] FLAG: --register-node="true" Jul 07 23:13:37.720445 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712868 2564 flags.go:64] FLAG: --register-with-taints="" Jul 07 23:13:37.720445 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712874 2564 flags.go:64] FLAG: --registry-burst="10" Jul 07 23:13:37.720445 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712879 2564 flags.go:64] FLAG: --registry-qps="5" Jul 07 23:13:37.720445 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712884 2564 flags.go:64] FLAG: --reserved-cpus="" Jul 07 23:13:37.720445 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712888 2564 flags.go:64] FLAG: --reserved-memory="" Jul 07 23:13:37.720445 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712894 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 23:13:37.720445 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712899 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 23:13:37.721090 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712904 2564 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 23:13:37.721090 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712908 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 23:13:37.721090 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712913 2564 flags.go:64] FLAG: --runonce="false" Jul 07 23:13:37.721090 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712917 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 23:13:37.721090 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712922 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 23:13:37.721090 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712929 2564 flags.go:64] FLAG: --seccomp-default="false" Jul 07 23:13:37.721090 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712933 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 23:13:37.721090 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712937 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 23:13:37.721090 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712942 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 23:13:37.721090 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712947 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 23:13:37.721090 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712952 2564 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 23:13:37.721090 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712956 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 23:13:37.721090 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712961 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 23:13:37.721090 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712965 2564 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 23:13:37.721090 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712970 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 23:13:37.721090 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712976 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 23:13:37.721090 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712981 2564 flags.go:64] FLAG: --system-cgroups="" Jul 07 23:13:37.721090 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712985 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 23:13:37.721090 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712994 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 23:13:37.721090 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.712998 2564 flags.go:64] FLAG: --tls-cert-file="" Jul 07 23:13:37.721090 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.713003 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 23:13:37.721090 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.713010 2564 flags.go:64] FLAG: --tls-min-version="" Jul 07 23:13:37.721090 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.713015 2564 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 23:13:37.721090 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.713019 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 23:13:37.721090 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.713024 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 23:13:37.721736 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.713029 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 23:13:37.721736 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.713033 2564 flags.go:64] FLAG: --v="2" Jul 07 23:13:37.721736 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.713040 2564 flags.go:64] FLAG: --version="false" Jul 07 23:13:37.721736 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.713047 2564 flags.go:64] FLAG: --vmodule="" Jul 07 23:13:37.721736 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.713053 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 23:13:37.721736 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.713058 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 23:13:37.721736 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713248 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 23:13:37.721736 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713254 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 23:13:37.721736 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713259 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 23:13:37.721736 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713264 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 23:13:37.721736 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713268 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 23:13:37.721736 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713272 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 23:13:37.721736 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713278 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 23:13:37.721736 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713283 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 23:13:37.721736 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713287 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 23:13:37.721736 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713293 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 23:13:37.721736 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713298 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 23:13:37.721736 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713303 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 23:13:37.721736 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713308 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 23:13:37.721736 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713312 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 23:13:37.721736 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713316 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 23:13:37.722256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713320 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 23:13:37.722256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713336 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 23:13:37.722256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713342 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 23:13:37.722256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713347 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 23:13:37.722256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713352 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 23:13:37.722256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713356 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 23:13:37.722256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713360 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 23:13:37.722256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713365 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 23:13:37.722256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713369 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 23:13:37.722256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713373 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 23:13:37.722256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713377 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 23:13:37.722256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713381 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 23:13:37.722256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713385 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 23:13:37.722256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713390 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 23:13:37.722256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713394 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 23:13:37.722256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713399 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 23:13:37.722256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713403 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 23:13:37.722256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713408 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 23:13:37.722256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713411 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 23:13:37.722256 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713415 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 23:13:37.722783 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713420 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 23:13:37.722783 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713424 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 23:13:37.722783 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713428 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 23:13:37.722783 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713435 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 23:13:37.722783 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713439 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 23:13:37.722783 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713443 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 23:13:37.722783 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713447 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 23:13:37.722783 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713451 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 23:13:37.722783 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713455 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 23:13:37.722783 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713459 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 23:13:37.722783 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713463 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 23:13:37.722783 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713467 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 23:13:37.722783 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713471 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 23:13:37.722783 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713477 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 23:13:37.722783 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713481 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 23:13:37.722783 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713486 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 23:13:37.722783 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713489 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 23:13:37.722783 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713494 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 23:13:37.722783 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713497 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 23:13:37.722783 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713501 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 23:13:37.723300 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713506 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 23:13:37.723300 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713510 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 23:13:37.723300 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713516 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 23:13:37.723300 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713523 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 23:13:37.723300 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713529 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 23:13:37.723300 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713534 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 23:13:37.723300 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713538 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 23:13:37.723300 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713543 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 23:13:37.723300 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713548 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 23:13:37.723300 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713553 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 23:13:37.723300 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713577 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 23:13:37.723300 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713582 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 23:13:37.723300 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713587 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 23:13:37.723300 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713590 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 23:13:37.723300 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713595 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 23:13:37.723300 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713602 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 23:13:37.723300 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713605 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 23:13:37.723300 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713610 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 23:13:37.723300 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713614 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 23:13:37.723829 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713618 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 23:13:37.723829 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713623 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 23:13:37.723829 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713627 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 23:13:37.723829 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713631 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 23:13:37.723829 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713635 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 23:13:37.723829 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713639 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 23:13:37.723829 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713645 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 23:13:37.723829 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713649 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 23:13:37.723829 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713654 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 23:13:37.723829 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713658 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 23:13:37.723829 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713662 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 23:13:37.723829 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713666 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 23:13:37.723829 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713670 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 23:13:37.723829 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713674 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 23:13:37.723829 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713678 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 23:13:37.723829 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713682 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 23:13:37.723829 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713686 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 23:13:37.723829 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713689 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 07 23:13:37.723829 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713693 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 23:13:37.723829 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713697 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 23:13:37.724311 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713702 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 23:13:37.724311 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713706 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 23:13:37.724311 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713711 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 23:13:37.724311 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713715 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 23:13:37.724311 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.713719 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 23:13:37.724311 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.714344 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 23:13:37.724311 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.721300 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 23:13:37.724311 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.721317 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 23:13:37.724311 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.721337 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 23:13:37.724311 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.721342 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 23:13:37.724311 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721416 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 23:13:37.724311 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721421 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 23:13:37.724311 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721423 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 23:13:37.724311 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721426 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 23:13:37.724690 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721429 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 23:13:37.724690 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721432 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 23:13:37.724690 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721435 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 23:13:37.724690 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721437 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 23:13:37.724690 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721440 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 23:13:37.724690 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721443 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 23:13:37.724690 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721446 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 23:13:37.724690 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721448 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 23:13:37.724690 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721451 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 23:13:37.724690 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721453 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 23:13:37.724690 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721456 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 23:13:37.724690 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721458 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 23:13:37.724690 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721461 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 23:13:37.724690 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721464 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 23:13:37.724690 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721466 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 23:13:37.724690 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721469 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 23:13:37.724690 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721471 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 23:13:37.724690 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721474 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 23:13:37.724690 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721476 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 23:13:37.724690 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721479 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 23:13:37.725165 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721481 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 23:13:37.725165 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721484 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 23:13:37.725165 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721486 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 23:13:37.725165 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721488 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 23:13:37.725165 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721491 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 23:13:37.725165 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721495 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 23:13:37.725165 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721498 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 23:13:37.725165 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721500 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 23:13:37.725165 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721503 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 23:13:37.725165 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721507 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 23:13:37.725165 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721511 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 23:13:37.725165 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721513 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 23:13:37.725165 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721516 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 23:13:37.725165 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721519 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 23:13:37.725165 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721522 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 23:13:37.725165 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721524 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 23:13:37.725165 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721527 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 23:13:37.725165 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721529 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 23:13:37.725165 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721533 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 23:13:37.725657 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721536 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 23:13:37.725657 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721539 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 23:13:37.725657 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721541 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 23:13:37.725657 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721545 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 23:13:37.725657 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721548 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 23:13:37.725657 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721551 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 23:13:37.725657 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721554 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 23:13:37.725657 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721557 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 23:13:37.725657 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721574 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 07 23:13:37.725657 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721577 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 23:13:37.725657 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721580 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 23:13:37.725657 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721582 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 23:13:37.725657 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721585 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 23:13:37.725657 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721588 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 23:13:37.725657 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721590 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 23:13:37.725657 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721593 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 23:13:37.725657 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721596 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 23:13:37.725657 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721598 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 23:13:37.725657 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721601 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 23:13:37.725657 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721607 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 23:13:37.726130 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721610 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 23:13:37.726130 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721613 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 23:13:37.726130 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721616 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 23:13:37.726130 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721618 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 23:13:37.726130 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721621 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 23:13:37.726130 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721623 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 23:13:37.726130 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721626 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 23:13:37.726130 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721628 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 23:13:37.726130 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721631 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 23:13:37.726130 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721633 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 23:13:37.726130 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721636 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 23:13:37.726130 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721638 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 23:13:37.726130 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721640 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 23:13:37.726130 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721643 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 23:13:37.726130 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721645 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 23:13:37.726130 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721648 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 23:13:37.726130 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721650 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 23:13:37.726130 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721653 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 23:13:37.726130 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721656 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 23:13:37.726130 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721658 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 23:13:37.727304 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721661 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 23:13:37.727304 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721663 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 23:13:37.727304 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721666 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 23:13:37.727304 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721668 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 23:13:37.727304 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721671 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 23:13:37.727304 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721674 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 23:13:37.727304 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721676 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 23:13:37.727304 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721679 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 23:13:37.727304 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721681 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 23:13:37.727304 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721683 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 23:13:37.727304 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721686 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 23:13:37.727304 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721689 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 23:13:37.727304 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721693 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 23:13:37.727304 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721695 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 23:13:37.727304 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721698 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 23:13:37.727304 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721700 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 23:13:37.727756 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.721705 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 23:13:37.727756 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721818 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 23:13:37.727756 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721823 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 23:13:37.727756 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721827 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 23:13:37.727756 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721829 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 23:13:37.727756 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721832 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 23:13:37.727756 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721835 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 23:13:37.727756 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721839 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 23:13:37.727756 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721843 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 23:13:37.727756 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721846 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 23:13:37.727756 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721848 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 23:13:37.727756 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721851 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 23:13:37.727756 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721853 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 23:13:37.727756 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721856 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 23:13:37.727756 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721859 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 23:13:37.728127 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721861 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 23:13:37.728127 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721864 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 23:13:37.728127 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721866 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 23:13:37.728127 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721868 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 23:13:37.728127 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721871 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 23:13:37.728127 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721874 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 23:13:37.728127 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721876 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 23:13:37.728127 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721879 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 23:13:37.728127 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721881 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 23:13:37.728127 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721884 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 23:13:37.728127 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721886 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 23:13:37.728127 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721888 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 23:13:37.728127 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721891 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 23:13:37.728127 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721894 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 23:13:37.728127 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721900 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 23:13:37.728127 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721904 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 23:13:37.728127 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721907 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 23:13:37.728127 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721910 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 23:13:37.728127 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721913 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 23:13:37.728127 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721915 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 23:13:37.728651 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721918 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 23:13:37.728651 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721920 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 23:13:37.728651 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721923 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 23:13:37.728651 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721925 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 23:13:37.728651 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721928 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 23:13:37.728651 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721930 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 23:13:37.728651 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721933 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 23:13:37.728651 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721935 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 23:13:37.728651 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721938 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 23:13:37.728651 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721940 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 23:13:37.728651 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721943 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 23:13:37.728651 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721945 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 23:13:37.728651 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721948 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 23:13:37.728651 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721950 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 23:13:37.728651 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721953 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 23:13:37.728651 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721955 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 23:13:37.728651 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721958 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 23:13:37.728651 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721960 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 23:13:37.728651 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721963 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 23:13:37.728651 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721965 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 23:13:37.729137 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721967 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 23:13:37.729137 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721971 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 23:13:37.729137 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721974 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 23:13:37.729137 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721977 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 23:13:37.729137 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721979 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 23:13:37.729137 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721982 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 23:13:37.729137 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721985 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 23:13:37.729137 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721988 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 23:13:37.729137 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721990 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 23:13:37.729137 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721993 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 23:13:37.729137 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721995 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 23:13:37.729137 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.721998 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 23:13:37.729137 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722001 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 23:13:37.729137 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722003 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 23:13:37.729137 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722006 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 23:13:37.729137 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722008 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 23:13:37.729137 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722011 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 23:13:37.729137 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722013 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 23:13:37.729137 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722016 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 23:13:37.729619 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722018 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 23:13:37.729619 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722020 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 23:13:37.729619 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722023 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 23:13:37.729619 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722025 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 23:13:37.729619 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722028 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 23:13:37.729619 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722030 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 23:13:37.729619 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722032 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 23:13:37.729619 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722035 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 23:13:37.729619 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722038 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 23:13:37.729619 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722040 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 23:13:37.729619 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722042 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 23:13:37.729619 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722045 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 23:13:37.729619 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722047 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 23:13:37.729619 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722050 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 23:13:37.729619 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722052 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 23:13:37.729619 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722055 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 23:13:37.729619 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722057 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 07 23:13:37.729619 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722060 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 23:13:37.729619 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722063 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 23:13:37.729619 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722065 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 23:13:37.730111 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722067 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 23:13:37.730111 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722073 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 23:13:37.730111 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722075 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 23:13:37.730111 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722078 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 23:13:37.730111 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722080 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 23:13:37.730111 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:37.722083 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 23:13:37.730111 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.722088 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 23:13:37.730111 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.722209 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 23:13:37.730111 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.724640 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 23:13:37.730111 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.725875 2564 server.go:1019] "Starting client certificate rotation" Jul 07 23:13:37.730111 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.725975 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 23:13:37.730111 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.726011 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 23:13:37.730111 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.728182 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 23:13:37.732527 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.732512 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 23:13:37.742700 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.742684 2564 log.go:25] "Validated CRI v1 runtime API" Jul 07 23:13:37.745288 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.745269 2564 log.go:25] "Validated CRI v1 image API" Jul 07 23:13:37.746768 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.746747 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 23:13:37.749705 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.749685 2564 fs.go:135] Filesystem UUIDs: map[04f72e87-6238-4701-b625-e73237792528:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 94a75e8c-3910-41f0-993b-b36456039aa4:/dev/nvme0n1p3] Jul 07 23:13:37.749758 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.749706 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 23:13:37.755771 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.755658 2564 manager.go:216] Machine: {Timestamp:2026-07-07 23:13:37.754468125 +0000 UTC m=+0.314448871 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3046848 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bc814d9c73a4260ff1fbdbfcd4d00 SystemUUID:ec2bc814-d9c7-3a42-60ff-1fbdbfcd4d00 BootID:2971205a-0cac-4baf-b9b5-ac72a8738845 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f1:16:f3:9c:63 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f1:16:f3:9c:63 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:8b:52:16:40:18 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 23:13:37.755771 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.755766 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 23:13:37.755886 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.755849 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 23:13:37.759205 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.759170 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 23:13:37.759342 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.759207 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-195.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 23:13:37.759960 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.759949 2564 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 23:13:37.759992 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.759963 2564 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 23:13:37.759992 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.759971 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 23:13:37.760687 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.760676 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 23:13:37.761921 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.761911 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 23:13:37.762628 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.762590 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 23:13:37.765026 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.765013 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 07 23:13:37.765162 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.765152 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 23:13:37.765195 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.765188 2564 kubelet.go:486] "Attempting to sync node with API server" Jul 07 23:13:37.765223 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.765210 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 23:13:37.765250 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.765233 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 23:13:37.765250 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.765246 2564 kubelet.go:398] "Adding apiserver pod source" Jul 07 23:13:37.765317 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.765257 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 23:13:37.765725 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.765713 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 23:13:37.765775 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.765732 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 23:13:37.767809 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.767791 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 23:13:37.769680 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.769667 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 23:13:37.769728 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.769697 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 23:13:37.770747 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.770736 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 23:13:37.770793 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.770751 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 23:13:37.770793 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.770757 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 23:13:37.770793 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.770761 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 23:13:37.770793 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.770770 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 23:13:37.770793 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.770775 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 23:13:37.770793 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.770784 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 23:13:37.770793 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.770789 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 23:13:37.770793 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.770796 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 23:13:37.771008 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.770804 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 23:13:37.771008 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.770818 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 23:13:37.771008 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.770823 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 23:13:37.772148 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.772134 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 23:13:37.772185 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.772152 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 23:13:37.775470 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.775455 2564 server.go:1268] "Started kubelet" Jul 07 23:13:37.775692 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.775608 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 23:13:37.775753 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.775719 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 23:13:37.775796 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.775765 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 23:13:37.776406 ip-10-0-143-195 systemd[1]: Started Kubernetes Kubelet. Jul 07 23:13:37.777388 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.777372 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 23:13:37.778227 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.778208 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-195.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 23:13:37.778678 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.778663 2564 server.go:310] "Adding debug handlers to kubelet server" Jul 07 23:13:37.778825 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:37.778798 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-195.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 23:13:37.778947 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:37.778926 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 23:13:37.783900 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:37.783881 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 23:13:37.784650 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.784636 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 23:13:37.784753 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.784731 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 23:13:37.784904 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:37.784871 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-195.ec2.internal\" not found" Jul 07 23:13:37.785329 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.785314 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 23:13:37.785329 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.785315 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 23:13:37.785456 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.785335 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 23:13:37.785456 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.785416 2564 reconstruct.go:97] "Volume reconstruction finished" Jul 07 23:13:37.785456 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.785427 2564 reconciler.go:29] "Reconciler: start to sync state" Jul 07 23:13:37.785651 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:37.783190 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-195.ec2.internal.18c024e4da7c1528 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-195.ec2.internal,UID:ip-10-0-143-195.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-195.ec2.internal,},FirstTimestamp:2026-07-07 23:13:37.775424808 +0000 UTC m=+0.335405603,LastTimestamp:2026-07-07 23:13:37.775424808 +0000 UTC m=+0.335405603,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-195.ec2.internal,}" Jul 07 23:13:37.786105 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.786087 2564 factory.go:55] Registering systemd factory Jul 07 23:13:37.786105 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.786107 2564 factory.go:223] Registration of the systemd container factory successfully Jul 07 23:13:37.786312 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.786296 2564 factory.go:153] Registering CRI-O factory Jul 07 23:13:37.786312 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.786310 2564 factory.go:223] Registration of the crio container factory successfully Jul 07 23:13:37.786436 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.786360 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 23:13:37.786436 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.786387 2564 factory.go:103] Registering Raw factory Jul 07 23:13:37.786436 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.786403 2564 manager.go:1196] Started watching for new ooms in manager Jul 07 23:13:37.787022 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.787007 2564 manager.go:349] Starting recovery of all containers Jul 07 23:13:37.789514 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:37.789486 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 23:13:37.789623 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:37.789524 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-195.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 23:13:37.795643 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.795621 2564 manager.go:354] Recovery completed Jul 07 23:13:37.796041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.796016 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q2zcw" Jul 07 23:13:37.800383 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.800370 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 23:13:37.802990 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.802973 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-195.ec2.internal" event="NodeHasSufficientMemory" Jul 07 23:13:37.803055 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.803009 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-195.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 23:13:37.803055 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.803022 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-195.ec2.internal" event="NodeHasSufficientPID" Jul 07 23:13:37.803551 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.803536 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 23:13:37.803551 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.803549 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 23:13:37.803687 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.803580 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 07 23:13:37.803687 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.803591 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 23:13:37.804337 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.804322 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q2zcw" Jul 07 23:13:37.805051 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.805035 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-195.ec2.internal" event="NodeHasSufficientMemory" Jul 07 23:13:37.805103 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.805067 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-195.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 23:13:37.805103 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.805078 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-195.ec2.internal" event="NodeHasSufficientPID" Jul 07 23:13:37.805237 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.805226 2564 policy_none.go:49] "None policy: Start" Jul 07 23:13:37.805270 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.805244 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 23:13:37.805270 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.805257 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 23:13:37.805734 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:37.805640 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-195.ec2.internal.18c024e4dc20b6f9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-195.ec2.internal,UID:ip-10-0-143-195.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-195.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-195.ec2.internal,},FirstTimestamp:2026-07-07 23:13:37.802991353 +0000 UTC m=+0.362972097,LastTimestamp:2026-07-07 23:13:37.802991353 +0000 UTC m=+0.362972097,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-195.ec2.internal,}" Jul 07 23:13:37.806475 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.806462 2564 policy_none.go:47] "Start" Jul 07 23:13:37.842250 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.842231 2564 manager.go:337] "Starting Device Plugin manager" Jul 07 23:13:37.842404 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:37.842270 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 23:13:37.842404 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.842284 2564 server.go:87] "Starting device plugin registration server" Jul 07 23:13:37.842630 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.842613 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 23:13:37.842742 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.842630 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 23:13:37.842742 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.842709 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 23:13:37.842838 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.842790 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 23:13:37.842838 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.842798 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 23:13:37.843374 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:37.843354 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 23:13:37.843459 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:37.843404 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-195.ec2.internal\" not found" Jul 07 23:13:37.943052 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.942999 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 23:13:37.944185 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.944146 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-195.ec2.internal" event="NodeHasSufficientMemory" Jul 07 23:13:37.944185 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.944176 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-195.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 23:13:37.944185 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.944185 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-195.ec2.internal" event="NodeHasSufficientPID" Jul 07 23:13:37.944307 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.944212 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-195.ec2.internal" Jul 07 23:13:37.953264 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.953211 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-195.ec2.internal" Jul 07 23:13:37.953264 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:37.953241 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-195.ec2.internal\": node \"ip-10-0-143-195.ec2.internal\" not found" Jul 07 23:13:37.959692 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.959660 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 23:13:37.961171 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.961142 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 23:13:37.961297 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.961195 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 23:13:37.961297 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.961218 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 23:13:37.961297 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:37.961262 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 23:13:37.964013 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:37.963989 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 23:13:37.971671 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:37.971648 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-195.ec2.internal\" not found" Jul 07 23:13:38.061765 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:38.061710 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-195.ec2.internal"] Jul 07 23:13:38.061963 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:38.061840 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 23:13:38.063781 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:38.063761 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-195.ec2.internal" event="NodeHasSufficientMemory" Jul 07 23:13:38.063909 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:38.063794 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-195.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 23:13:38.063909 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:38.063806 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-195.ec2.internal" event="NodeHasSufficientPID" Jul 07 23:13:38.065121 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:38.065105 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 23:13:38.065267 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:38.065251 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.ec2.internal" Jul 07 23:13:38.065345 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:38.065293 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 23:13:38.066177 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:38.066159 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-195.ec2.internal" event="NodeHasSufficientMemory" Jul 07 23:13:38.066257 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:38.066166 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-195.ec2.internal" event="NodeHasSufficientMemory" Jul 07 23:13:38.066257 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:38.066220 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-195.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 23:13:38.066257 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:38.066237 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-195.ec2.internal" event="NodeHasSufficientPID" Jul 07 23:13:38.066257 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:38.066192 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-195.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 23:13:38.066369 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:38.066264 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-195.ec2.internal" event="NodeHasSufficientPID" Jul 07 23:13:38.067460 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:38.067444 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-195.ec2.internal" Jul 07 23:13:38.067550 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:38.067471 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 23:13:38.071804 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:38.071786 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-195.ec2.internal\" not found" Jul 07 23:13:38.073468 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:38.073453 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-195.ec2.internal" event="NodeHasSufficientMemory" Jul 07 23:13:38.073537 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:38.073483 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-195.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 23:13:38.073537 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:38.073494 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-195.ec2.internal" event="NodeHasSufficientPID" Jul 07 23:13:38.084274 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:38.084254 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-195.ec2.internal\" not found" node="ip-10-0-143-195.ec2.internal" Jul 07 23:13:38.086510 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:38.086490 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9920e86aa1876c5dcd50b7872b122a7b-config\") pod \"kube-apiserver-proxy-ip-10-0-143-195.ec2.internal\" (UID: \"9920e86aa1876c5dcd50b7872b122a7b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-195.ec2.internal" Jul 07 23:13:38.086579 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:38.086518 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/27ea0ba2e575db56b4e2e077b3865048-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-195.ec2.internal\" (UID: \"27ea0ba2e575db56b4e2e077b3865048\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.ec2.internal" Jul 07 23:13:38.086579 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:38.086534 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27ea0ba2e575db56b4e2e077b3865048-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-195.ec2.internal\" (UID: \"27ea0ba2e575db56b4e2e077b3865048\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.ec2.internal" Jul 07 23:13:38.090306 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:38.090288 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-195.ec2.internal\" not found" node="ip-10-0-143-195.ec2.internal" Jul 07 23:13:38.172350 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:38.172318 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-195.ec2.internal\" not found" Jul 07 23:13:38.187685 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:38.187655 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/27ea0ba2e575db56b4e2e077b3865048-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-195.ec2.internal\" (UID: \"27ea0ba2e575db56b4e2e077b3865048\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.ec2.internal" Jul 07 23:13:38.187804 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:38.187688 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27ea0ba2e575db56b4e2e077b3865048-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-195.ec2.internal\" (UID: \"27ea0ba2e575db56b4e2e077b3865048\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.ec2.internal" Jul 07 23:13:38.187804 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:38.187705 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9920e86aa1876c5dcd50b7872b122a7b-config\") pod \"kube-apiserver-proxy-ip-10-0-143-195.ec2.internal\" (UID: \"9920e86aa1876c5dcd50b7872b122a7b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-195.ec2.internal" Jul 07 23:13:38.187804 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:38.187734 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9920e86aa1876c5dcd50b7872b122a7b-config\") pod \"kube-apiserver-proxy-ip-10-0-143-195.ec2.internal\" (UID: \"9920e86aa1876c5dcd50b7872b122a7b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-195.ec2.internal" Jul 07 23:13:38.187804 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:38.187758 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/27ea0ba2e575db56b4e2e077b3865048-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-195.ec2.internal\" (UID: \"27ea0ba2e575db56b4e2e077b3865048\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.ec2.internal" Jul 07 23:13:38.187804 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:38.187758 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27ea0ba2e575db56b4e2e077b3865048-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-195.ec2.internal\" (UID: \"27ea0ba2e575db56b4e2e077b3865048\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.ec2.internal" Jul 07 23:13:38.273120 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:38.273049 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-195.ec2.internal\" not found" Jul 07 23:13:39.523588 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:39.523541 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-195.ec2.internal\" not found" Jul 07 23:13:39.537881 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:39.537856 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.ec2.internal" Jul 07 23:13:39.544141 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:39.544119 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-195.ec2.internal" Jul 07 23:13:39.624360 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:39.624321 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-195.ec2.internal\" not found" Jul 07 23:13:39.724892 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:39.724831 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-195.ec2.internal\" not found" Jul 07 23:13:39.825459 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:39.825423 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-195.ec2.internal\" not found" Jul 07 23:13:39.875083 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:39.875047 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 23:13:39.875612 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:39.875211 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 23:13:39.926562 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:39.926531 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-195.ec2.internal\" not found" Jul 07 23:13:39.956779 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:39.956744 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 23:08:38 +0000 UTC" deadline="2028-03-11 14:01:54.336078371 +0000 UTC" Jul 07 23:13:39.956779 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:39.956775 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14702h48m14.37930724s" Jul 07 23:13:40.027143 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:40.027071 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-195.ec2.internal\" not found" Jul 07 23:13:40.042983 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:40.042952 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27ea0ba2e575db56b4e2e077b3865048.slice/crio-31245000fbf1aa774981f049df3642769c7c8e1083896dfaabb1ace265eb0689 WatchSource:0}: Error finding container 31245000fbf1aa774981f049df3642769c7c8e1083896dfaabb1ace265eb0689: Status 404 returned error can't find the container with id 31245000fbf1aa774981f049df3642769c7c8e1083896dfaabb1ace265eb0689 Jul 07 23:13:40.043400 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:40.043377 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9920e86aa1876c5dcd50b7872b122a7b.slice/crio-907ef42df85d225226e6b7cc6bb96d56efa64992d951bb55a41b8e841b4f4a39 WatchSource:0}: Error finding container 907ef42df85d225226e6b7cc6bb96d56efa64992d951bb55a41b8e841b4f4a39: Status 404 returned error can't find the container with id 907ef42df85d225226e6b7cc6bb96d56efa64992d951bb55a41b8e841b4f4a39 Jul 07 23:13:40.047106 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.047092 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 23:13:40.088544 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.088504 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 23:13:40.115223 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.115177 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-195.ec2.internal" event={"ID":"9920e86aa1876c5dcd50b7872b122a7b","Type":"ContainerStarted","Data":"907ef42df85d225226e6b7cc6bb96d56efa64992d951bb55a41b8e841b4f4a39"} Jul 07 23:13:40.116171 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.116148 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.ec2.internal" event={"ID":"27ea0ba2e575db56b4e2e077b3865048","Type":"ContainerStarted","Data":"31245000fbf1aa774981f049df3642769c7c8e1083896dfaabb1ace265eb0689"} Jul 07 23:13:40.127320 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:40.127298 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-195.ec2.internal\" not found" Jul 07 23:13:40.227849 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:40.227808 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-195.ec2.internal\" not found" Jul 07 23:13:40.249947 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.249926 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 23:13:40.328344 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:40.328249 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-195.ec2.internal\" not found" Jul 07 23:13:40.429054 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:40.429025 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-195.ec2.internal\" not found" Jul 07 23:13:40.489395 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.489369 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 23:13:40.535579 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.535532 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.ec2.internal" Jul 07 23:13:40.548012 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.547985 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 23:13:40.549117 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.549096 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-195.ec2.internal" Jul 07 23:13:40.558535 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.558510 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 23:13:40.915372 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.915340 2564 apiserver.go:52] "Watching apiserver" Jul 07 23:13:40.925094 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.925069 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 23:13:40.925568 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.925542 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-rksdr","kube-system/konnectivity-agent-xdr5m","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9zh","openshift-dns/node-resolver-r7trc","openshift-image-registry/node-ca-mkht6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.ec2.internal","openshift-multus/multus-additional-cni-plugins-hg4n2","openshift-network-operator/iptables-alerter-c4s8w","kube-system/kube-apiserver-proxy-ip-10-0-143-195.ec2.internal","openshift-cluster-node-tuning-operator/tuned-cd6cr","openshift-multus/multus-nxszt","openshift-multus/network-metrics-daemon-jcr7v","openshift-network-diagnostics/network-check-target-l8cls","openshift-ovn-kubernetes/ovnkube-node-6wsmm"] Jul 07 23:13:40.927119 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.927095 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hg4n2" Jul 07 23:13:40.928496 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.928454 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8cls" Jul 07 23:13:40.928584 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:40.928558 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8cls" podUID="dea746d7-4d19-4bbf-b437-4ddf238117b5" Jul 07 23:13:40.930146 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.930122 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9zh" Jul 07 23:13:40.931622 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.931602 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r7trc" Jul 07 23:13:40.931908 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.931891 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 23:13:40.932322 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.932291 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lbzf7\"" Jul 07 23:13:40.932449 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.932435 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 23:13:40.932540 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.932443 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 23:13:40.932540 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.932440 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 23:13:40.932863 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.932846 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mkht6" Jul 07 23:13:40.932944 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.932895 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 23:13:40.934534 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.934251 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vm876\"" Jul 07 23:13:40.934628 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.934581 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 23:13:40.937170 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.935307 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 23:13:40.937170 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.935425 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 23:13:40.937170 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.935997 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 23:13:40.937170 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.936338 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:40.937669 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.937551 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c4s8w" Jul 07 23:13:40.939813 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.939795 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:13:40.939920 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:40.939865 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rksdr" podUID="fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8" Jul 07 23:13:40.941214 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.941193 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xdr5m" Jul 07 23:13:40.942600 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.942581 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:40.944135 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.944119 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nxszt" Jul 07 23:13:40.945645 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.945625 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:13:40.945735 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:40.945704 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcr7v" podUID="f1f655ca-5728-4b21-b5ba-298b1d9fa0f7" Jul 07 23:13:40.947244 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.947209 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-host-run-ovn-kubernetes\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:40.947347 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.947247 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/21da4d2c-ae31-4c99-874d-f63cd50bc656-ovnkube-config\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:40.947347 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.947303 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2a9d0c8-6e1d-4740-8066-0f04d6e9d978-tmp-dir\") pod \"node-resolver-r7trc\" (UID: \"b2a9d0c8-6e1d-4740-8066-0f04d6e9d978\") " pod="openshift-dns/node-resolver-r7trc" Jul 07 23:13:40.947347 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.947339 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-host-run-netns\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:40.947591 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.947367 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-var-lib-openvswitch\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:40.947591 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.947411 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-etc-openvswitch\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:40.947591 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.947439 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlmsq\" (UniqueName: \"kubernetes.io/projected/21da4d2c-ae31-4c99-874d-f63cd50bc656-kube-api-access-jlmsq\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:40.947591 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.947461 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7839699b-d95d-4e11-bac2-a1cca78e8b3c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hg4n2\" (UID: \"7839699b-d95d-4e11-bac2-a1cca78e8b3c\") " pod="openshift-multus/multus-additional-cni-plugins-hg4n2" Jul 07 23:13:40.947591 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.947504 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7839699b-d95d-4e11-bac2-a1cca78e8b3c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hg4n2\" (UID: \"7839699b-d95d-4e11-bac2-a1cca78e8b3c\") " pod="openshift-multus/multus-additional-cni-plugins-hg4n2" Jul 07 23:13:40.947591 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.947529 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8c2472f6-4877-497f-b82c-e71dd1e65a2b-device-dir\") pod \"aws-ebs-csi-driver-node-gn9zh\" (UID: \"8c2472f6-4877-497f-b82c-e71dd1e65a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9zh" Jul 07 23:13:40.947591 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.947553 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9fwz\" (UniqueName: \"kubernetes.io/projected/8c2472f6-4877-497f-b82c-e71dd1e65a2b-kube-api-access-g9fwz\") pod \"aws-ebs-csi-driver-node-gn9zh\" (UID: \"8c2472f6-4877-497f-b82c-e71dd1e65a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9zh" Jul 07 23:13:40.947959 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.947594 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-run-systemd\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:40.947959 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.947631 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-node-log\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:40.947959 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.947658 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7839699b-d95d-4e11-bac2-a1cca78e8b3c-system-cni-dir\") pod \"multus-additional-cni-plugins-hg4n2\" (UID: \"7839699b-d95d-4e11-bac2-a1cca78e8b3c\") " pod="openshift-multus/multus-additional-cni-plugins-hg4n2" Jul 07 23:13:40.947959 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.947693 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8c2472f6-4877-497f-b82c-e71dd1e65a2b-socket-dir\") pod \"aws-ebs-csi-driver-node-gn9zh\" (UID: \"8c2472f6-4877-497f-b82c-e71dd1e65a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9zh" Jul 07 23:13:40.947959 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.947717 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b2a9d0c8-6e1d-4740-8066-0f04d6e9d978-hosts-file\") pod \"node-resolver-r7trc\" (UID: \"b2a9d0c8-6e1d-4740-8066-0f04d6e9d978\") " pod="openshift-dns/node-resolver-r7trc" Jul 07 23:13:40.947959 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.947739 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2vqx\" (UniqueName: \"kubernetes.io/projected/b2a9d0c8-6e1d-4740-8066-0f04d6e9d978-kube-api-access-z2vqx\") pod \"node-resolver-r7trc\" (UID: \"b2a9d0c8-6e1d-4740-8066-0f04d6e9d978\") " pod="openshift-dns/node-resolver-r7trc" Jul 07 23:13:40.947959 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.947762 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-run-ovn\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:40.947959 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.947784 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80ad2cb8-2e06-4706-b864-034ab05fffaf-host-slash\") pod \"iptables-alerter-c4s8w\" (UID: \"80ad2cb8-2e06-4706-b864-034ab05fffaf\") " pod="openshift-network-operator/iptables-alerter-c4s8w" Jul 07 23:13:40.947959 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.947805 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7839699b-d95d-4e11-bac2-a1cca78e8b3c-cni-binary-copy\") pod \"multus-additional-cni-plugins-hg4n2\" (UID: \"7839699b-d95d-4e11-bac2-a1cca78e8b3c\") " pod="openshift-multus/multus-additional-cni-plugins-hg4n2" Jul 07 23:13:40.947959 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.947827 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8c2472f6-4877-497f-b82c-e71dd1e65a2b-etc-selinux\") pod \"aws-ebs-csi-driver-node-gn9zh\" (UID: \"8c2472f6-4877-497f-b82c-e71dd1e65a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9zh" Jul 07 23:13:40.947959 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.947849 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8c2472f6-4877-497f-b82c-e71dd1e65a2b-sys-fs\") pod \"aws-ebs-csi-driver-node-gn9zh\" (UID: \"8c2472f6-4877-497f-b82c-e71dd1e65a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9zh" Jul 07 23:13:40.947959 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.947876 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-host-cni-bin\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:40.947959 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.947898 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/21da4d2c-ae31-4c99-874d-f63cd50bc656-ovn-node-metrics-cert\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:40.947959 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.947934 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/21da4d2c-ae31-4c99-874d-f63cd50bc656-ovnkube-script-lib\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:40.947959 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.947964 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ddk7\" (UniqueName: \"kubernetes.io/projected/80ad2cb8-2e06-4706-b864-034ab05fffaf-kube-api-access-9ddk7\") pod \"iptables-alerter-c4s8w\" (UID: \"80ad2cb8-2e06-4706-b864-034ab05fffaf\") " pod="openshift-network-operator/iptables-alerter-c4s8w" Jul 07 23:13:40.949041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.947989 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8c2472f6-4877-497f-b82c-e71dd1e65a2b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gn9zh\" (UID: \"8c2472f6-4877-497f-b82c-e71dd1e65a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9zh" Jul 07 23:13:40.949041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.948015 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8c2472f6-4877-497f-b82c-e71dd1e65a2b-registration-dir\") pod \"aws-ebs-csi-driver-node-gn9zh\" (UID: \"8c2472f6-4877-497f-b82c-e71dd1e65a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9zh" Jul 07 23:13:40.949041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.948077 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-host-slash\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:40.949041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.948117 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-run-openvswitch\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:40.949041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.948136 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 23:13:40.949041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.948142 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:40.949041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.948167 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7839699b-d95d-4e11-bac2-a1cca78e8b3c-os-release\") pod \"multus-additional-cni-plugins-hg4n2\" (UID: \"7839699b-d95d-4e11-bac2-a1cca78e8b3c\") " pod="openshift-multus/multus-additional-cni-plugins-hg4n2" Jul 07 23:13:40.949041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.948200 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/80ad2cb8-2e06-4706-b864-034ab05fffaf-iptables-alerter-script\") pod \"iptables-alerter-c4s8w\" (UID: \"80ad2cb8-2e06-4706-b864-034ab05fffaf\") " pod="openshift-network-operator/iptables-alerter-c4s8w" Jul 07 23:13:40.949041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.948241 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvgqw\" (UniqueName: \"kubernetes.io/projected/dea746d7-4d19-4bbf-b437-4ddf238117b5-kube-api-access-wvgqw\") pod \"network-check-target-l8cls\" (UID: \"dea746d7-4d19-4bbf-b437-4ddf238117b5\") " pod="openshift-network-diagnostics/network-check-target-l8cls" Jul 07 23:13:40.949041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.948269 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-systemd-units\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:40.949041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.948292 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-log-socket\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:40.949041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.948314 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-host-cni-netd\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:40.949041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.948335 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7839699b-d95d-4e11-bac2-a1cca78e8b3c-cnibin\") pod \"multus-additional-cni-plugins-hg4n2\" (UID: \"7839699b-d95d-4e11-bac2-a1cca78e8b3c\") " pod="openshift-multus/multus-additional-cni-plugins-hg4n2" Jul 07 23:13:40.949041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.948360 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7839699b-d95d-4e11-bac2-a1cca78e8b3c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hg4n2\" (UID: \"7839699b-d95d-4e11-bac2-a1cca78e8b3c\") " pod="openshift-multus/multus-additional-cni-plugins-hg4n2" Jul 07 23:13:40.949041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.948391 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5jrh\" (UniqueName: \"kubernetes.io/projected/97e34b22-568f-4ca3-b8ca-a38ab8ed4eb2-kube-api-access-p5jrh\") pod \"node-ca-mkht6\" (UID: \"97e34b22-568f-4ca3-b8ca-a38ab8ed4eb2\") " pod="openshift-image-registry/node-ca-mkht6" Jul 07 23:13:40.949041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.948425 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/21da4d2c-ae31-4c99-874d-f63cd50bc656-env-overrides\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:40.949861 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.948452 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j9fq\" (UniqueName: \"kubernetes.io/projected/7839699b-d95d-4e11-bac2-a1cca78e8b3c-kube-api-access-7j9fq\") pod \"multus-additional-cni-plugins-hg4n2\" (UID: \"7839699b-d95d-4e11-bac2-a1cca78e8b3c\") " pod="openshift-multus/multus-additional-cni-plugins-hg4n2" Jul 07 23:13:40.949861 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.948512 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/97e34b22-568f-4ca3-b8ca-a38ab8ed4eb2-host\") pod \"node-ca-mkht6\" (UID: \"97e34b22-568f-4ca3-b8ca-a38ab8ed4eb2\") " pod="openshift-image-registry/node-ca-mkht6" Jul 07 23:13:40.949861 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.948541 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/97e34b22-568f-4ca3-b8ca-a38ab8ed4eb2-serviceca\") pod \"node-ca-mkht6\" (UID: \"97e34b22-568f-4ca3-b8ca-a38ab8ed4eb2\") " pod="openshift-image-registry/node-ca-mkht6" Jul 07 23:13:40.949861 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.948601 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-host-kubelet\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:40.950710 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.950689 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 23:13:40.950824 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.950715 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 23:13:40.951374 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.951145 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 23:13:40.951374 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.951269 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 23:13:40.953060 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.952251 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 23:13:40.953060 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.952330 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 23:13:40.953060 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.952445 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 23:13:40.953060 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.952586 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 23:13:40.953060 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.952609 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 23:13:40.953060 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.952695 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-r6xxm\"" Jul 07 23:13:40.953060 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.952732 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fkh87\"" Jul 07 23:13:40.953060 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.952810 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 23:13:40.953060 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.952905 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lw7gj\"" Jul 07 23:13:40.953060 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.953002 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qhzgl\"" Jul 07 23:13:40.953623 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.953607 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 23:13:40.953682 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.953626 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 23:13:40.953737 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.953708 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jcsgn\"" Jul 07 23:13:40.953795 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.953744 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-78k5x\"" Jul 07 23:13:40.953944 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.953928 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 23:13:40.954069 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.954056 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 23:13:40.954121 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.954106 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 23:13:40.954900 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.954108 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 23:13:40.954900 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.954186 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 23:13:40.954900 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.954060 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hp7s5\"" Jul 07 23:13:40.954900 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.954166 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 23:13:40.961390 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.961360 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 23:13:40.999836 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:40.998228 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sbq4r" Jul 07 23:13:41.007167 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.007147 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 23:13:41.009913 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.009891 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sbq4r" Jul 07 23:13:41.036267 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.036240 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 23:13:41.048836 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.048811 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsj6v\" (UniqueName: \"kubernetes.io/projected/3a72f607-d161-4182-a32c-da418ef84a9a-kube-api-access-wsj6v\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.049022 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.048848 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-run-ovn\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.049022 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.048873 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80ad2cb8-2e06-4706-b864-034ab05fffaf-host-slash\") pod \"iptables-alerter-c4s8w\" (UID: \"80ad2cb8-2e06-4706-b864-034ab05fffaf\") " pod="openshift-network-operator/iptables-alerter-c4s8w" Jul 07 23:13:41.049022 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.048928 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7839699b-d95d-4e11-bac2-a1cca78e8b3c-cni-binary-copy\") pod \"multus-additional-cni-plugins-hg4n2\" (UID: \"7839699b-d95d-4e11-bac2-a1cca78e8b3c\") " pod="openshift-multus/multus-additional-cni-plugins-hg4n2" Jul 07 23:13:41.049022 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.048964 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8c2472f6-4877-497f-b82c-e71dd1e65a2b-etc-selinux\") pod \"aws-ebs-csi-driver-node-gn9zh\" (UID: \"8c2472f6-4877-497f-b82c-e71dd1e65a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9zh" Jul 07 23:13:41.049022 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.048976 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80ad2cb8-2e06-4706-b864-034ab05fffaf-host-slash\") pod \"iptables-alerter-c4s8w\" (UID: \"80ad2cb8-2e06-4706-b864-034ab05fffaf\") " pod="openshift-network-operator/iptables-alerter-c4s8w" Jul 07 23:13:41.049022 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.048990 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8c2472f6-4877-497f-b82c-e71dd1e65a2b-sys-fs\") pod \"aws-ebs-csi-driver-node-gn9zh\" (UID: \"8c2472f6-4877-497f-b82c-e71dd1e65a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9zh" Jul 07 23:13:41.049022 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049015 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-run-ovn\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.049370 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049052 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-lib-modules\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.049370 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049078 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-cnibin\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.049370 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049110 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-host-var-lib-kubelet\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.049370 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049139 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/21da4d2c-ae31-4c99-874d-f63cd50bc656-ovn-node-metrics-cert\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.049370 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049163 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/21da4d2c-ae31-4c99-874d-f63cd50bc656-ovnkube-script-lib\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.049370 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049173 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8c2472f6-4877-497f-b82c-e71dd1e65a2b-etc-selinux\") pod \"aws-ebs-csi-driver-node-gn9zh\" (UID: \"8c2472f6-4877-497f-b82c-e71dd1e65a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9zh" Jul 07 23:13:41.049370 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049209 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8c2472f6-4877-497f-b82c-e71dd1e65a2b-registration-dir\") pod \"aws-ebs-csi-driver-node-gn9zh\" (UID: \"8c2472f6-4877-497f-b82c-e71dd1e65a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9zh" Jul 07 23:13:41.049370 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049232 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-etc-modprobe-d\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.049370 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049253 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-run\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.049370 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049277 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8-kubelet-config\") pod \"global-pull-secret-syncer-rksdr\" (UID: \"fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8\") " pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:13:41.049370 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049314 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8-original-pull-secret\") pod \"global-pull-secret-syncer-rksdr\" (UID: \"fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8\") " pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:13:41.049370 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049339 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7839699b-d95d-4e11-bac2-a1cca78e8b3c-os-release\") pod \"multus-additional-cni-plugins-hg4n2\" (UID: \"7839699b-d95d-4e11-bac2-a1cca78e8b3c\") " pod="openshift-multus/multus-additional-cni-plugins-hg4n2" Jul 07 23:13:41.049370 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049360 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8-dbus\") pod \"global-pull-secret-syncer-rksdr\" (UID: \"fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8\") " pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:13:41.050041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049384 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-host-var-lib-cni-multus\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.050041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049407 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1f655ca-5728-4b21-b5ba-298b1d9fa0f7-metrics-certs\") pod \"network-metrics-daemon-jcr7v\" (UID: \"f1f655ca-5728-4b21-b5ba-298b1d9fa0f7\") " pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:13:41.050041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049432 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvgqw\" (UniqueName: \"kubernetes.io/projected/dea746d7-4d19-4bbf-b437-4ddf238117b5-kube-api-access-wvgqw\") pod \"network-check-target-l8cls\" (UID: \"dea746d7-4d19-4bbf-b437-4ddf238117b5\") " pod="openshift-network-diagnostics/network-check-target-l8cls" Jul 07 23:13:41.050041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049459 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7839699b-d95d-4e11-bac2-a1cca78e8b3c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hg4n2\" (UID: \"7839699b-d95d-4e11-bac2-a1cca78e8b3c\") " pod="openshift-multus/multus-additional-cni-plugins-hg4n2" Jul 07 23:13:41.050041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049503 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-host-run-multus-certs\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.050041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049528 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-etc-kubernetes\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.050041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049533 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 23:13:41.050041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049555 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/21da4d2c-ae31-4c99-874d-f63cd50bc656-env-overrides\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.050041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049589 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j9fq\" (UniqueName: \"kubernetes.io/projected/7839699b-d95d-4e11-bac2-a1cca78e8b3c-kube-api-access-7j9fq\") pod \"multus-additional-cni-plugins-hg4n2\" (UID: \"7839699b-d95d-4e11-bac2-a1cca78e8b3c\") " pod="openshift-multus/multus-additional-cni-plugins-hg4n2" Jul 07 23:13:41.050041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049616 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-host\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.050041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049638 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff5157ee-1d74-49f4-82bb-b322459baca9-etc-tuned\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.050041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049741 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-system-cni-dir\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.050041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049766 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-multus-cni-dir\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.050041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049791 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-multus-socket-dir-parent\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.050041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049814 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-etc-sysconfig\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.050041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049841 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-host-run-netns\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.050041 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049868 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7839699b-d95d-4e11-bac2-a1cca78e8b3c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hg4n2\" (UID: \"7839699b-d95d-4e11-bac2-a1cca78e8b3c\") " pod="openshift-multus/multus-additional-cni-plugins-hg4n2" Jul 07 23:13:41.050845 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049895 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8c2472f6-4877-497f-b82c-e71dd1e65a2b-device-dir\") pod \"aws-ebs-csi-driver-node-gn9zh\" (UID: \"8c2472f6-4877-497f-b82c-e71dd1e65a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9zh" Jul 07 23:13:41.050845 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049924 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b2a9d0c8-6e1d-4740-8066-0f04d6e9d978-hosts-file\") pod \"node-resolver-r7trc\" (UID: \"b2a9d0c8-6e1d-4740-8066-0f04d6e9d978\") " pod="openshift-dns/node-resolver-r7trc" Jul 07 23:13:41.050845 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049948 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1d88ada1-2d4e-4b35-8079-8c893bbe41f7-konnectivity-ca\") pod \"konnectivity-agent-xdr5m\" (UID: \"1d88ada1-2d4e-4b35-8079-8c893bbe41f7\") " pod="kube-system/konnectivity-agent-xdr5m" Jul 07 23:13:41.050845 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049971 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-host-run-k8s-cni-cncf-io\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.050845 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.049996 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-etc-systemd\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.050845 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.050024 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-node-log\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.050845 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.050048 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7839699b-d95d-4e11-bac2-a1cca78e8b3c-system-cni-dir\") pod \"multus-additional-cni-plugins-hg4n2\" (UID: \"7839699b-d95d-4e11-bac2-a1cca78e8b3c\") " pod="openshift-multus/multus-additional-cni-plugins-hg4n2" Jul 07 23:13:41.050845 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.050050 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/21da4d2c-ae31-4c99-874d-f63cd50bc656-ovnkube-script-lib\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.050845 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.050072 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2vqx\" (UniqueName: \"kubernetes.io/projected/b2a9d0c8-6e1d-4740-8066-0f04d6e9d978-kube-api-access-z2vqx\") pod \"node-resolver-r7trc\" (UID: \"b2a9d0c8-6e1d-4740-8066-0f04d6e9d978\") " pod="openshift-dns/node-resolver-r7trc" Jul 07 23:13:41.050845 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.050132 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8c2472f6-4877-497f-b82c-e71dd1e65a2b-sys-fs\") pod \"aws-ebs-csi-driver-node-gn9zh\" (UID: \"8c2472f6-4877-497f-b82c-e71dd1e65a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9zh" Jul 07 23:13:41.050845 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.050162 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-etc-sysctl-d\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.050845 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.050518 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7839699b-d95d-4e11-bac2-a1cca78e8b3c-cni-binary-copy\") pod \"multus-additional-cni-plugins-hg4n2\" (UID: \"7839699b-d95d-4e11-bac2-a1cca78e8b3c\") " pod="openshift-multus/multus-additional-cni-plugins-hg4n2" Jul 07 23:13:41.050845 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.050562 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-host-run-netns\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.050845 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.050557 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-sys\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.050845 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.050605 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3a72f607-d161-4182-a32c-da418ef84a9a-multus-daemon-config\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.050845 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.050630 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-host-cni-bin\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.050845 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.050652 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ddk7\" (UniqueName: \"kubernetes.io/projected/80ad2cb8-2e06-4706-b864-034ab05fffaf-kube-api-access-9ddk7\") pod \"iptables-alerter-c4s8w\" (UID: \"80ad2cb8-2e06-4706-b864-034ab05fffaf\") " pod="openshift-network-operator/iptables-alerter-c4s8w" Jul 07 23:13:41.051651 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.050674 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8c2472f6-4877-497f-b82c-e71dd1e65a2b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gn9zh\" (UID: \"8c2472f6-4877-497f-b82c-e71dd1e65a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9zh" Jul 07 23:13:41.051651 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.050697 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a72f607-d161-4182-a32c-da418ef84a9a-cni-binary-copy\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.051651 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.050721 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-host-slash\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.051651 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.050745 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8c2472f6-4877-497f-b82c-e71dd1e65a2b-device-dir\") pod \"aws-ebs-csi-driver-node-gn9zh\" (UID: \"8c2472f6-4877-497f-b82c-e71dd1e65a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9zh" Jul 07 23:13:41.051651 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.050743 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-run-openvswitch\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.051651 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.050775 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.051651 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.050782 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-run-openvswitch\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.051651 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.050795 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff5157ee-1d74-49f4-82bb-b322459baca9-tmp\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.051651 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.050811 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-multus-conf-dir\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.051651 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.050827 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/80ad2cb8-2e06-4706-b864-034ab05fffaf-iptables-alerter-script\") pod \"iptables-alerter-c4s8w\" (UID: \"80ad2cb8-2e06-4706-b864-034ab05fffaf\") " pod="openshift-network-operator/iptables-alerter-c4s8w" Jul 07 23:13:41.051651 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.050844 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-systemd-units\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.051651 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.050842 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/21da4d2c-ae31-4c99-874d-f63cd50bc656-env-overrides\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.051651 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.050860 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-log-socket\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.051651 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.050876 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-host-cni-netd\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.051651 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.050892 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7839699b-d95d-4e11-bac2-a1cca78e8b3c-cnibin\") pod \"multus-additional-cni-plugins-hg4n2\" (UID: \"7839699b-d95d-4e11-bac2-a1cca78e8b3c\") " pod="openshift-multus/multus-additional-cni-plugins-hg4n2" Jul 07 23:13:41.051651 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.050927 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7839699b-d95d-4e11-bac2-a1cca78e8b3c-os-release\") pod \"multus-additional-cni-plugins-hg4n2\" (UID: \"7839699b-d95d-4e11-bac2-a1cca78e8b3c\") " pod="openshift-multus/multus-additional-cni-plugins-hg4n2" Jul 07 23:13:41.051651 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.050947 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8c2472f6-4877-497f-b82c-e71dd1e65a2b-registration-dir\") pod \"aws-ebs-csi-driver-node-gn9zh\" (UID: \"8c2472f6-4877-497f-b82c-e71dd1e65a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9zh" Jul 07 23:13:41.052437 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.050977 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-host-run-netns\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.052437 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.050993 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thjf8\" (UniqueName: \"kubernetes.io/projected/f1f655ca-5728-4b21-b5ba-298b1d9fa0f7-kube-api-access-thjf8\") pod \"network-metrics-daemon-jcr7v\" (UID: \"f1f655ca-5728-4b21-b5ba-298b1d9fa0f7\") " pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:13:41.052437 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051011 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5jrh\" (UniqueName: \"kubernetes.io/projected/97e34b22-568f-4ca3-b8ca-a38ab8ed4eb2-kube-api-access-p5jrh\") pod \"node-ca-mkht6\" (UID: \"97e34b22-568f-4ca3-b8ca-a38ab8ed4eb2\") " pod="openshift-image-registry/node-ca-mkht6" Jul 07 23:13:41.052437 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051026 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-hostroot\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.052437 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051043 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/97e34b22-568f-4ca3-b8ca-a38ab8ed4eb2-host\") pod \"node-ca-mkht6\" (UID: \"97e34b22-568f-4ca3-b8ca-a38ab8ed4eb2\") " pod="openshift-image-registry/node-ca-mkht6" Jul 07 23:13:41.052437 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051057 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/97e34b22-568f-4ca3-b8ca-a38ab8ed4eb2-serviceca\") pod \"node-ca-mkht6\" (UID: \"97e34b22-568f-4ca3-b8ca-a38ab8ed4eb2\") " pod="openshift-image-registry/node-ca-mkht6" Jul 07 23:13:41.052437 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051087 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-host-kubelet\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.052437 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051105 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-host-run-ovn-kubernetes\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.052437 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051121 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/21da4d2c-ae31-4c99-874d-f63cd50bc656-ovnkube-config\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.052437 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051136 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2a9d0c8-6e1d-4740-8066-0f04d6e9d978-tmp-dir\") pod \"node-resolver-r7trc\" (UID: \"b2a9d0c8-6e1d-4740-8066-0f04d6e9d978\") " pod="openshift-dns/node-resolver-r7trc" Jul 07 23:13:41.052437 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051150 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-etc-sysctl-conf\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.052437 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051166 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-etc-kubernetes\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.052437 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051183 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-var-lib-openvswitch\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.052437 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051201 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-etc-openvswitch\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.052437 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051213 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-host-cni-bin\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.052437 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051215 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7839699b-d95d-4e11-bac2-a1cca78e8b3c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hg4n2\" (UID: \"7839699b-d95d-4e11-bac2-a1cca78e8b3c\") " pod="openshift-multus/multus-additional-cni-plugins-hg4n2" Jul 07 23:13:41.052437 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051217 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlmsq\" (UniqueName: \"kubernetes.io/projected/21da4d2c-ae31-4c99-874d-f63cd50bc656-kube-api-access-jlmsq\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.053125 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051263 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7839699b-d95d-4e11-bac2-a1cca78e8b3c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hg4n2\" (UID: \"7839699b-d95d-4e11-bac2-a1cca78e8b3c\") " pod="openshift-multus/multus-additional-cni-plugins-hg4n2" Jul 07 23:13:41.053125 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051280 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8c2472f6-4877-497f-b82c-e71dd1e65a2b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gn9zh\" (UID: \"8c2472f6-4877-497f-b82c-e71dd1e65a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9zh" Jul 07 23:13:41.053125 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051294 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9fwz\" (UniqueName: \"kubernetes.io/projected/8c2472f6-4877-497f-b82c-e71dd1e65a2b-kube-api-access-g9fwz\") pod \"aws-ebs-csi-driver-node-gn9zh\" (UID: \"8c2472f6-4877-497f-b82c-e71dd1e65a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9zh" Jul 07 23:13:41.053125 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051323 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1d88ada1-2d4e-4b35-8079-8c893bbe41f7-agent-certs\") pod \"konnectivity-agent-xdr5m\" (UID: \"1d88ada1-2d4e-4b35-8079-8c893bbe41f7\") " pod="kube-system/konnectivity-agent-xdr5m" Jul 07 23:13:41.053125 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051328 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-host-slash\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.053125 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051357 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-var-lib-kubelet\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.053125 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051360 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7839699b-d95d-4e11-bac2-a1cca78e8b3c-cnibin\") pod \"multus-additional-cni-plugins-hg4n2\" (UID: \"7839699b-d95d-4e11-bac2-a1cca78e8b3c\") " pod="openshift-multus/multus-additional-cni-plugins-hg4n2" Jul 07 23:13:41.053125 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051387 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.053125 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051405 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-run-systemd\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.053125 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051411 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7839699b-d95d-4e11-bac2-a1cca78e8b3c-system-cni-dir\") pod \"multus-additional-cni-plugins-hg4n2\" (UID: \"7839699b-d95d-4e11-bac2-a1cca78e8b3c\") " pod="openshift-multus/multus-additional-cni-plugins-hg4n2" Jul 07 23:13:41.053125 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051422 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8c2472f6-4877-497f-b82c-e71dd1e65a2b-socket-dir\") pod \"aws-ebs-csi-driver-node-gn9zh\" (UID: \"8c2472f6-4877-497f-b82c-e71dd1e65a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9zh" Jul 07 23:13:41.053125 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051440 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdnj7\" (UniqueName: \"kubernetes.io/projected/ff5157ee-1d74-49f4-82bb-b322459baca9-kube-api-access-gdnj7\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.053125 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051456 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-os-release\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.053125 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051473 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-host-var-lib-cni-bin\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.053125 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051552 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-host-cni-netd\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.053125 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051605 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-systemd-units\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.053125 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051652 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-log-socket\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.053786 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051705 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/97e34b22-568f-4ca3-b8ca-a38ab8ed4eb2-host\") pod \"node-ca-mkht6\" (UID: \"97e34b22-568f-4ca3-b8ca-a38ab8ed4eb2\") " pod="openshift-image-registry/node-ca-mkht6" Jul 07 23:13:41.053786 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051909 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/80ad2cb8-2e06-4706-b864-034ab05fffaf-iptables-alerter-script\") pod \"iptables-alerter-c4s8w\" (UID: \"80ad2cb8-2e06-4706-b864-034ab05fffaf\") " pod="openshift-network-operator/iptables-alerter-c4s8w" Jul 07 23:13:41.053786 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051971 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b2a9d0c8-6e1d-4740-8066-0f04d6e9d978-hosts-file\") pod \"node-resolver-r7trc\" (UID: \"b2a9d0c8-6e1d-4740-8066-0f04d6e9d978\") " pod="openshift-dns/node-resolver-r7trc" Jul 07 23:13:41.053786 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.051994 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/97e34b22-568f-4ca3-b8ca-a38ab8ed4eb2-serviceca\") pod \"node-ca-mkht6\" (UID: \"97e34b22-568f-4ca3-b8ca-a38ab8ed4eb2\") " pod="openshift-image-registry/node-ca-mkht6" Jul 07 23:13:41.053786 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.052003 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-node-log\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.053786 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.052031 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-host-run-ovn-kubernetes\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.053786 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.052044 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-host-kubelet\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.053786 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.052087 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-var-lib-openvswitch\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.053786 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.052114 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-etc-openvswitch\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.053786 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.052217 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7839699b-d95d-4e11-bac2-a1cca78e8b3c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hg4n2\" (UID: \"7839699b-d95d-4e11-bac2-a1cca78e8b3c\") " pod="openshift-multus/multus-additional-cni-plugins-hg4n2" Jul 07 23:13:41.053786 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.052298 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7839699b-d95d-4e11-bac2-a1cca78e8b3c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hg4n2\" (UID: \"7839699b-d95d-4e11-bac2-a1cca78e8b3c\") " pod="openshift-multus/multus-additional-cni-plugins-hg4n2" Jul 07 23:13:41.053786 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.052337 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/21da4d2c-ae31-4c99-874d-f63cd50bc656-run-systemd\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.053786 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.052412 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8c2472f6-4877-497f-b82c-e71dd1e65a2b-socket-dir\") pod \"aws-ebs-csi-driver-node-gn9zh\" (UID: \"8c2472f6-4877-497f-b82c-e71dd1e65a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9zh" Jul 07 23:13:41.053786 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.052463 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/21da4d2c-ae31-4c99-874d-f63cd50bc656-ovnkube-config\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.053786 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.052743 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2a9d0c8-6e1d-4740-8066-0f04d6e9d978-tmp-dir\") pod \"node-resolver-r7trc\" (UID: \"b2a9d0c8-6e1d-4740-8066-0f04d6e9d978\") " pod="openshift-dns/node-resolver-r7trc" Jul 07 23:13:41.053786 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.053327 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/21da4d2c-ae31-4c99-874d-f63cd50bc656-ovn-node-metrics-cert\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.065764 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:41.065737 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 23:13:41.065764 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:41.065765 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 23:13:41.065941 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:41.065781 2564 projected.go:196] Error preparing data for projected volume kube-api-access-wvgqw for pod openshift-network-diagnostics/network-check-target-l8cls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 23:13:41.065941 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:41.065857 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dea746d7-4d19-4bbf-b437-4ddf238117b5-kube-api-access-wvgqw podName:dea746d7-4d19-4bbf-b437-4ddf238117b5 nodeName:}" failed. No retries permitted until 2026-07-07 23:13:41.565833756 +0000 UTC m=+2.975895978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wvgqw" (UniqueName: "kubernetes.io/projected/dea746d7-4d19-4bbf-b437-4ddf238117b5-kube-api-access-wvgqw") pod "network-check-target-l8cls" (UID: "dea746d7-4d19-4bbf-b437-4ddf238117b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 23:13:41.067175 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.067147 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9fwz\" (UniqueName: \"kubernetes.io/projected/8c2472f6-4877-497f-b82c-e71dd1e65a2b-kube-api-access-g9fwz\") pod \"aws-ebs-csi-driver-node-gn9zh\" (UID: \"8c2472f6-4877-497f-b82c-e71dd1e65a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9zh" Jul 07 23:13:41.067281 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.067157 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2vqx\" (UniqueName: \"kubernetes.io/projected/b2a9d0c8-6e1d-4740-8066-0f04d6e9d978-kube-api-access-z2vqx\") pod \"node-resolver-r7trc\" (UID: \"b2a9d0c8-6e1d-4740-8066-0f04d6e9d978\") " pod="openshift-dns/node-resolver-r7trc" Jul 07 23:13:41.067281 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.067157 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j9fq\" (UniqueName: \"kubernetes.io/projected/7839699b-d95d-4e11-bac2-a1cca78e8b3c-kube-api-access-7j9fq\") pod \"multus-additional-cni-plugins-hg4n2\" (UID: \"7839699b-d95d-4e11-bac2-a1cca78e8b3c\") " pod="openshift-multus/multus-additional-cni-plugins-hg4n2" Jul 07 23:13:41.068653 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.068626 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ddk7\" (UniqueName: \"kubernetes.io/projected/80ad2cb8-2e06-4706-b864-034ab05fffaf-kube-api-access-9ddk7\") pod \"iptables-alerter-c4s8w\" (UID: \"80ad2cb8-2e06-4706-b864-034ab05fffaf\") " pod="openshift-network-operator/iptables-alerter-c4s8w" Jul 07 23:13:41.069717 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.069692 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5jrh\" (UniqueName: \"kubernetes.io/projected/97e34b22-568f-4ca3-b8ca-a38ab8ed4eb2-kube-api-access-p5jrh\") pod \"node-ca-mkht6\" (UID: \"97e34b22-568f-4ca3-b8ca-a38ab8ed4eb2\") " pod="openshift-image-registry/node-ca-mkht6" Jul 07 23:13:41.069831 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.069806 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlmsq\" (UniqueName: \"kubernetes.io/projected/21da4d2c-ae31-4c99-874d-f63cd50bc656-kube-api-access-jlmsq\") pod \"ovnkube-node-6wsmm\" (UID: \"21da4d2c-ae31-4c99-874d-f63cd50bc656\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.152796 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.152766 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1d88ada1-2d4e-4b35-8079-8c893bbe41f7-agent-certs\") pod \"konnectivity-agent-xdr5m\" (UID: \"1d88ada1-2d4e-4b35-8079-8c893bbe41f7\") " pod="kube-system/konnectivity-agent-xdr5m" Jul 07 23:13:41.152796 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.152797 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-var-lib-kubelet\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.152796 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.152814 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdnj7\" (UniqueName: \"kubernetes.io/projected/ff5157ee-1d74-49f4-82bb-b322459baca9-kube-api-access-gdnj7\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.153080 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.152831 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-os-release\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.153080 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.152921 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-os-release\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.153080 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.152924 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-var-lib-kubelet\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.153080 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.152974 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-host-var-lib-cni-bin\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.153080 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153006 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsj6v\" (UniqueName: \"kubernetes.io/projected/3a72f607-d161-4182-a32c-da418ef84a9a-kube-api-access-wsj6v\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.153080 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153035 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-lib-modules\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.153080 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153054 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-host-var-lib-cni-bin\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.153396 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153102 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-cnibin\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.153396 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153057 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-cnibin\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.153396 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153129 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-host-var-lib-kubelet\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.153396 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153153 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-etc-modprobe-d\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.153396 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153168 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-run\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.153396 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153184 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8-kubelet-config\") pod \"global-pull-secret-syncer-rksdr\" (UID: \"fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8\") " pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:13:41.153396 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153207 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8-original-pull-secret\") pod \"global-pull-secret-syncer-rksdr\" (UID: \"fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8\") " pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:13:41.153396 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153230 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8-dbus\") pod \"global-pull-secret-syncer-rksdr\" (UID: \"fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8\") " pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:13:41.153396 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153249 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-host-var-lib-cni-multus\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.153396 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153249 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-lib-modules\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.153396 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153274 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1f655ca-5728-4b21-b5ba-298b1d9fa0f7-metrics-certs\") pod \"network-metrics-daemon-jcr7v\" (UID: \"f1f655ca-5728-4b21-b5ba-298b1d9fa0f7\") " pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:13:41.153396 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153292 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-etc-modprobe-d\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.153396 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153297 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-host-var-lib-kubelet\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.153396 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153313 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-host-run-multus-certs\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.153396 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153337 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-etc-kubernetes\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.153396 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153343 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-run\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.153396 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153350 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8-kubelet-config\") pod \"global-pull-secret-syncer-rksdr\" (UID: \"fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8\") " pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:13:41.153396 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153364 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-host\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.154275 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153374 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-host-var-lib-cni-multus\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.154275 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153382 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-host-run-multus-certs\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.154275 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153387 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff5157ee-1d74-49f4-82bb-b322459baca9-etc-tuned\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.154275 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:41.153338 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 23:13:41.154275 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:41.153407 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 23:13:41.154275 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153413 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-system-cni-dir\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.154275 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153453 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-host\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.154275 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:41.153457 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8-original-pull-secret podName:fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8 nodeName:}" failed. No retries permitted until 2026-07-07 23:13:41.653436529 +0000 UTC m=+3.063498759 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8-original-pull-secret") pod "global-pull-secret-syncer-rksdr" (UID: "fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8") : object "kube-system"/"original-pull-secret" not registered Jul 07 23:13:41.154275 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153467 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-system-cni-dir\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.154275 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153471 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-multus-cni-dir\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.154275 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153512 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-etc-kubernetes\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.154275 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153520 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-multus-socket-dir-parent\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.154275 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153544 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-etc-sysconfig\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.154275 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153572 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1d88ada1-2d4e-4b35-8079-8c893bbe41f7-konnectivity-ca\") pod \"konnectivity-agent-xdr5m\" (UID: \"1d88ada1-2d4e-4b35-8079-8c893bbe41f7\") " pod="kube-system/konnectivity-agent-xdr5m" Jul 07 23:13:41.154275 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153575 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8-dbus\") pod \"global-pull-secret-syncer-rksdr\" (UID: \"fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8\") " pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:13:41.154275 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153525 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-multus-cni-dir\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.154275 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153594 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-host-run-k8s-cni-cncf-io\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.154275 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153625 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-host-run-k8s-cni-cncf-io\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.155100 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153626 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-etc-systemd\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.155100 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153663 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-etc-sysctl-d\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.155100 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153665 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-etc-systemd\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.155100 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:41.153677 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1f655ca-5728-4b21-b5ba-298b1d9fa0f7-metrics-certs podName:f1f655ca-5728-4b21-b5ba-298b1d9fa0f7 nodeName:}" failed. No retries permitted until 2026-07-07 23:13:41.653662731 +0000 UTC m=+3.063724954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1f655ca-5728-4b21-b5ba-298b1d9fa0f7-metrics-certs") pod "network-metrics-daemon-jcr7v" (UID: "f1f655ca-5728-4b21-b5ba-298b1d9fa0f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 23:13:41.155100 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153704 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-multus-socket-dir-parent\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.155100 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153711 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-sys\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.155100 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153738 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3a72f607-d161-4182-a32c-da418ef84a9a-multus-daemon-config\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.155100 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153754 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-sys\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.155100 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153763 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a72f607-d161-4182-a32c-da418ef84a9a-cni-binary-copy\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.155100 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153786 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff5157ee-1d74-49f4-82bb-b322459baca9-tmp\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.155100 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153809 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-multus-conf-dir\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.155100 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153812 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-etc-sysctl-d\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.155100 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153846 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-host-run-netns\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.155100 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153854 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-multus-conf-dir\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.155100 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153713 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-etc-sysconfig\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.155100 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153872 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thjf8\" (UniqueName: \"kubernetes.io/projected/f1f655ca-5728-4b21-b5ba-298b1d9fa0f7-kube-api-access-thjf8\") pod \"network-metrics-daemon-jcr7v\" (UID: \"f1f655ca-5728-4b21-b5ba-298b1d9fa0f7\") " pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:13:41.155100 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153898 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-hostroot\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.155856 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153927 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-etc-sysctl-conf\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.155856 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.153949 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-etc-kubernetes\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.155856 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.154013 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-etc-kubernetes\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.155856 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.154052 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-host-run-netns\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.155856 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.154256 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3a72f607-d161-4182-a32c-da418ef84a9a-hostroot\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.155856 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.154291 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1d88ada1-2d4e-4b35-8079-8c893bbe41f7-konnectivity-ca\") pod \"konnectivity-agent-xdr5m\" (UID: \"1d88ada1-2d4e-4b35-8079-8c893bbe41f7\") " pod="kube-system/konnectivity-agent-xdr5m" Jul 07 23:13:41.155856 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.154375 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3a72f607-d161-4182-a32c-da418ef84a9a-multus-daemon-config\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.155856 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.154381 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff5157ee-1d74-49f4-82bb-b322459baca9-etc-sysctl-conf\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.155856 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.154825 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a72f607-d161-4182-a32c-da418ef84a9a-cni-binary-copy\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.155856 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.155475 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1d88ada1-2d4e-4b35-8079-8c893bbe41f7-agent-certs\") pod \"konnectivity-agent-xdr5m\" (UID: \"1d88ada1-2d4e-4b35-8079-8c893bbe41f7\") " pod="kube-system/konnectivity-agent-xdr5m" Jul 07 23:13:41.157029 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.157008 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff5157ee-1d74-49f4-82bb-b322459baca9-tmp\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.158668 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.158645 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff5157ee-1d74-49f4-82bb-b322459baca9-etc-tuned\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.173291 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.173228 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdnj7\" (UniqueName: \"kubernetes.io/projected/ff5157ee-1d74-49f4-82bb-b322459baca9-kube-api-access-gdnj7\") pod \"tuned-cd6cr\" (UID: \"ff5157ee-1d74-49f4-82bb-b322459baca9\") " pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.174966 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.174934 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thjf8\" (UniqueName: \"kubernetes.io/projected/f1f655ca-5728-4b21-b5ba-298b1d9fa0f7-kube-api-access-thjf8\") pod \"network-metrics-daemon-jcr7v\" (UID: \"f1f655ca-5728-4b21-b5ba-298b1d9fa0f7\") " pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:13:41.175185 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.175167 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsj6v\" (UniqueName: \"kubernetes.io/projected/3a72f607-d161-4182-a32c-da418ef84a9a-kube-api-access-wsj6v\") pod \"multus-nxszt\" (UID: \"3a72f607-d161-4182-a32c-da418ef84a9a\") " pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.247042 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.247011 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hg4n2" Jul 07 23:13:41.254416 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.254393 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9zh" Jul 07 23:13:41.264220 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.264193 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r7trc" Jul 07 23:13:41.271706 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.271684 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mkht6" Jul 07 23:13:41.278958 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.278937 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:13:41.285959 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.285941 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c4s8w" Jul 07 23:13:41.295264 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.295244 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xdr5m" Jul 07 23:13:41.302978 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.302956 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" Jul 07 23:13:41.308542 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.308523 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nxszt" Jul 07 23:13:41.657398 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.657348 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8-original-pull-secret\") pod \"global-pull-secret-syncer-rksdr\" (UID: \"fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8\") " pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:13:41.657398 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.657398 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1f655ca-5728-4b21-b5ba-298b1d9fa0f7-metrics-certs\") pod \"network-metrics-daemon-jcr7v\" (UID: \"f1f655ca-5728-4b21-b5ba-298b1d9fa0f7\") " pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:13:41.657649 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:41.657431 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvgqw\" (UniqueName: \"kubernetes.io/projected/dea746d7-4d19-4bbf-b437-4ddf238117b5-kube-api-access-wvgqw\") pod \"network-check-target-l8cls\" (UID: \"dea746d7-4d19-4bbf-b437-4ddf238117b5\") " pod="openshift-network-diagnostics/network-check-target-l8cls" Jul 07 23:13:41.657649 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:41.657524 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 23:13:41.657649 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:41.657579 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 23:13:41.657649 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:41.657591 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8-original-pull-secret podName:fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8 nodeName:}" failed. No retries permitted until 2026-07-07 23:13:42.657571964 +0000 UTC m=+4.067634182 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8-original-pull-secret") pod "global-pull-secret-syncer-rksdr" (UID: "fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8") : object "kube-system"/"original-pull-secret" not registered Jul 07 23:13:41.657649 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:41.657599 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 23:13:41.657649 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:41.657612 2564 projected.go:196] Error preparing data for projected volume kube-api-access-wvgqw for pod openshift-network-diagnostics/network-check-target-l8cls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 23:13:41.657931 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:41.657656 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dea746d7-4d19-4bbf-b437-4ddf238117b5-kube-api-access-wvgqw podName:dea746d7-4d19-4bbf-b437-4ddf238117b5 nodeName:}" failed. No retries permitted until 2026-07-07 23:13:42.657644526 +0000 UTC m=+4.067706759 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wvgqw" (UniqueName: "kubernetes.io/projected/dea746d7-4d19-4bbf-b437-4ddf238117b5-kube-api-access-wvgqw") pod "network-check-target-l8cls" (UID: "dea746d7-4d19-4bbf-b437-4ddf238117b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 23:13:41.657931 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:41.657707 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 23:13:41.657931 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:41.657736 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1f655ca-5728-4b21-b5ba-298b1d9fa0f7-metrics-certs podName:f1f655ca-5728-4b21-b5ba-298b1d9fa0f7 nodeName:}" failed. No retries permitted until 2026-07-07 23:13:42.657728206 +0000 UTC m=+4.067790422 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1f655ca-5728-4b21-b5ba-298b1d9fa0f7-metrics-certs") pod "network-metrics-daemon-jcr7v" (UID: "f1f655ca-5728-4b21-b5ba-298b1d9fa0f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 23:13:41.998300 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:41.998007 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21da4d2c_ae31_4c99_874d_f63cd50bc656.slice/crio-7575da5e2a3ebe1be456687bd24f9a52d8fa8310e15a2cdfabeac4a089afcadf WatchSource:0}: Error finding container 7575da5e2a3ebe1be456687bd24f9a52d8fa8310e15a2cdfabeac4a089afcadf: Status 404 returned error can't find the container with id 7575da5e2a3ebe1be456687bd24f9a52d8fa8310e15a2cdfabeac4a089afcadf Jul 07 23:13:42.002205 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:42.002173 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2a9d0c8_6e1d_4740_8066_0f04d6e9d978.slice/crio-09e513796708c09b4be14c0a0e4b936dd5bb73e3592b3f90e1c3e04cd2078a1e WatchSource:0}: Error finding container 09e513796708c09b4be14c0a0e4b936dd5bb73e3592b3f90e1c3e04cd2078a1e: Status 404 returned error can't find the container with id 09e513796708c09b4be14c0a0e4b936dd5bb73e3592b3f90e1c3e04cd2078a1e Jul 07 23:13:42.002971 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:42.002943 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97e34b22_568f_4ca3_b8ca_a38ab8ed4eb2.slice/crio-86af45ecf263417a88819ea0224555e2b719b6ce24a0b7855a5a80af449fed15 WatchSource:0}: Error finding container 86af45ecf263417a88819ea0224555e2b719b6ce24a0b7855a5a80af449fed15: Status 404 returned error can't find the container with id 86af45ecf263417a88819ea0224555e2b719b6ce24a0b7855a5a80af449fed15 Jul 07 23:13:42.003637 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:42.003605 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a72f607_d161_4182_a32c_da418ef84a9a.slice/crio-9dfe672b2bf4afe8ce222d3683be4c6db99ccd261d486511d238727682f01bb9 WatchSource:0}: Error finding container 9dfe672b2bf4afe8ce222d3683be4c6db99ccd261d486511d238727682f01bb9: Status 404 returned error can't find the container with id 9dfe672b2bf4afe8ce222d3683be4c6db99ccd261d486511d238727682f01bb9 Jul 07 23:13:42.004364 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:42.004290 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80ad2cb8_2e06_4706_b864_034ab05fffaf.slice/crio-5512fee95eb85b1e5c55f3111a2944461e02c76d08ef745185b92c9f9caceb69 WatchSource:0}: Error finding container 5512fee95eb85b1e5c55f3111a2944461e02c76d08ef745185b92c9f9caceb69: Status 404 returned error can't find the container with id 5512fee95eb85b1e5c55f3111a2944461e02c76d08ef745185b92c9f9caceb69 Jul 07 23:13:42.005739 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:42.005713 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c2472f6_4877_497f_b82c_e71dd1e65a2b.slice/crio-7094f38c5a56730ee6432b3383b4b800f10567df5693c0bf5d507ed0dec9a767 WatchSource:0}: Error finding container 7094f38c5a56730ee6432b3383b4b800f10567df5693c0bf5d507ed0dec9a767: Status 404 returned error can't find the container with id 7094f38c5a56730ee6432b3383b4b800f10567df5693c0bf5d507ed0dec9a767 Jul 07 23:13:42.006450 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:42.006298 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7839699b_d95d_4e11_bac2_a1cca78e8b3c.slice/crio-2822c78e21eb1a5ac76f45f08ec67445766f1341c6a21a64f50d6f51296008a5 WatchSource:0}: Error finding container 2822c78e21eb1a5ac76f45f08ec67445766f1341c6a21a64f50d6f51296008a5: Status 404 returned error can't find the container with id 2822c78e21eb1a5ac76f45f08ec67445766f1341c6a21a64f50d6f51296008a5 Jul 07 23:13:42.007330 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:42.007266 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d88ada1_2d4e_4b35_8079_8c893bbe41f7.slice/crio-8d536cdc740c4ec2d0f66263ce759657c65c195b285ae3331d9ae476e0e9339f WatchSource:0}: Error finding container 8d536cdc740c4ec2d0f66263ce759657c65c195b285ae3331d9ae476e0e9339f: Status 404 returned error can't find the container with id 8d536cdc740c4ec2d0f66263ce759657c65c195b285ae3331d9ae476e0e9339f Jul 07 23:13:42.008352 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:13:42.008320 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff5157ee_1d74_49f4_82bb_b322459baca9.slice/crio-141359f5993d0b3d15fb516d242c3a0e8e93cad1769eeeda03ecfea87ffc4022 WatchSource:0}: Error finding container 141359f5993d0b3d15fb516d242c3a0e8e93cad1769eeeda03ecfea87ffc4022: Status 404 returned error can't find the container with id 141359f5993d0b3d15fb516d242c3a0e8e93cad1769eeeda03ecfea87ffc4022 Jul 07 23:13:42.012087 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:42.012048 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 23:08:40 +0000 UTC" deadline="2027-12-31 02:06:13.896007282 +0000 UTC" Jul 07 23:13:42.012087 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:42.012085 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12986h52m31.88392476s" Jul 07 23:13:42.112297 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:42.112069 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:13:42.112447 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:42.112392 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rksdr" podUID="fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8" Jul 07 23:13:42.123513 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:42.123445 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-195.ec2.internal" event={"ID":"9920e86aa1876c5dcd50b7872b122a7b","Type":"ContainerStarted","Data":"67fc207cc3b858c06bda04e33c258e2193b7bff266744a37f4eefff18b44f394"} Jul 07 23:13:42.124744 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:42.124712 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xdr5m" event={"ID":"1d88ada1-2d4e-4b35-8079-8c893bbe41f7","Type":"ContainerStarted","Data":"8d536cdc740c4ec2d0f66263ce759657c65c195b285ae3331d9ae476e0e9339f"} Jul 07 23:13:42.125743 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:42.125724 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9zh" event={"ID":"8c2472f6-4877-497f-b82c-e71dd1e65a2b","Type":"ContainerStarted","Data":"7094f38c5a56730ee6432b3383b4b800f10567df5693c0bf5d507ed0dec9a767"} Jul 07 23:13:42.127905 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:42.127884 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r7trc" event={"ID":"b2a9d0c8-6e1d-4740-8066-0f04d6e9d978","Type":"ContainerStarted","Data":"09e513796708c09b4be14c0a0e4b936dd5bb73e3592b3f90e1c3e04cd2078a1e"} Jul 07 23:13:42.129874 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:42.129853 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" event={"ID":"ff5157ee-1d74-49f4-82bb-b322459baca9","Type":"ContainerStarted","Data":"141359f5993d0b3d15fb516d242c3a0e8e93cad1769eeeda03ecfea87ffc4022"} Jul 07 23:13:42.130848 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:42.130830 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hg4n2" event={"ID":"7839699b-d95d-4e11-bac2-a1cca78e8b3c","Type":"ContainerStarted","Data":"2822c78e21eb1a5ac76f45f08ec67445766f1341c6a21a64f50d6f51296008a5"} Jul 07 23:13:42.133832 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:42.133807 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c4s8w" event={"ID":"80ad2cb8-2e06-4706-b864-034ab05fffaf","Type":"ContainerStarted","Data":"5512fee95eb85b1e5c55f3111a2944461e02c76d08ef745185b92c9f9caceb69"} Jul 07 23:13:42.134783 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:42.134767 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nxszt" event={"ID":"3a72f607-d161-4182-a32c-da418ef84a9a","Type":"ContainerStarted","Data":"9dfe672b2bf4afe8ce222d3683be4c6db99ccd261d486511d238727682f01bb9"} Jul 07 23:13:42.136560 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:42.136540 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mkht6" event={"ID":"97e34b22-568f-4ca3-b8ca-a38ab8ed4eb2","Type":"ContainerStarted","Data":"86af45ecf263417a88819ea0224555e2b719b6ce24a0b7855a5a80af449fed15"} Jul 07 23:13:42.141534 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:42.141511 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" event={"ID":"21da4d2c-ae31-4c99-874d-f63cd50bc656","Type":"ContainerStarted","Data":"7575da5e2a3ebe1be456687bd24f9a52d8fa8310e15a2cdfabeac4a089afcadf"} Jul 07 23:13:42.141635 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:42.141601 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-195.ec2.internal" podStartSLOduration=2.14158888 podStartE2EDuration="2.14158888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:13:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:13:42.141496315 +0000 UTC m=+3.551558548" watchObservedRunningTime="2026-07-07 23:13:42.14158888 +0000 UTC m=+3.551651117" Jul 07 23:13:42.664014 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:42.662983 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8-original-pull-secret\") pod \"global-pull-secret-syncer-rksdr\" (UID: \"fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8\") " pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:13:42.664014 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:42.663036 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1f655ca-5728-4b21-b5ba-298b1d9fa0f7-metrics-certs\") pod \"network-metrics-daemon-jcr7v\" (UID: \"f1f655ca-5728-4b21-b5ba-298b1d9fa0f7\") " pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:13:42.664014 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:42.663062 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvgqw\" (UniqueName: \"kubernetes.io/projected/dea746d7-4d19-4bbf-b437-4ddf238117b5-kube-api-access-wvgqw\") pod \"network-check-target-l8cls\" (UID: \"dea746d7-4d19-4bbf-b437-4ddf238117b5\") " pod="openshift-network-diagnostics/network-check-target-l8cls" Jul 07 23:13:42.664014 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:42.663223 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 23:13:42.664014 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:42.663244 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 23:13:42.664014 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:42.663257 2564 projected.go:196] Error preparing data for projected volume kube-api-access-wvgqw for pod openshift-network-diagnostics/network-check-target-l8cls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 23:13:42.664014 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:42.663313 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dea746d7-4d19-4bbf-b437-4ddf238117b5-kube-api-access-wvgqw podName:dea746d7-4d19-4bbf-b437-4ddf238117b5 nodeName:}" failed. No retries permitted until 2026-07-07 23:13:44.663295248 +0000 UTC m=+6.073357465 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wvgqw" (UniqueName: "kubernetes.io/projected/dea746d7-4d19-4bbf-b437-4ddf238117b5-kube-api-access-wvgqw") pod "network-check-target-l8cls" (UID: "dea746d7-4d19-4bbf-b437-4ddf238117b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 23:13:42.664014 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:42.663777 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 23:13:42.664014 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:42.663826 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8-original-pull-secret podName:fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8 nodeName:}" failed. No retries permitted until 2026-07-07 23:13:44.663811038 +0000 UTC m=+6.073873255 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8-original-pull-secret") pod "global-pull-secret-syncer-rksdr" (UID: "fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8") : object "kube-system"/"original-pull-secret" not registered Jul 07 23:13:42.664014 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:42.663885 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 23:13:42.664014 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:42.663917 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1f655ca-5728-4b21-b5ba-298b1d9fa0f7-metrics-certs podName:f1f655ca-5728-4b21-b5ba-298b1d9fa0f7 nodeName:}" failed. No retries permitted until 2026-07-07 23:13:44.66390462 +0000 UTC m=+6.073966839 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1f655ca-5728-4b21-b5ba-298b1d9fa0f7-metrics-certs") pod "network-metrics-daemon-jcr7v" (UID: "f1f655ca-5728-4b21-b5ba-298b1d9fa0f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 23:13:43.012967 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:43.012824 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 23:08:40 +0000 UTC" deadline="2028-02-07 01:27:45.936682835 +0000 UTC" Jul 07 23:13:43.012967 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:43.012861 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13898h14m2.923825974s" Jul 07 23:13:43.113208 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:43.112606 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:13:43.113208 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:43.112749 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcr7v" podUID="f1f655ca-5728-4b21-b5ba-298b1d9fa0f7" Jul 07 23:13:43.113767 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:43.113578 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8cls" Jul 07 23:13:43.113767 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:43.113678 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8cls" podUID="dea746d7-4d19-4bbf-b437-4ddf238117b5" Jul 07 23:13:43.166132 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:43.166094 2564 generic.go:356] "Generic (PLEG): container finished" podID="27ea0ba2e575db56b4e2e077b3865048" containerID="a8261c38a36749e80340e0361c8fb3c89788caa3ee4116846ba922982c10ba19" exitCode=0 Jul 07 23:13:43.167099 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:43.167072 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.ec2.internal" event={"ID":"27ea0ba2e575db56b4e2e077b3865048","Type":"ContainerDied","Data":"a8261c38a36749e80340e0361c8fb3c89788caa3ee4116846ba922982c10ba19"} Jul 07 23:13:44.111906 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:44.111871 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:13:44.112377 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:44.112010 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rksdr" podUID="fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8" Jul 07 23:13:44.173300 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:44.173251 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.ec2.internal" event={"ID":"27ea0ba2e575db56b4e2e077b3865048","Type":"ContainerStarted","Data":"ba92e6fa54b9eb342ee4701dbc0b2b643980d68af91fdd0fd8191d019fb68b27"} Jul 07 23:13:44.191992 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:44.191925 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.ec2.internal" podStartSLOduration=4.191898398 podStartE2EDuration="4.191898398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:13:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:13:44.190898044 +0000 UTC m=+5.600960283" watchObservedRunningTime="2026-07-07 23:13:44.191898398 +0000 UTC m=+5.601960638" Jul 07 23:13:44.683975 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:44.683552 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8-original-pull-secret\") pod \"global-pull-secret-syncer-rksdr\" (UID: \"fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8\") " pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:13:44.683975 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:44.683604 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1f655ca-5728-4b21-b5ba-298b1d9fa0f7-metrics-certs\") pod \"network-metrics-daemon-jcr7v\" (UID: \"f1f655ca-5728-4b21-b5ba-298b1d9fa0f7\") " pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:13:44.683975 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:44.683631 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvgqw\" (UniqueName: \"kubernetes.io/projected/dea746d7-4d19-4bbf-b437-4ddf238117b5-kube-api-access-wvgqw\") pod \"network-check-target-l8cls\" (UID: \"dea746d7-4d19-4bbf-b437-4ddf238117b5\") " pod="openshift-network-diagnostics/network-check-target-l8cls" Jul 07 23:13:44.683975 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:44.683714 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 23:13:44.683975 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:44.683754 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 23:13:44.683975 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:44.683775 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 23:13:44.683975 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:44.683788 2564 projected.go:196] Error preparing data for projected volume kube-api-access-wvgqw for pod openshift-network-diagnostics/network-check-target-l8cls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 23:13:44.683975 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:44.683794 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8-original-pull-secret podName:fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8 nodeName:}" failed. No retries permitted until 2026-07-07 23:13:48.683772968 +0000 UTC m=+10.093835204 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8-original-pull-secret") pod "global-pull-secret-syncer-rksdr" (UID: "fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8") : object "kube-system"/"original-pull-secret" not registered Jul 07 23:13:44.683975 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:44.683838 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dea746d7-4d19-4bbf-b437-4ddf238117b5-kube-api-access-wvgqw podName:dea746d7-4d19-4bbf-b437-4ddf238117b5 nodeName:}" failed. No retries permitted until 2026-07-07 23:13:48.683821342 +0000 UTC m=+10.093883563 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wvgqw" (UniqueName: "kubernetes.io/projected/dea746d7-4d19-4bbf-b437-4ddf238117b5-kube-api-access-wvgqw") pod "network-check-target-l8cls" (UID: "dea746d7-4d19-4bbf-b437-4ddf238117b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 23:13:44.683975 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:44.683897 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 23:13:44.683975 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:44.683931 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1f655ca-5728-4b21-b5ba-298b1d9fa0f7-metrics-certs podName:f1f655ca-5728-4b21-b5ba-298b1d9fa0f7 nodeName:}" failed. No retries permitted until 2026-07-07 23:13:48.683918913 +0000 UTC m=+10.093981135 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1f655ca-5728-4b21-b5ba-298b1d9fa0f7-metrics-certs") pod "network-metrics-daemon-jcr7v" (UID: "f1f655ca-5728-4b21-b5ba-298b1d9fa0f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 23:13:45.112644 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:45.112608 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:13:45.113107 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:45.112766 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcr7v" podUID="f1f655ca-5728-4b21-b5ba-298b1d9fa0f7" Jul 07 23:13:45.113107 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:45.112804 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8cls" Jul 07 23:13:45.113107 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:45.112887 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8cls" podUID="dea746d7-4d19-4bbf-b437-4ddf238117b5" Jul 07 23:13:46.112001 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:46.111511 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:13:46.112001 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:46.111652 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rksdr" podUID="fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8" Jul 07 23:13:47.112312 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:47.112281 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:13:47.112784 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:47.112283 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8cls" Jul 07 23:13:47.112784 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:47.112430 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcr7v" podUID="f1f655ca-5728-4b21-b5ba-298b1d9fa0f7" Jul 07 23:13:47.112784 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:47.112510 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8cls" podUID="dea746d7-4d19-4bbf-b437-4ddf238117b5" Jul 07 23:13:48.112133 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:48.111594 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:13:48.112133 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:48.111759 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rksdr" podUID="fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8" Jul 07 23:13:48.720457 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:48.719473 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8-original-pull-secret\") pod \"global-pull-secret-syncer-rksdr\" (UID: \"fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8\") " pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:13:48.720457 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:48.719541 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1f655ca-5728-4b21-b5ba-298b1d9fa0f7-metrics-certs\") pod \"network-metrics-daemon-jcr7v\" (UID: \"f1f655ca-5728-4b21-b5ba-298b1d9fa0f7\") " pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:13:48.720457 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:48.719570 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvgqw\" (UniqueName: \"kubernetes.io/projected/dea746d7-4d19-4bbf-b437-4ddf238117b5-kube-api-access-wvgqw\") pod \"network-check-target-l8cls\" (UID: \"dea746d7-4d19-4bbf-b437-4ddf238117b5\") " pod="openshift-network-diagnostics/network-check-target-l8cls" Jul 07 23:13:48.720457 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:48.719726 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 23:13:48.720457 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:48.719743 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 23:13:48.720457 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:48.719757 2564 projected.go:196] Error preparing data for projected volume kube-api-access-wvgqw for pod openshift-network-diagnostics/network-check-target-l8cls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 23:13:48.720457 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:48.719844 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dea746d7-4d19-4bbf-b437-4ddf238117b5-kube-api-access-wvgqw podName:dea746d7-4d19-4bbf-b437-4ddf238117b5 nodeName:}" failed. No retries permitted until 2026-07-07 23:13:56.71979519 +0000 UTC m=+18.129857423 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wvgqw" (UniqueName: "kubernetes.io/projected/dea746d7-4d19-4bbf-b437-4ddf238117b5-kube-api-access-wvgqw") pod "network-check-target-l8cls" (UID: "dea746d7-4d19-4bbf-b437-4ddf238117b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 23:13:48.720457 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:48.720279 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 23:13:48.720457 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:48.720325 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8-original-pull-secret podName:fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8 nodeName:}" failed. No retries permitted until 2026-07-07 23:13:56.720310642 +0000 UTC m=+18.130372864 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8-original-pull-secret") pod "global-pull-secret-syncer-rksdr" (UID: "fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8") : object "kube-system"/"original-pull-secret" not registered Jul 07 23:13:48.720457 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:48.720386 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 23:13:48.720457 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:48.720419 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1f655ca-5728-4b21-b5ba-298b1d9fa0f7-metrics-certs podName:f1f655ca-5728-4b21-b5ba-298b1d9fa0f7 nodeName:}" failed. No retries permitted until 2026-07-07 23:13:56.720406805 +0000 UTC m=+18.130469027 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1f655ca-5728-4b21-b5ba-298b1d9fa0f7-metrics-certs") pod "network-metrics-daemon-jcr7v" (UID: "f1f655ca-5728-4b21-b5ba-298b1d9fa0f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 23:13:49.111973 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:49.111941 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8cls" Jul 07 23:13:49.112125 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:49.112036 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8cls" podUID="dea746d7-4d19-4bbf-b437-4ddf238117b5" Jul 07 23:13:49.113416 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:49.113395 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:13:49.113551 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:49.113513 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcr7v" podUID="f1f655ca-5728-4b21-b5ba-298b1d9fa0f7" Jul 07 23:13:50.111501 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:50.111451 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:13:50.111922 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:50.111619 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rksdr" podUID="fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8" Jul 07 23:13:51.115218 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:51.115187 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8cls" Jul 07 23:13:51.115712 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:51.115309 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8cls" podUID="dea746d7-4d19-4bbf-b437-4ddf238117b5" Jul 07 23:13:51.115712 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:51.115631 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:13:51.115712 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:51.115709 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcr7v" podUID="f1f655ca-5728-4b21-b5ba-298b1d9fa0f7" Jul 07 23:13:52.111929 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:52.111890 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:13:52.112125 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:52.111999 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rksdr" podUID="fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8" Jul 07 23:13:53.111940 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:53.111906 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:13:53.112308 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:53.111910 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8cls" Jul 07 23:13:53.112308 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:53.112032 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcr7v" podUID="f1f655ca-5728-4b21-b5ba-298b1d9fa0f7" Jul 07 23:13:53.112308 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:53.112085 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8cls" podUID="dea746d7-4d19-4bbf-b437-4ddf238117b5" Jul 07 23:13:54.111845 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:54.111815 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:13:54.112008 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:54.111934 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rksdr" podUID="fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8" Jul 07 23:13:55.112153 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:55.111866 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8cls" Jul 07 23:13:55.112153 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:55.111994 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8cls" podUID="dea746d7-4d19-4bbf-b437-4ddf238117b5" Jul 07 23:13:55.112153 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:55.112032 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:13:55.112153 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:55.112122 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcr7v" podUID="f1f655ca-5728-4b21-b5ba-298b1d9fa0f7" Jul 07 23:13:56.112105 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:56.112073 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:13:56.112364 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:56.112189 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rksdr" podUID="fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8" Jul 07 23:13:56.777815 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:56.777741 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8-original-pull-secret\") pod \"global-pull-secret-syncer-rksdr\" (UID: \"fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8\") " pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:13:56.777815 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:56.777820 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1f655ca-5728-4b21-b5ba-298b1d9fa0f7-metrics-certs\") pod \"network-metrics-daemon-jcr7v\" (UID: \"f1f655ca-5728-4b21-b5ba-298b1d9fa0f7\") " pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:13:56.778068 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:56.777849 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvgqw\" (UniqueName: \"kubernetes.io/projected/dea746d7-4d19-4bbf-b437-4ddf238117b5-kube-api-access-wvgqw\") pod \"network-check-target-l8cls\" (UID: \"dea746d7-4d19-4bbf-b437-4ddf238117b5\") " pod="openshift-network-diagnostics/network-check-target-l8cls" Jul 07 23:13:56.778068 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:56.777908 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 23:13:56.778068 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:56.777972 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 23:13:56.778068 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:56.777992 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 23:13:56.778068 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:56.778008 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 23:13:56.778068 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:56.777981 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8-original-pull-secret podName:fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8 nodeName:}" failed. No retries permitted until 2026-07-07 23:14:12.777960663 +0000 UTC m=+34.188022880 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8-original-pull-secret") pod "global-pull-secret-syncer-rksdr" (UID: "fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8") : object "kube-system"/"original-pull-secret" not registered Jul 07 23:13:56.778068 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:56.778022 2564 projected.go:196] Error preparing data for projected volume kube-api-access-wvgqw for pod openshift-network-diagnostics/network-check-target-l8cls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 23:13:56.778068 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:56.778043 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1f655ca-5728-4b21-b5ba-298b1d9fa0f7-metrics-certs podName:f1f655ca-5728-4b21-b5ba-298b1d9fa0f7 nodeName:}" failed. No retries permitted until 2026-07-07 23:14:12.778023797 +0000 UTC m=+34.188086021 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1f655ca-5728-4b21-b5ba-298b1d9fa0f7-metrics-certs") pod "network-metrics-daemon-jcr7v" (UID: "f1f655ca-5728-4b21-b5ba-298b1d9fa0f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 23:13:56.778068 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:56.778066 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dea746d7-4d19-4bbf-b437-4ddf238117b5-kube-api-access-wvgqw podName:dea746d7-4d19-4bbf-b437-4ddf238117b5 nodeName:}" failed. No retries permitted until 2026-07-07 23:14:12.778052772 +0000 UTC m=+34.188114993 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wvgqw" (UniqueName: "kubernetes.io/projected/dea746d7-4d19-4bbf-b437-4ddf238117b5-kube-api-access-wvgqw") pod "network-check-target-l8cls" (UID: "dea746d7-4d19-4bbf-b437-4ddf238117b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 23:13:57.111673 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:57.111578 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:13:57.111839 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:57.111717 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcr7v" podUID="f1f655ca-5728-4b21-b5ba-298b1d9fa0f7" Jul 07 23:13:57.111839 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:57.111745 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8cls" Jul 07 23:13:57.111953 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:57.111860 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8cls" podUID="dea746d7-4d19-4bbf-b437-4ddf238117b5" Jul 07 23:13:58.111592 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:58.111553 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:13:58.112071 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:58.111686 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rksdr" podUID="fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8" Jul 07 23:13:59.112904 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:59.112855 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:13:59.113316 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:59.112984 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcr7v" podUID="f1f655ca-5728-4b21-b5ba-298b1d9fa0f7" Jul 07 23:13:59.113316 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:13:59.113044 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8cls" Jul 07 23:13:59.113316 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:13:59.113127 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8cls" podUID="dea746d7-4d19-4bbf-b437-4ddf238117b5" Jul 07 23:14:00.111890 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:00.111849 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:14:00.112161 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:00.111992 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rksdr" podUID="fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8" Jul 07 23:14:01.112346 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:01.112315 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8cls" Jul 07 23:14:01.112844 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:01.112325 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:14:01.112844 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:01.112440 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8cls" podUID="dea746d7-4d19-4bbf-b437-4ddf238117b5" Jul 07 23:14:01.112844 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:01.112590 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcr7v" podUID="f1f655ca-5728-4b21-b5ba-298b1d9fa0f7" Jul 07 23:14:02.112310 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:02.111963 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:14:02.112591 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:02.112411 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rksdr" podUID="fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8" Jul 07 23:14:02.214762 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:02.214723 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" event={"ID":"21da4d2c-ae31-4c99-874d-f63cd50bc656","Type":"ContainerStarted","Data":"74073cc0d290d4bfcbe7c9376231e0b5b91458f1670067cb505e8cff0fc051d9"} Jul 07 23:14:02.215061 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:02.214841 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" event={"ID":"21da4d2c-ae31-4c99-874d-f63cd50bc656","Type":"ContainerStarted","Data":"c6ba1e2096a178d2301786e36e14ee450adf55734537301d722d621785eda252"} Jul 07 23:14:02.215061 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:02.214882 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" event={"ID":"21da4d2c-ae31-4c99-874d-f63cd50bc656","Type":"ContainerStarted","Data":"c6f3e94a94d193e1d6ebaf9647a87bca10015005a46409c62f834cf0e8d3c8bc"} Jul 07 23:14:02.215061 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:02.214927 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" event={"ID":"21da4d2c-ae31-4c99-874d-f63cd50bc656","Type":"ContainerStarted","Data":"d58a11c558617ac6becd63e68143f066b91cceba640aa774c678acb7a9fe214c"} Jul 07 23:14:02.215061 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:02.214954 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" event={"ID":"21da4d2c-ae31-4c99-874d-f63cd50bc656","Type":"ContainerStarted","Data":"a832e578fd34131cedc48e0d6292977964ffb6e328ff50629bab02d15d162115"} Jul 07 23:14:02.215061 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:02.214998 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" event={"ID":"21da4d2c-ae31-4c99-874d-f63cd50bc656","Type":"ContainerStarted","Data":"6e2705481d69e5d570ddf140f7202e9d8cd73751ce5ea2cf000975d86e5e0b27"} Jul 07 23:14:02.216323 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:02.216295 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xdr5m" event={"ID":"1d88ada1-2d4e-4b35-8079-8c893bbe41f7","Type":"ContainerStarted","Data":"b131259645c4e3084c188c9b17f1ba9f115a08185f1e2f8264979763ea435a72"} Jul 07 23:14:02.217757 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:02.217732 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9zh" event={"ID":"8c2472f6-4877-497f-b82c-e71dd1e65a2b","Type":"ContainerStarted","Data":"e629dd15fda25afd9982e318b77b78fe42ca1fedb4118e3df7a2d7cb966402e4"} Jul 07 23:14:02.219061 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:02.219033 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r7trc" event={"ID":"b2a9d0c8-6e1d-4740-8066-0f04d6e9d978","Type":"ContainerStarted","Data":"6841f24ca8367bab9f1cdd96ad8b9a089124f580ffb2c4aa639a858bd76cc706"} Jul 07 23:14:02.220512 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:02.220469 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" event={"ID":"ff5157ee-1d74-49f4-82bb-b322459baca9","Type":"ContainerStarted","Data":"21b90281c9516dcc4bf40575db10af27014715f5345dbbb3df40105d009dfa79"} Jul 07 23:14:02.221961 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:02.221941 2564 generic.go:356] "Generic (PLEG): container finished" podID="7839699b-d95d-4e11-bac2-a1cca78e8b3c" containerID="a2787343b3da61b619c91dd627f1ebbf79b4e33092555e1e79a4f6d09721cbbb" exitCode=0 Jul 07 23:14:02.222068 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:02.222019 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hg4n2" event={"ID":"7839699b-d95d-4e11-bac2-a1cca78e8b3c","Type":"ContainerDied","Data":"a2787343b3da61b619c91dd627f1ebbf79b4e33092555e1e79a4f6d09721cbbb"} Jul 07 23:14:02.223514 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:02.223449 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nxszt" event={"ID":"3a72f607-d161-4182-a32c-da418ef84a9a","Type":"ContainerStarted","Data":"c82a52144ffaf600674aa232b538086bbbb55c7db75edf5df915acdfff3f7add"} Jul 07 23:14:02.224873 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:02.224852 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mkht6" event={"ID":"97e34b22-568f-4ca3-b8ca-a38ab8ed4eb2","Type":"ContainerStarted","Data":"38b4fbdb03c52aafa1bb8c68c91770dc5ae2a246bd0f40329d7c7a1f0a126e40"} Jul 07 23:14:02.233642 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:02.233563 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xdr5m" podStartSLOduration=12.205502023 podStartE2EDuration="23.233546062s" totalImagesPullingTime="11.028044039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:14:02.232974077 +0000 UTC m=+23.643036307" watchObservedRunningTime="2026-07-07 23:14:02.233546062 +0000 UTC m=+23.643608302" Jul 07 23:14:02.250773 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:02.250722 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nxszt" podStartSLOduration=4.016655688 podStartE2EDuration="23.250706334s" totalImagesPullingTime="19.234050646s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:14:02.250093097 +0000 UTC m=+23.660155337" watchObservedRunningTime="2026-07-07 23:14:02.250706334 +0000 UTC m=+23.660768585" Jul 07 23:14:02.289691 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:02.289641 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-r7trc" podStartSLOduration=4.1115252 podStartE2EDuration="23.289623956s" totalImagesPullingTime="19.178098756s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:14:02.289327232 +0000 UTC m=+23.699389470" watchObservedRunningTime="2026-07-07 23:14:02.289623956 +0000 UTC m=+23.699686193" Jul 07 23:14:02.307186 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:02.307129 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mkht6" podStartSLOduration=4.130003775 podStartE2EDuration="23.307113899s" totalImagesPullingTime="19.177110124s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:14:02.306533634 +0000 UTC m=+23.716595872" watchObservedRunningTime="2026-07-07 23:14:02.307113899 +0000 UTC m=+23.717176162" Jul 07 23:14:02.324008 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:02.323960 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cd6cr" podStartSLOduration=4.137181112 podStartE2EDuration="23.323946105s" totalImagesPullingTime="19.186764993s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:14:02.323472054 +0000 UTC m=+23.733534293" watchObservedRunningTime="2026-07-07 23:14:02.323946105 +0000 UTC m=+23.734008334" Jul 07 23:14:02.626634 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:02.626610 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 23:14:03.005069 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:03.004966 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T23:14:02.626627916Z","UUID":"2c1b0f37-4e6b-4f94-a12f-f27ffd728f7f","Handler":null,"Name":"","Endpoint":""} Jul 07 23:14:03.006379 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:03.006359 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 23:14:03.006513 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:03.006393 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 23:14:03.114417 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:03.114386 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:14:03.114981 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:03.114674 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcr7v" podUID="f1f655ca-5728-4b21-b5ba-298b1d9fa0f7" Jul 07 23:14:03.115172 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:03.115146 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8cls" Jul 07 23:14:03.115303 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:03.115276 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8cls" podUID="dea746d7-4d19-4bbf-b437-4ddf238117b5" Jul 07 23:14:03.229537 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:03.229502 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c4s8w" event={"ID":"80ad2cb8-2e06-4706-b864-034ab05fffaf","Type":"ContainerStarted","Data":"811e30696cf4d6af26a343cb0229d3c10989f0efb7420adf964e79c8e69b09c1"} Jul 07 23:14:03.232293 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:03.232263 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9zh" event={"ID":"8c2472f6-4877-497f-b82c-e71dd1e65a2b","Type":"ContainerStarted","Data":"b42414cf2b11301e33108212fad3b6a706cbe44820f1fd85fde1eb42f587873b"} Jul 07 23:14:03.266168 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:03.266058 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c4s8w" podStartSLOduration=5.091690127 podStartE2EDuration="24.266035212s" totalImagesPullingTime="19.174345085s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:14:03.265360661 +0000 UTC m=+24.675422900" watchObservedRunningTime="2026-07-07 23:14:03.266035212 +0000 UTC m=+24.676097497" Jul 07 23:14:03.688245 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:03.688165 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xdr5m" Jul 07 23:14:03.688868 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:03.688843 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xdr5m" Jul 07 23:14:04.112386 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:04.112354 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:14:04.112596 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:04.112510 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rksdr" podUID="fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8" Jul 07 23:14:04.238727 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:04.238689 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" event={"ID":"21da4d2c-ae31-4c99-874d-f63cd50bc656","Type":"ContainerStarted","Data":"2a0f1b84cba6bae065435524cab111f2dabe4d219a7703b7b7682fd5ae54ec2a"} Jul 07 23:14:04.240952 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:04.240923 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9zh" event={"ID":"8c2472f6-4877-497f-b82c-e71dd1e65a2b","Type":"ContainerStarted","Data":"dccca16c0c395bd2fbdc1930fcf0dce126b2c96ccedbd4395d8b6842217934b7"} Jul 07 23:14:04.241306 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:04.241272 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xdr5m" Jul 07 23:14:04.241756 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:04.241740 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xdr5m" Jul 07 23:14:04.267181 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:04.267127 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9zh" podStartSLOduration=3.892112199 podStartE2EDuration="25.267108844s" totalImagesPullingTime="21.374996645s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:13:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:14:04.266982959 +0000 UTC m=+25.677045198" watchObservedRunningTime="2026-07-07 23:14:04.267108844 +0000 UTC m=+25.677171084" Jul 07 23:14:05.111880 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:05.111849 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:14:05.112070 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:05.111860 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8cls" Jul 07 23:14:05.112070 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:05.111988 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcr7v" podUID="f1f655ca-5728-4b21-b5ba-298b1d9fa0f7" Jul 07 23:14:05.112070 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:05.112019 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8cls" podUID="dea746d7-4d19-4bbf-b437-4ddf238117b5" Jul 07 23:14:06.111338 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:06.111295 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:14:06.111810 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:06.111432 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rksdr" podUID="fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8" Jul 07 23:14:07.112262 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:07.112051 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:14:07.112859 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:07.112092 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8cls" Jul 07 23:14:07.112859 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:07.112369 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcr7v" podUID="f1f655ca-5728-4b21-b5ba-298b1d9fa0f7" Jul 07 23:14:07.112859 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:07.112404 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8cls" podUID="dea746d7-4d19-4bbf-b437-4ddf238117b5" Jul 07 23:14:07.249702 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:07.249672 2564 generic.go:356] "Generic (PLEG): container finished" podID="7839699b-d95d-4e11-bac2-a1cca78e8b3c" containerID="bf166f1b484e41b5eed45c6b48f78a470c8d836f5119142e458e7f4bae3274ba" exitCode=0 Jul 07 23:14:07.249896 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:07.249768 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hg4n2" event={"ID":"7839699b-d95d-4e11-bac2-a1cca78e8b3c","Type":"ContainerDied","Data":"bf166f1b484e41b5eed45c6b48f78a470c8d836f5119142e458e7f4bae3274ba"} Jul 07 23:14:07.253388 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:07.253275 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" event={"ID":"21da4d2c-ae31-4c99-874d-f63cd50bc656","Type":"ContainerStarted","Data":"425291fb9f3a9f0132203e9f5783590de880ebbd25d6bb9ec65404d61c2fef0c"} Jul 07 23:14:07.253546 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:07.253526 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:14:07.269940 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:07.269916 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:14:07.310914 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:07.310863 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" podStartSLOduration=9.059739809 podStartE2EDuration="28.310848482s" totalImagesPullingTime="19.251108673s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:14:07.309108516 +0000 UTC m=+28.719170764" watchObservedRunningTime="2026-07-07 23:14:07.310848482 +0000 UTC m=+28.720910719" Jul 07 23:14:08.111852 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:08.111626 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:14:08.112046 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:08.111943 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rksdr" podUID="fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8" Jul 07 23:14:08.255788 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:08.255755 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:14:08.256475 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:08.255832 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:14:08.271423 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:08.271399 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:14:08.666369 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:08.666259 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jcr7v"] Jul 07 23:14:08.666594 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:08.666390 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:14:08.666594 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:08.666545 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcr7v" podUID="f1f655ca-5728-4b21-b5ba-298b1d9fa0f7" Jul 07 23:14:08.670449 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:08.667918 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rksdr"] Jul 07 23:14:08.670449 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:08.668062 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:14:08.670449 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:08.668205 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rksdr" podUID="fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8" Jul 07 23:14:08.670449 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:08.669256 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l8cls"] Jul 07 23:14:08.670449 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:08.669364 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8cls" Jul 07 23:14:08.670449 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:08.669475 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8cls" podUID="dea746d7-4d19-4bbf-b437-4ddf238117b5" Jul 07 23:14:09.259358 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:09.259319 2564 generic.go:356] "Generic (PLEG): container finished" podID="7839699b-d95d-4e11-bac2-a1cca78e8b3c" containerID="b9dab4e08c4823659e49e75977389b711d076e7983412649a1042419838503f5" exitCode=0 Jul 07 23:14:09.259833 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:09.259399 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hg4n2" event={"ID":"7839699b-d95d-4e11-bac2-a1cca78e8b3c","Type":"ContainerDied","Data":"b9dab4e08c4823659e49e75977389b711d076e7983412649a1042419838503f5"} Jul 07 23:14:10.112266 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:10.112235 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8cls" Jul 07 23:14:10.112446 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:10.112347 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:14:10.112446 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:10.112359 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8cls" podUID="dea746d7-4d19-4bbf-b437-4ddf238117b5" Jul 07 23:14:10.112446 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:10.112381 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:14:10.112627 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:10.112499 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rksdr" podUID="fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8" Jul 07 23:14:10.112627 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:10.112564 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcr7v" podUID="f1f655ca-5728-4b21-b5ba-298b1d9fa0f7" Jul 07 23:14:11.183466 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:11.183224 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r7trc_b2a9d0c8-6e1d-4740-8066-0f04d6e9d978/dns-node-resolver/0.log" Jul 07 23:14:11.266273 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:11.266233 2564 generic.go:356] "Generic (PLEG): container finished" podID="7839699b-d95d-4e11-bac2-a1cca78e8b3c" containerID="6c71256de0f78ab23bc2b64be1f8ae227c577d306d030512f5df75253c1ec608" exitCode=0 Jul 07 23:14:11.266450 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:11.266311 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hg4n2" event={"ID":"7839699b-d95d-4e11-bac2-a1cca78e8b3c","Type":"ContainerDied","Data":"6c71256de0f78ab23bc2b64be1f8ae227c577d306d030512f5df75253c1ec608"} Jul 07 23:14:11.944115 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:11.944082 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mkht6_97e34b22-568f-4ca3-b8ca-a38ab8ed4eb2/node-ca/0.log" Jul 07 23:14:12.112553 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:12.112039 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:14:12.112553 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:12.112083 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8cls" Jul 07 23:14:12.112553 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:12.112083 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:14:12.112553 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:12.112159 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rksdr" podUID="fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8" Jul 07 23:14:12.112553 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:12.112260 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8cls" podUID="dea746d7-4d19-4bbf-b437-4ddf238117b5" Jul 07 23:14:12.112553 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:12.112334 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcr7v" podUID="f1f655ca-5728-4b21-b5ba-298b1d9fa0f7" Jul 07 23:14:12.800116 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:12.800078 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8-original-pull-secret\") pod \"global-pull-secret-syncer-rksdr\" (UID: \"fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8\") " pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:14:12.800116 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:12.800124 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1f655ca-5728-4b21-b5ba-298b1d9fa0f7-metrics-certs\") pod \"network-metrics-daemon-jcr7v\" (UID: \"f1f655ca-5728-4b21-b5ba-298b1d9fa0f7\") " pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:14:12.800736 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:12.800142 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvgqw\" (UniqueName: \"kubernetes.io/projected/dea746d7-4d19-4bbf-b437-4ddf238117b5-kube-api-access-wvgqw\") pod \"network-check-target-l8cls\" (UID: \"dea746d7-4d19-4bbf-b437-4ddf238117b5\") " pod="openshift-network-diagnostics/network-check-target-l8cls" Jul 07 23:14:12.800736 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:12.800252 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 23:14:12.800736 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:12.800259 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 23:14:12.800736 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:12.800292 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 23:14:12.800736 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:12.800306 2564 projected.go:196] Error preparing data for projected volume kube-api-access-wvgqw for pod openshift-network-diagnostics/network-check-target-l8cls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 23:14:12.800736 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:12.800326 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8-original-pull-secret podName:fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8 nodeName:}" failed. No retries permitted until 2026-07-07 23:14:44.800305256 +0000 UTC m=+66.210367491 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8-original-pull-secret") pod "global-pull-secret-syncer-rksdr" (UID: "fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8") : object "kube-system"/"original-pull-secret" not registered Jul 07 23:14:12.800736 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:12.800252 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 23:14:12.800736 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:12.800358 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dea746d7-4d19-4bbf-b437-4ddf238117b5-kube-api-access-wvgqw podName:dea746d7-4d19-4bbf-b437-4ddf238117b5 nodeName:}" failed. No retries permitted until 2026-07-07 23:14:44.80034294 +0000 UTC m=+66.210405161 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wvgqw" (UniqueName: "kubernetes.io/projected/dea746d7-4d19-4bbf-b437-4ddf238117b5-kube-api-access-wvgqw") pod "network-check-target-l8cls" (UID: "dea746d7-4d19-4bbf-b437-4ddf238117b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 23:14:12.800736 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:12.800413 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1f655ca-5728-4b21-b5ba-298b1d9fa0f7-metrics-certs podName:f1f655ca-5728-4b21-b5ba-298b1d9fa0f7 nodeName:}" failed. No retries permitted until 2026-07-07 23:14:44.800396688 +0000 UTC m=+66.210458921 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1f655ca-5728-4b21-b5ba-298b1d9fa0f7-metrics-certs") pod "network-metrics-daemon-jcr7v" (UID: "f1f655ca-5728-4b21-b5ba-298b1d9fa0f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 23:14:13.925413 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:13.925384 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-195.ec2.internal" event="NodeReady" Jul 07 23:14:13.925946 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:13.925542 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 23:14:14.011317 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.011232 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lqh8p"] Jul 07 23:14:14.013886 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.013867 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rk84p"] Jul 07 23:14:14.014017 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.013999 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lqh8p" Jul 07 23:14:14.016856 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.016569 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rk84p" Jul 07 23:14:14.028118 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.027612 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 23:14:14.028118 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.027680 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mjlml\"" Jul 07 23:14:14.028118 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.027706 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wxtn5\"" Jul 07 23:14:14.028118 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.027760 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 23:14:14.028118 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.027766 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 23:14:14.028118 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.027874 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 23:14:14.028118 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.027966 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 23:14:14.028118 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.028053 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 23:14:14.028118 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.028097 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 23:14:14.052596 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.051252 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lqh8p"] Jul 07 23:14:14.052596 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.051313 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rk84p"] Jul 07 23:14:14.052596 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.052305 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zqnmf"] Jul 07 23:14:14.054612 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.054589 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zqnmf" Jul 07 23:14:14.067981 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.067954 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 23:14:14.068127 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.068085 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-94qrf\"" Jul 07 23:14:14.068294 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.068273 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 23:14:14.073699 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.073669 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-85b4878b74-75lvx"] Jul 07 23:14:14.075841 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.075824 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:14.078794 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.078775 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 23:14:14.078897 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.078808 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 23:14:14.079099 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.079084 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wgd2s\"" Jul 07 23:14:14.079202 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.079172 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 23:14:14.085721 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.085693 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zqnmf"] Jul 07 23:14:14.086919 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.086900 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 23:14:14.104702 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.104666 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85b4878b74-75lvx"] Jul 07 23:14:14.109751 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.109721 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/896a6145-9c7e-4bb8-9e71-d35415f005dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rk84p\" (UID: \"896a6145-9c7e-4bb8-9e71-d35415f005dc\") " pod="openshift-insights/insights-runtime-extractor-rk84p" Jul 07 23:14:14.109909 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.109756 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9czll\" (UniqueName: \"kubernetes.io/projected/896a6145-9c7e-4bb8-9e71-d35415f005dc-kube-api-access-9czll\") pod \"insights-runtime-extractor-rk84p\" (UID: \"896a6145-9c7e-4bb8-9e71-d35415f005dc\") " pod="openshift-insights/insights-runtime-extractor-rk84p" Jul 07 23:14:14.109909 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.109784 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/896a6145-9c7e-4bb8-9e71-d35415f005dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rk84p\" (UID: \"896a6145-9c7e-4bb8-9e71-d35415f005dc\") " pod="openshift-insights/insights-runtime-extractor-rk84p" Jul 07 23:14:14.109909 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.109805 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/896a6145-9c7e-4bb8-9e71-d35415f005dc-crio-socket\") pod \"insights-runtime-extractor-rk84p\" (UID: \"896a6145-9c7e-4bb8-9e71-d35415f005dc\") " pod="openshift-insights/insights-runtime-extractor-rk84p" Jul 07 23:14:14.109909 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.109894 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfl7c\" (UniqueName: \"kubernetes.io/projected/b58e842e-195e-445f-b167-5f9a98fa3778-kube-api-access-gfl7c\") pod \"ingress-canary-lqh8p\" (UID: \"b58e842e-195e-445f-b167-5f9a98fa3778\") " pod="openshift-ingress-canary/ingress-canary-lqh8p" Jul 07 23:14:14.110100 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.110025 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/896a6145-9c7e-4bb8-9e71-d35415f005dc-data-volume\") pod \"insights-runtime-extractor-rk84p\" (UID: \"896a6145-9c7e-4bb8-9e71-d35415f005dc\") " pod="openshift-insights/insights-runtime-extractor-rk84p" Jul 07 23:14:14.110100 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.110061 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b58e842e-195e-445f-b167-5f9a98fa3778-cert\") pod \"ingress-canary-lqh8p\" (UID: \"b58e842e-195e-445f-b167-5f9a98fa3778\") " pod="openshift-ingress-canary/ingress-canary-lqh8p" Jul 07 23:14:14.111794 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.111772 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8cls" Jul 07 23:14:14.111904 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.111810 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:14:14.111904 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.111813 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:14:14.115506 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.115471 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 23:14:14.115658 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.115634 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nhfdw\"" Jul 07 23:14:14.116139 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.115897 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 23:14:14.116139 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.115980 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 23:14:14.116139 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.116055 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 23:14:14.116363 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.116256 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hxkkf\"" Jul 07 23:14:14.210777 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.210737 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-registry-tls\") pod \"image-registry-85b4878b74-75lvx\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:14.210959 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.210783 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/56cbfa43-9143-4c33-a92c-4fff6872e85b-registry-certificates\") pod \"image-registry-85b4878b74-75lvx\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:14.210959 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.210819 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dd9b2457-0512-4b0c-8f68-5e2b0091ed3e-config-volume\") pod \"dns-default-zqnmf\" (UID: \"dd9b2457-0512-4b0c-8f68-5e2b0091ed3e\") " pod="openshift-dns/dns-default-zqnmf" Jul 07 23:14:14.210959 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.210870 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/896a6145-9c7e-4bb8-9e71-d35415f005dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rk84p\" (UID: \"896a6145-9c7e-4bb8-9e71-d35415f005dc\") " pod="openshift-insights/insights-runtime-extractor-rk84p" Jul 07 23:14:14.210959 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.210902 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9czll\" (UniqueName: \"kubernetes.io/projected/896a6145-9c7e-4bb8-9e71-d35415f005dc-kube-api-access-9czll\") pod \"insights-runtime-extractor-rk84p\" (UID: \"896a6145-9c7e-4bb8-9e71-d35415f005dc\") " pod="openshift-insights/insights-runtime-extractor-rk84p" Jul 07 23:14:14.210959 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.210928 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd9b2457-0512-4b0c-8f68-5e2b0091ed3e-metrics-tls\") pod \"dns-default-zqnmf\" (UID: \"dd9b2457-0512-4b0c-8f68-5e2b0091ed3e\") " pod="openshift-dns/dns-default-zqnmf" Jul 07 23:14:14.210959 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.210953 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/896a6145-9c7e-4bb8-9e71-d35415f005dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rk84p\" (UID: \"896a6145-9c7e-4bb8-9e71-d35415f005dc\") " pod="openshift-insights/insights-runtime-extractor-rk84p" Jul 07 23:14:14.211224 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.210991 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/896a6145-9c7e-4bb8-9e71-d35415f005dc-crio-socket\") pod \"insights-runtime-extractor-rk84p\" (UID: \"896a6145-9c7e-4bb8-9e71-d35415f005dc\") " pod="openshift-insights/insights-runtime-extractor-rk84p" Jul 07 23:14:14.211224 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:14.211001 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 23:14:14.211224 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:14.211076 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 23:14:14.211224 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.211007 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/56cbfa43-9143-4c33-a92c-4fff6872e85b-image-registry-private-configuration\") pod \"image-registry-85b4878b74-75lvx\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:14.211373 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:14.211080 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/896a6145-9c7e-4bb8-9e71-d35415f005dc-insights-runtime-extractor-tls podName:896a6145-9c7e-4bb8-9e71-d35415f005dc nodeName:}" failed. No retries permitted until 2026-07-07 23:14:14.711059022 +0000 UTC m=+36.121121241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/896a6145-9c7e-4bb8-9e71-d35415f005dc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rk84p" (UID: "896a6145-9c7e-4bb8-9e71-d35415f005dc") : secret "insights-runtime-extractor-tls" not found Jul 07 23:14:14.211373 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:14.211310 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/896a6145-9c7e-4bb8-9e71-d35415f005dc-kube-rbac-proxy-cm podName:896a6145-9c7e-4bb8-9e71-d35415f005dc nodeName:}" failed. No retries permitted until 2026-07-07 23:14:14.711295222 +0000 UTC m=+36.121357442 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/896a6145-9c7e-4bb8-9e71-d35415f005dc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rk84p" (UID: "896a6145-9c7e-4bb8-9e71-d35415f005dc") : configmap "kube-rbac-proxy" not found Jul 07 23:14:14.211373 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.211329 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/56cbfa43-9143-4c33-a92c-4fff6872e85b-installation-pull-secrets\") pod \"image-registry-85b4878b74-75lvx\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:14.211373 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.211352 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-bound-sa-token\") pod \"image-registry-85b4878b74-75lvx\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:14.211579 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.211404 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfl7c\" (UniqueName: \"kubernetes.io/projected/b58e842e-195e-445f-b167-5f9a98fa3778-kube-api-access-gfl7c\") pod \"ingress-canary-lqh8p\" (UID: \"b58e842e-195e-445f-b167-5f9a98fa3778\") " pod="openshift-ingress-canary/ingress-canary-lqh8p" Jul 07 23:14:14.211579 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.211404 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/896a6145-9c7e-4bb8-9e71-d35415f005dc-crio-socket\") pod \"insights-runtime-extractor-rk84p\" (UID: \"896a6145-9c7e-4bb8-9e71-d35415f005dc\") " pod="openshift-insights/insights-runtime-extractor-rk84p" Jul 07 23:14:14.211579 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.211499 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8vzm\" (UniqueName: \"kubernetes.io/projected/dd9b2457-0512-4b0c-8f68-5e2b0091ed3e-kube-api-access-k8vzm\") pod \"dns-default-zqnmf\" (UID: \"dd9b2457-0512-4b0c-8f68-5e2b0091ed3e\") " pod="openshift-dns/dns-default-zqnmf" Jul 07 23:14:14.211579 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.211540 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/896a6145-9c7e-4bb8-9e71-d35415f005dc-data-volume\") pod \"insights-runtime-extractor-rk84p\" (UID: \"896a6145-9c7e-4bb8-9e71-d35415f005dc\") " pod="openshift-insights/insights-runtime-extractor-rk84p" Jul 07 23:14:14.211579 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.211565 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/56cbfa43-9143-4c33-a92c-4fff6872e85b-ca-trust-extracted\") pod \"image-registry-85b4878b74-75lvx\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:14.211778 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.211588 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56cbfa43-9143-4c33-a92c-4fff6872e85b-trusted-ca\") pod \"image-registry-85b4878b74-75lvx\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:14.211778 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.211611 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g8c7\" (UniqueName: \"kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-kube-api-access-8g8c7\") pod \"image-registry-85b4878b74-75lvx\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:14.211778 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.211641 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b58e842e-195e-445f-b167-5f9a98fa3778-cert\") pod \"ingress-canary-lqh8p\" (UID: \"b58e842e-195e-445f-b167-5f9a98fa3778\") " pod="openshift-ingress-canary/ingress-canary-lqh8p" Jul 07 23:14:14.211778 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.211665 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd9b2457-0512-4b0c-8f68-5e2b0091ed3e-tmp-dir\") pod \"dns-default-zqnmf\" (UID: \"dd9b2457-0512-4b0c-8f68-5e2b0091ed3e\") " pod="openshift-dns/dns-default-zqnmf" Jul 07 23:14:14.211920 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.211855 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/896a6145-9c7e-4bb8-9e71-d35415f005dc-data-volume\") pod \"insights-runtime-extractor-rk84p\" (UID: \"896a6145-9c7e-4bb8-9e71-d35415f005dc\") " pod="openshift-insights/insights-runtime-extractor-rk84p" Jul 07 23:14:14.216189 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.216165 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b58e842e-195e-445f-b167-5f9a98fa3778-cert\") pod \"ingress-canary-lqh8p\" (UID: \"b58e842e-195e-445f-b167-5f9a98fa3778\") " pod="openshift-ingress-canary/ingress-canary-lqh8p" Jul 07 23:14:14.221536 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.221504 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9czll\" (UniqueName: \"kubernetes.io/projected/896a6145-9c7e-4bb8-9e71-d35415f005dc-kube-api-access-9czll\") pod \"insights-runtime-extractor-rk84p\" (UID: \"896a6145-9c7e-4bb8-9e71-d35415f005dc\") " pod="openshift-insights/insights-runtime-extractor-rk84p" Jul 07 23:14:14.223416 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.223389 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfl7c\" (UniqueName: \"kubernetes.io/projected/b58e842e-195e-445f-b167-5f9a98fa3778-kube-api-access-gfl7c\") pod \"ingress-canary-lqh8p\" (UID: \"b58e842e-195e-445f-b167-5f9a98fa3778\") " pod="openshift-ingress-canary/ingress-canary-lqh8p" Jul 07 23:14:14.312655 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.312567 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8vzm\" (UniqueName: \"kubernetes.io/projected/dd9b2457-0512-4b0c-8f68-5e2b0091ed3e-kube-api-access-k8vzm\") pod \"dns-default-zqnmf\" (UID: \"dd9b2457-0512-4b0c-8f68-5e2b0091ed3e\") " pod="openshift-dns/dns-default-zqnmf" Jul 07 23:14:14.312655 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.312622 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/56cbfa43-9143-4c33-a92c-4fff6872e85b-ca-trust-extracted\") pod \"image-registry-85b4878b74-75lvx\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:14.312655 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.312646 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56cbfa43-9143-4c33-a92c-4fff6872e85b-trusted-ca\") pod \"image-registry-85b4878b74-75lvx\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:14.312927 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.312671 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g8c7\" (UniqueName: \"kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-kube-api-access-8g8c7\") pod \"image-registry-85b4878b74-75lvx\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:14.312927 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.312702 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd9b2457-0512-4b0c-8f68-5e2b0091ed3e-tmp-dir\") pod \"dns-default-zqnmf\" (UID: \"dd9b2457-0512-4b0c-8f68-5e2b0091ed3e\") " pod="openshift-dns/dns-default-zqnmf" Jul 07 23:14:14.312927 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.312731 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-registry-tls\") pod \"image-registry-85b4878b74-75lvx\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:14.312927 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.312755 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/56cbfa43-9143-4c33-a92c-4fff6872e85b-registry-certificates\") pod \"image-registry-85b4878b74-75lvx\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:14.312927 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.312780 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dd9b2457-0512-4b0c-8f68-5e2b0091ed3e-config-volume\") pod \"dns-default-zqnmf\" (UID: \"dd9b2457-0512-4b0c-8f68-5e2b0091ed3e\") " pod="openshift-dns/dns-default-zqnmf" Jul 07 23:14:14.312927 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.312824 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd9b2457-0512-4b0c-8f68-5e2b0091ed3e-metrics-tls\") pod \"dns-default-zqnmf\" (UID: \"dd9b2457-0512-4b0c-8f68-5e2b0091ed3e\") " pod="openshift-dns/dns-default-zqnmf" Jul 07 23:14:14.312927 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.312886 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/56cbfa43-9143-4c33-a92c-4fff6872e85b-image-registry-private-configuration\") pod \"image-registry-85b4878b74-75lvx\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:14.312927 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.312920 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/56cbfa43-9143-4c33-a92c-4fff6872e85b-installation-pull-secrets\") pod \"image-registry-85b4878b74-75lvx\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:14.313285 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.312947 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-bound-sa-token\") pod \"image-registry-85b4878b74-75lvx\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:14.313285 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:14.312972 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 23:14:14.313285 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:14.312998 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85b4878b74-75lvx: secret "image-registry-tls" not found Jul 07 23:14:14.313285 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:14.313060 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-registry-tls podName:56cbfa43-9143-4c33-a92c-4fff6872e85b nodeName:}" failed. No retries permitted until 2026-07-07 23:14:14.813043186 +0000 UTC m=+36.223105414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-registry-tls") pod "image-registry-85b4878b74-75lvx" (UID: "56cbfa43-9143-4c33-a92c-4fff6872e85b") : secret "image-registry-tls" not found Jul 07 23:14:14.313285 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:14.313071 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 23:14:14.313285 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.313084 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/56cbfa43-9143-4c33-a92c-4fff6872e85b-ca-trust-extracted\") pod \"image-registry-85b4878b74-75lvx\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:14.313285 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:14.313135 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd9b2457-0512-4b0c-8f68-5e2b0091ed3e-metrics-tls podName:dd9b2457-0512-4b0c-8f68-5e2b0091ed3e nodeName:}" failed. No retries permitted until 2026-07-07 23:14:14.813115216 +0000 UTC m=+36.223177437 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd9b2457-0512-4b0c-8f68-5e2b0091ed3e-metrics-tls") pod "dns-default-zqnmf" (UID: "dd9b2457-0512-4b0c-8f68-5e2b0091ed3e") : secret "dns-default-metrics-tls" not found Jul 07 23:14:14.313638 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.313585 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd9b2457-0512-4b0c-8f68-5e2b0091ed3e-tmp-dir\") pod \"dns-default-zqnmf\" (UID: \"dd9b2457-0512-4b0c-8f68-5e2b0091ed3e\") " pod="openshift-dns/dns-default-zqnmf" Jul 07 23:14:14.313738 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.313716 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/56cbfa43-9143-4c33-a92c-4fff6872e85b-registry-certificates\") pod \"image-registry-85b4878b74-75lvx\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:14.313773 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.313751 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dd9b2457-0512-4b0c-8f68-5e2b0091ed3e-config-volume\") pod \"dns-default-zqnmf\" (UID: \"dd9b2457-0512-4b0c-8f68-5e2b0091ed3e\") " pod="openshift-dns/dns-default-zqnmf" Jul 07 23:14:14.314143 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.314095 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56cbfa43-9143-4c33-a92c-4fff6872e85b-trusted-ca\") pod \"image-registry-85b4878b74-75lvx\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:14.316053 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.316023 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/56cbfa43-9143-4c33-a92c-4fff6872e85b-image-registry-private-configuration\") pod \"image-registry-85b4878b74-75lvx\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:14.316166 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.316086 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/56cbfa43-9143-4c33-a92c-4fff6872e85b-installation-pull-secrets\") pod \"image-registry-85b4878b74-75lvx\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:14.326265 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.326217 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lqh8p" Jul 07 23:14:14.327846 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.327820 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8vzm\" (UniqueName: \"kubernetes.io/projected/dd9b2457-0512-4b0c-8f68-5e2b0091ed3e-kube-api-access-k8vzm\") pod \"dns-default-zqnmf\" (UID: \"dd9b2457-0512-4b0c-8f68-5e2b0091ed3e\") " pod="openshift-dns/dns-default-zqnmf" Jul 07 23:14:14.327967 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.327880 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-bound-sa-token\") pod \"image-registry-85b4878b74-75lvx\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:14.328071 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.328040 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g8c7\" (UniqueName: \"kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-kube-api-access-8g8c7\") pod \"image-registry-85b4878b74-75lvx\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:14.717908 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.717813 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/896a6145-9c7e-4bb8-9e71-d35415f005dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rk84p\" (UID: \"896a6145-9c7e-4bb8-9e71-d35415f005dc\") " pod="openshift-insights/insights-runtime-extractor-rk84p" Jul 07 23:14:14.717908 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.717884 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/896a6145-9c7e-4bb8-9e71-d35415f005dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rk84p\" (UID: \"896a6145-9c7e-4bb8-9e71-d35415f005dc\") " pod="openshift-insights/insights-runtime-extractor-rk84p" Jul 07 23:14:14.718102 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:14.717981 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 23:14:14.718102 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:14.718022 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 23:14:14.718102 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:14.718045 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/896a6145-9c7e-4bb8-9e71-d35415f005dc-kube-rbac-proxy-cm podName:896a6145-9c7e-4bb8-9e71-d35415f005dc nodeName:}" failed. No retries permitted until 2026-07-07 23:14:15.71803113 +0000 UTC m=+37.128093346 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/896a6145-9c7e-4bb8-9e71-d35415f005dc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rk84p" (UID: "896a6145-9c7e-4bb8-9e71-d35415f005dc") : configmap "kube-rbac-proxy" not found Jul 07 23:14:14.718102 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:14.718092 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/896a6145-9c7e-4bb8-9e71-d35415f005dc-insights-runtime-extractor-tls podName:896a6145-9c7e-4bb8-9e71-d35415f005dc nodeName:}" failed. No retries permitted until 2026-07-07 23:14:15.718077662 +0000 UTC m=+37.128139881 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/896a6145-9c7e-4bb8-9e71-d35415f005dc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rk84p" (UID: "896a6145-9c7e-4bb8-9e71-d35415f005dc") : secret "insights-runtime-extractor-tls" not found Jul 07 23:14:14.818387 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.818342 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-registry-tls\") pod \"image-registry-85b4878b74-75lvx\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:14.818603 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:14.818405 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd9b2457-0512-4b0c-8f68-5e2b0091ed3e-metrics-tls\") pod \"dns-default-zqnmf\" (UID: \"dd9b2457-0512-4b0c-8f68-5e2b0091ed3e\") " pod="openshift-dns/dns-default-zqnmf" Jul 07 23:14:14.818603 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:14.818554 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 23:14:14.818603 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:14.818573 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85b4878b74-75lvx: secret "image-registry-tls" not found Jul 07 23:14:14.818603 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:14.818575 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 23:14:14.818777 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:14.818630 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd9b2457-0512-4b0c-8f68-5e2b0091ed3e-metrics-tls podName:dd9b2457-0512-4b0c-8f68-5e2b0091ed3e nodeName:}" failed. No retries permitted until 2026-07-07 23:14:15.818611215 +0000 UTC m=+37.228673453 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd9b2457-0512-4b0c-8f68-5e2b0091ed3e-metrics-tls") pod "dns-default-zqnmf" (UID: "dd9b2457-0512-4b0c-8f68-5e2b0091ed3e") : secret "dns-default-metrics-tls" not found Jul 07 23:14:14.818777 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:14.818651 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-registry-tls podName:56cbfa43-9143-4c33-a92c-4fff6872e85b nodeName:}" failed. No retries permitted until 2026-07-07 23:14:15.818641374 +0000 UTC m=+37.228703602 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-registry-tls") pod "image-registry-85b4878b74-75lvx" (UID: "56cbfa43-9143-4c33-a92c-4fff6872e85b") : secret "image-registry-tls" not found Jul 07 23:14:15.667860 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:15.667602 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lqh8p"] Jul 07 23:14:15.670788 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:14:15.670755 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb58e842e_195e_445f_b167_5f9a98fa3778.slice/crio-6e2f8a4da9249de7901cb0af546e6bb846d24e3d121f5d931f77217be63c8218 WatchSource:0}: Error finding container 6e2f8a4da9249de7901cb0af546e6bb846d24e3d121f5d931f77217be63c8218: Status 404 returned error can't find the container with id 6e2f8a4da9249de7901cb0af546e6bb846d24e3d121f5d931f77217be63c8218 Jul 07 23:14:15.728785 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:15.728755 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/896a6145-9c7e-4bb8-9e71-d35415f005dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rk84p\" (UID: \"896a6145-9c7e-4bb8-9e71-d35415f005dc\") " pod="openshift-insights/insights-runtime-extractor-rk84p" Jul 07 23:14:15.728942 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:15.728806 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/896a6145-9c7e-4bb8-9e71-d35415f005dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rk84p\" (UID: \"896a6145-9c7e-4bb8-9e71-d35415f005dc\") " pod="openshift-insights/insights-runtime-extractor-rk84p" Jul 07 23:14:15.728942 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:15.728896 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 23:14:15.729018 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:15.728933 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 23:14:15.729018 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:15.728958 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/896a6145-9c7e-4bb8-9e71-d35415f005dc-kube-rbac-proxy-cm podName:896a6145-9c7e-4bb8-9e71-d35415f005dc nodeName:}" failed. No retries permitted until 2026-07-07 23:14:17.728943256 +0000 UTC m=+39.139005472 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/896a6145-9c7e-4bb8-9e71-d35415f005dc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rk84p" (UID: "896a6145-9c7e-4bb8-9e71-d35415f005dc") : configmap "kube-rbac-proxy" not found Jul 07 23:14:15.729018 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:15.729002 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/896a6145-9c7e-4bb8-9e71-d35415f005dc-insights-runtime-extractor-tls podName:896a6145-9c7e-4bb8-9e71-d35415f005dc nodeName:}" failed. No retries permitted until 2026-07-07 23:14:17.728983786 +0000 UTC m=+39.139046014 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/896a6145-9c7e-4bb8-9e71-d35415f005dc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rk84p" (UID: "896a6145-9c7e-4bb8-9e71-d35415f005dc") : secret "insights-runtime-extractor-tls" not found Jul 07 23:14:15.829471 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:15.829353 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-registry-tls\") pod \"image-registry-85b4878b74-75lvx\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:15.829471 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:15.829407 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd9b2457-0512-4b0c-8f68-5e2b0091ed3e-metrics-tls\") pod \"dns-default-zqnmf\" (UID: \"dd9b2457-0512-4b0c-8f68-5e2b0091ed3e\") " pod="openshift-dns/dns-default-zqnmf" Jul 07 23:14:15.829707 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:15.829517 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 23:14:15.829707 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:15.829525 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 23:14:15.829707 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:15.829545 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85b4878b74-75lvx: secret "image-registry-tls" not found Jul 07 23:14:15.829707 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:15.829575 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd9b2457-0512-4b0c-8f68-5e2b0091ed3e-metrics-tls podName:dd9b2457-0512-4b0c-8f68-5e2b0091ed3e nodeName:}" failed. No retries permitted until 2026-07-07 23:14:17.829562487 +0000 UTC m=+39.239624702 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd9b2457-0512-4b0c-8f68-5e2b0091ed3e-metrics-tls") pod "dns-default-zqnmf" (UID: "dd9b2457-0512-4b0c-8f68-5e2b0091ed3e") : secret "dns-default-metrics-tls" not found Jul 07 23:14:15.829707 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:15.829596 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-registry-tls podName:56cbfa43-9143-4c33-a92c-4fff6872e85b nodeName:}" failed. No retries permitted until 2026-07-07 23:14:17.829581147 +0000 UTC m=+39.239643385 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-registry-tls") pod "image-registry-85b4878b74-75lvx" (UID: "56cbfa43-9143-4c33-a92c-4fff6872e85b") : secret "image-registry-tls" not found Jul 07 23:14:16.290554 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:16.290519 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lqh8p" event={"ID":"b58e842e-195e-445f-b167-5f9a98fa3778","Type":"ContainerStarted","Data":"6e2f8a4da9249de7901cb0af546e6bb846d24e3d121f5d931f77217be63c8218"} Jul 07 23:14:16.293112 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:16.293088 2564 generic.go:356] "Generic (PLEG): container finished" podID="7839699b-d95d-4e11-bac2-a1cca78e8b3c" containerID="3829c7d0d7fa411a05f20589382f3b4f1a59e2368c7935ff8e0f453d35ed593f" exitCode=0 Jul 07 23:14:16.293216 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:16.293145 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hg4n2" event={"ID":"7839699b-d95d-4e11-bac2-a1cca78e8b3c","Type":"ContainerDied","Data":"3829c7d0d7fa411a05f20589382f3b4f1a59e2368c7935ff8e0f453d35ed593f"} Jul 07 23:14:17.299182 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:17.299142 2564 generic.go:356] "Generic (PLEG): container finished" podID="7839699b-d95d-4e11-bac2-a1cca78e8b3c" containerID="febe9df397629ffa7397b256ffa221e6560dd618188e5c3e5ea2856de4efa247" exitCode=0 Jul 07 23:14:17.299182 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:17.299195 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hg4n2" event={"ID":"7839699b-d95d-4e11-bac2-a1cca78e8b3c","Type":"ContainerDied","Data":"febe9df397629ffa7397b256ffa221e6560dd618188e5c3e5ea2856de4efa247"} Jul 07 23:14:17.745689 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:17.745650 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/896a6145-9c7e-4bb8-9e71-d35415f005dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rk84p\" (UID: \"896a6145-9c7e-4bb8-9e71-d35415f005dc\") " pod="openshift-insights/insights-runtime-extractor-rk84p" Jul 07 23:14:17.745858 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:17.745713 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/896a6145-9c7e-4bb8-9e71-d35415f005dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rk84p\" (UID: \"896a6145-9c7e-4bb8-9e71-d35415f005dc\") " pod="openshift-insights/insights-runtime-extractor-rk84p" Jul 07 23:14:17.745858 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:17.745825 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 23:14:17.745949 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:17.745857 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 23:14:17.745949 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:17.745903 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/896a6145-9c7e-4bb8-9e71-d35415f005dc-insights-runtime-extractor-tls podName:896a6145-9c7e-4bb8-9e71-d35415f005dc nodeName:}" failed. No retries permitted until 2026-07-07 23:14:21.745884622 +0000 UTC m=+43.155946839 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/896a6145-9c7e-4bb8-9e71-d35415f005dc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rk84p" (UID: "896a6145-9c7e-4bb8-9e71-d35415f005dc") : secret "insights-runtime-extractor-tls" not found Jul 07 23:14:17.745949 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:17.745921 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/896a6145-9c7e-4bb8-9e71-d35415f005dc-kube-rbac-proxy-cm podName:896a6145-9c7e-4bb8-9e71-d35415f005dc nodeName:}" failed. No retries permitted until 2026-07-07 23:14:21.745913529 +0000 UTC m=+43.155975745 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/896a6145-9c7e-4bb8-9e71-d35415f005dc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rk84p" (UID: "896a6145-9c7e-4bb8-9e71-d35415f005dc") : configmap "kube-rbac-proxy" not found Jul 07 23:14:17.846557 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:17.846511 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-registry-tls\") pod \"image-registry-85b4878b74-75lvx\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:17.846747 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:17.846581 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd9b2457-0512-4b0c-8f68-5e2b0091ed3e-metrics-tls\") pod \"dns-default-zqnmf\" (UID: \"dd9b2457-0512-4b0c-8f68-5e2b0091ed3e\") " pod="openshift-dns/dns-default-zqnmf" Jul 07 23:14:17.846747 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:17.846727 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 23:14:17.846747 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:17.846734 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 23:14:17.846909 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:17.846757 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85b4878b74-75lvx: secret "image-registry-tls" not found Jul 07 23:14:17.846909 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:17.846786 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd9b2457-0512-4b0c-8f68-5e2b0091ed3e-metrics-tls podName:dd9b2457-0512-4b0c-8f68-5e2b0091ed3e nodeName:}" failed. No retries permitted until 2026-07-07 23:14:21.846773753 +0000 UTC m=+43.256835973 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd9b2457-0512-4b0c-8f68-5e2b0091ed3e-metrics-tls") pod "dns-default-zqnmf" (UID: "dd9b2457-0512-4b0c-8f68-5e2b0091ed3e") : secret "dns-default-metrics-tls" not found Jul 07 23:14:17.846909 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:17.846809 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-registry-tls podName:56cbfa43-9143-4c33-a92c-4fff6872e85b nodeName:}" failed. No retries permitted until 2026-07-07 23:14:21.846792598 +0000 UTC m=+43.256854832 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-registry-tls") pod "image-registry-85b4878b74-75lvx" (UID: "56cbfa43-9143-4c33-a92c-4fff6872e85b") : secret "image-registry-tls" not found Jul 07 23:14:18.304978 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:18.304935 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hg4n2" event={"ID":"7839699b-d95d-4e11-bac2-a1cca78e8b3c","Type":"ContainerStarted","Data":"9e6f6e27e7bdb8919aa566c12821fc7095424e26b1c60bb393851088b2d936d3"} Jul 07 23:14:18.335877 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:18.335826 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hg4n2" podStartSLOduration=9.098420236 podStartE2EDuration="39.335811377s" totalImagesPullingTime="30.237391141s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:13:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:14:18.332821011 +0000 UTC m=+39.742883237" watchObservedRunningTime="2026-07-07 23:14:18.335811377 +0000 UTC m=+39.745873615" Jul 07 23:14:19.309224 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:19.309190 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lqh8p" event={"ID":"b58e842e-195e-445f-b167-5f9a98fa3778","Type":"ContainerStarted","Data":"24aead629b31ab856deb0098edf0028be983186f522812f90da0cabc8c95bf4d"} Jul 07 23:14:19.332644 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:19.332593 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lqh8p" podStartSLOduration=3.6351404069999997 podStartE2EDuration="6.332576869s" totalImagesPullingTime="2.697436462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:14:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:14:19.3323498 +0000 UTC m=+40.742412038" watchObservedRunningTime="2026-07-07 23:14:19.332576869 +0000 UTC m=+40.742639108" Jul 07 23:14:21.774221 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:21.774164 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/896a6145-9c7e-4bb8-9e71-d35415f005dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rk84p\" (UID: \"896a6145-9c7e-4bb8-9e71-d35415f005dc\") " pod="openshift-insights/insights-runtime-extractor-rk84p" Jul 07 23:14:21.774221 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:21.774227 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/896a6145-9c7e-4bb8-9e71-d35415f005dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rk84p\" (UID: \"896a6145-9c7e-4bb8-9e71-d35415f005dc\") " pod="openshift-insights/insights-runtime-extractor-rk84p" Jul 07 23:14:21.774682 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:21.774295 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 23:14:21.774682 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:21.774337 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 23:14:21.774682 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:21.774348 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/896a6145-9c7e-4bb8-9e71-d35415f005dc-kube-rbac-proxy-cm podName:896a6145-9c7e-4bb8-9e71-d35415f005dc nodeName:}" failed. No retries permitted until 2026-07-07 23:14:29.774334356 +0000 UTC m=+51.184396572 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/896a6145-9c7e-4bb8-9e71-d35415f005dc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rk84p" (UID: "896a6145-9c7e-4bb8-9e71-d35415f005dc") : configmap "kube-rbac-proxy" not found Jul 07 23:14:21.774682 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:21.774412 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/896a6145-9c7e-4bb8-9e71-d35415f005dc-insights-runtime-extractor-tls podName:896a6145-9c7e-4bb8-9e71-d35415f005dc nodeName:}" failed. No retries permitted until 2026-07-07 23:14:29.774392183 +0000 UTC m=+51.184454404 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/896a6145-9c7e-4bb8-9e71-d35415f005dc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rk84p" (UID: "896a6145-9c7e-4bb8-9e71-d35415f005dc") : secret "insights-runtime-extractor-tls" not found Jul 07 23:14:21.875087 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:21.875046 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-registry-tls\") pod \"image-registry-85b4878b74-75lvx\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:21.875246 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:21.875096 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd9b2457-0512-4b0c-8f68-5e2b0091ed3e-metrics-tls\") pod \"dns-default-zqnmf\" (UID: \"dd9b2457-0512-4b0c-8f68-5e2b0091ed3e\") " pod="openshift-dns/dns-default-zqnmf" Jul 07 23:14:21.875246 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:21.875187 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 23:14:21.875246 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:21.875203 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 23:14:21.875246 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:21.875220 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85b4878b74-75lvx: secret "image-registry-tls" not found Jul 07 23:14:21.875246 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:21.875236 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd9b2457-0512-4b0c-8f68-5e2b0091ed3e-metrics-tls podName:dd9b2457-0512-4b0c-8f68-5e2b0091ed3e nodeName:}" failed. No retries permitted until 2026-07-07 23:14:29.875224744 +0000 UTC m=+51.285286959 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd9b2457-0512-4b0c-8f68-5e2b0091ed3e-metrics-tls") pod "dns-default-zqnmf" (UID: "dd9b2457-0512-4b0c-8f68-5e2b0091ed3e") : secret "dns-default-metrics-tls" not found Jul 07 23:14:21.875403 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:21.875290 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-registry-tls podName:56cbfa43-9143-4c33-a92c-4fff6872e85b nodeName:}" failed. No retries permitted until 2026-07-07 23:14:29.87525054 +0000 UTC m=+51.285312778 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-registry-tls") pod "image-registry-85b4878b74-75lvx" (UID: "56cbfa43-9143-4c33-a92c-4fff6872e85b") : secret "image-registry-tls" not found Jul 07 23:14:29.837527 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:29.837467 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/896a6145-9c7e-4bb8-9e71-d35415f005dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rk84p\" (UID: \"896a6145-9c7e-4bb8-9e71-d35415f005dc\") " pod="openshift-insights/insights-runtime-extractor-rk84p" Jul 07 23:14:29.837527 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:29.837533 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/896a6145-9c7e-4bb8-9e71-d35415f005dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rk84p\" (UID: \"896a6145-9c7e-4bb8-9e71-d35415f005dc\") " pod="openshift-insights/insights-runtime-extractor-rk84p" Jul 07 23:14:29.838166 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:29.837640 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 23:14:29.838166 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:29.837738 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/896a6145-9c7e-4bb8-9e71-d35415f005dc-insights-runtime-extractor-tls podName:896a6145-9c7e-4bb8-9e71-d35415f005dc nodeName:}" failed. No retries permitted until 2026-07-07 23:14:45.837715589 +0000 UTC m=+67.247777815 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/896a6145-9c7e-4bb8-9e71-d35415f005dc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rk84p" (UID: "896a6145-9c7e-4bb8-9e71-d35415f005dc") : secret "insights-runtime-extractor-tls" not found Jul 07 23:14:29.838166 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:29.838033 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/896a6145-9c7e-4bb8-9e71-d35415f005dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rk84p\" (UID: \"896a6145-9c7e-4bb8-9e71-d35415f005dc\") " pod="openshift-insights/insights-runtime-extractor-rk84p" Jul 07 23:14:29.938220 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:29.938186 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-registry-tls\") pod \"image-registry-85b4878b74-75lvx\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:29.938386 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:29.938233 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd9b2457-0512-4b0c-8f68-5e2b0091ed3e-metrics-tls\") pod \"dns-default-zqnmf\" (UID: \"dd9b2457-0512-4b0c-8f68-5e2b0091ed3e\") " pod="openshift-dns/dns-default-zqnmf" Jul 07 23:14:29.938386 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:29.938330 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 23:14:29.938386 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:29.938348 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85b4878b74-75lvx: secret "image-registry-tls" not found Jul 07 23:14:29.938506 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:29.938403 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-registry-tls podName:56cbfa43-9143-4c33-a92c-4fff6872e85b nodeName:}" failed. No retries permitted until 2026-07-07 23:14:45.938388295 +0000 UTC m=+67.348450511 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-registry-tls") pod "image-registry-85b4878b74-75lvx" (UID: "56cbfa43-9143-4c33-a92c-4fff6872e85b") : secret "image-registry-tls" not found Jul 07 23:14:29.942177 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:29.942157 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd9b2457-0512-4b0c-8f68-5e2b0091ed3e-metrics-tls\") pod \"dns-default-zqnmf\" (UID: \"dd9b2457-0512-4b0c-8f68-5e2b0091ed3e\") " pod="openshift-dns/dns-default-zqnmf" Jul 07 23:14:29.965309 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:29.965276 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zqnmf" Jul 07 23:14:30.117633 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:30.117554 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zqnmf"] Jul 07 23:14:30.120817 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:14:30.120784 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd9b2457_0512_4b0c_8f68_5e2b0091ed3e.slice/crio-cb2188380cf6bf157ffa32b24ec6cf8e417b452bbe56f09fbf5e3cb375ff8023 WatchSource:0}: Error finding container cb2188380cf6bf157ffa32b24ec6cf8e417b452bbe56f09fbf5e3cb375ff8023: Status 404 returned error can't find the container with id cb2188380cf6bf157ffa32b24ec6cf8e417b452bbe56f09fbf5e3cb375ff8023 Jul 07 23:14:30.333625 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:30.333590 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zqnmf" event={"ID":"dd9b2457-0512-4b0c-8f68-5e2b0091ed3e","Type":"ContainerStarted","Data":"cb2188380cf6bf157ffa32b24ec6cf8e417b452bbe56f09fbf5e3cb375ff8023"} Jul 07 23:14:33.342002 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:33.341958 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zqnmf" event={"ID":"dd9b2457-0512-4b0c-8f68-5e2b0091ed3e","Type":"ContainerStarted","Data":"a3a50268c4359ca72cc26a50f7519c230baa30bea6496d9abffc87b5aa285196"} Jul 07 23:14:33.342379 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:33.342012 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zqnmf" event={"ID":"dd9b2457-0512-4b0c-8f68-5e2b0091ed3e","Type":"ContainerStarted","Data":"251a4ab752ac6da8232b6b48ef6adda431b5b34a14bb927164d7c9079d302abb"} Jul 07 23:14:33.342379 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:33.342100 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zqnmf" Jul 07 23:14:33.370786 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:33.370725 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zqnmf" podStartSLOduration=17.115977203 podStartE2EDuration="19.370710227s" totalImagesPullingTime="2.254733024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:14:33.369412421 +0000 UTC m=+54.779474661" watchObservedRunningTime="2026-07-07 23:14:33.370710227 +0000 UTC m=+54.780772443" Jul 07 23:14:40.277513 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:40.277455 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6wsmm" Jul 07 23:14:43.346406 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:43.346377 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zqnmf" Jul 07 23:14:44.848310 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:44.848261 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8-original-pull-secret\") pod \"global-pull-secret-syncer-rksdr\" (UID: \"fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8\") " pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:14:44.848310 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:44.848312 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1f655ca-5728-4b21-b5ba-298b1d9fa0f7-metrics-certs\") pod \"network-metrics-daemon-jcr7v\" (UID: \"f1f655ca-5728-4b21-b5ba-298b1d9fa0f7\") " pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:14:44.848310 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:44.848334 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvgqw\" (UniqueName: \"kubernetes.io/projected/dea746d7-4d19-4bbf-b437-4ddf238117b5-kube-api-access-wvgqw\") pod \"network-check-target-l8cls\" (UID: \"dea746d7-4d19-4bbf-b437-4ddf238117b5\") " pod="openshift-network-diagnostics/network-check-target-l8cls" Jul 07 23:14:44.851227 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:44.851205 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 23:14:44.851282 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:44.851205 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 23:14:44.852253 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:44.852238 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 23:14:44.861569 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:44.861544 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1f655ca-5728-4b21-b5ba-298b1d9fa0f7-metrics-certs\") pod \"network-metrics-daemon-jcr7v\" (UID: \"f1f655ca-5728-4b21-b5ba-298b1d9fa0f7\") " pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:14:44.861695 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:44.861567 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8-original-pull-secret\") pod \"global-pull-secret-syncer-rksdr\" (UID: \"fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8\") " pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:14:44.861695 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:44.861583 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 23:14:44.872189 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:44.872163 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvgqw\" (UniqueName: \"kubernetes.io/projected/dea746d7-4d19-4bbf-b437-4ddf238117b5-kube-api-access-wvgqw\") pod \"network-check-target-l8cls\" (UID: \"dea746d7-4d19-4bbf-b437-4ddf238117b5\") " pod="openshift-network-diagnostics/network-check-target-l8cls" Jul 07 23:14:45.027127 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.027095 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nhfdw\"" Jul 07 23:14:45.029569 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.029551 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rksdr" Jul 07 23:14:45.034571 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.034553 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8cls" Jul 07 23:14:45.038924 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.038784 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hxkkf\"" Jul 07 23:14:45.047190 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.047153 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcr7v" Jul 07 23:14:45.175199 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.175163 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rksdr"] Jul 07 23:14:45.179087 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:14:45.179055 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb77d2b8_4f5a_446e_83bd_08a5ff41f2d8.slice/crio-f07634dab28605c1de60a58b85a21ddf07d0d00a0c2aa39cd4dd6f2e0e04ea46 WatchSource:0}: Error finding container f07634dab28605c1de60a58b85a21ddf07d0d00a0c2aa39cd4dd6f2e0e04ea46: Status 404 returned error can't find the container with id f07634dab28605c1de60a58b85a21ddf07d0d00a0c2aa39cd4dd6f2e0e04ea46 Jul 07 23:14:45.197908 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.197878 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l8cls"] Jul 07 23:14:45.200189 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.200168 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jcr7v"] Jul 07 23:14:45.201971 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:14:45.201944 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddea746d7_4d19_4bbf_b437_4ddf238117b5.slice/crio-e86239eff5a77813f81341da53345d79a5fa63d365b5c0912eaa481e98b80e23 WatchSource:0}: Error finding container e86239eff5a77813f81341da53345d79a5fa63d365b5c0912eaa481e98b80e23: Status 404 returned error can't find the container with id e86239eff5a77813f81341da53345d79a5fa63d365b5c0912eaa481e98b80e23 Jul 07 23:14:45.203324 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:14:45.203302 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1f655ca_5728_4b21_b5ba_298b1d9fa0f7.slice/crio-a1e6f907a4d1cc5632a6d0301d7ab6b296e610b1b6b6705d7ff93f721d3e7511 WatchSource:0}: Error finding container a1e6f907a4d1cc5632a6d0301d7ab6b296e610b1b6b6705d7ff93f721d3e7511: Status 404 returned error can't find the container with id a1e6f907a4d1cc5632a6d0301d7ab6b296e610b1b6b6705d7ff93f721d3e7511 Jul 07 23:14:45.370324 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.370225 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jcr7v" event={"ID":"f1f655ca-5728-4b21-b5ba-298b1d9fa0f7","Type":"ContainerStarted","Data":"a1e6f907a4d1cc5632a6d0301d7ab6b296e610b1b6b6705d7ff93f721d3e7511"} Jul 07 23:14:45.371352 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.371328 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l8cls" event={"ID":"dea746d7-4d19-4bbf-b437-4ddf238117b5","Type":"ContainerStarted","Data":"e86239eff5a77813f81341da53345d79a5fa63d365b5c0912eaa481e98b80e23"} Jul 07 23:14:45.372386 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.372369 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rksdr" event={"ID":"fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8","Type":"ContainerStarted","Data":"f07634dab28605c1de60a58b85a21ddf07d0d00a0c2aa39cd4dd6f2e0e04ea46"} Jul 07 23:14:45.768119 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.768079 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd9c5747d-22g9s"] Jul 07 23:14:45.770411 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.770339 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd9c5747d-22g9s" Jul 07 23:14:45.773371 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.773343 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b5df7959d-vxw5n"] Jul 07 23:14:45.774836 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.774812 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 07 23:14:45.774961 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.774894 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-g95v6\"" Jul 07 23:14:45.775253 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.775107 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 07 23:14:45.776299 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.775911 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 07 23:14:45.776299 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.776012 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b5df7959d-vxw5n" Jul 07 23:14:45.776299 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.776136 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 07 23:14:45.779628 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.779570 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 07 23:14:45.787092 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.787024 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd9c5747d-22g9s"] Jul 07 23:14:45.805251 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.804935 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85b4878b74-75lvx"] Jul 07 23:14:45.805251 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:45.805192 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-85b4878b74-75lvx" podUID="56cbfa43-9143-4c33-a92c-4fff6872e85b" Jul 07 23:14:45.809979 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.809950 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b5df7959d-vxw5n"] Jul 07 23:14:45.855205 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.855157 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jrjw\" (UniqueName: \"kubernetes.io/projected/e765c070-c042-471c-ad06-5842ceb85178-kube-api-access-4jrjw\") pod \"managed-serviceaccount-addon-agent-bd9c5747d-22g9s\" (UID: \"e765c070-c042-471c-ad06-5842ceb85178\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd9c5747d-22g9s" Jul 07 23:14:45.855765 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.855241 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e765c070-c042-471c-ad06-5842ceb85178-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bd9c5747d-22g9s\" (UID: \"e765c070-c042-471c-ad06-5842ceb85178\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd9c5747d-22g9s" Jul 07 23:14:45.855765 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.855272 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhnds\" (UniqueName: \"kubernetes.io/projected/8f0a96de-93ca-46f7-b977-cf324778db5f-kube-api-access-bhnds\") pod \"klusterlet-addon-workmgr-6b5df7959d-vxw5n\" (UID: \"8f0a96de-93ca-46f7-b977-cf324778db5f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b5df7959d-vxw5n" Jul 07 23:14:45.855765 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.855307 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f0a96de-93ca-46f7-b977-cf324778db5f-tmp\") pod \"klusterlet-addon-workmgr-6b5df7959d-vxw5n\" (UID: \"8f0a96de-93ca-46f7-b977-cf324778db5f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b5df7959d-vxw5n" Jul 07 23:14:45.855765 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.855359 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8f0a96de-93ca-46f7-b977-cf324778db5f-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b5df7959d-vxw5n\" (UID: \"8f0a96de-93ca-46f7-b977-cf324778db5f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b5df7959d-vxw5n" Jul 07 23:14:45.855765 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.855391 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/896a6145-9c7e-4bb8-9e71-d35415f005dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rk84p\" (UID: \"896a6145-9c7e-4bb8-9e71-d35415f005dc\") " pod="openshift-insights/insights-runtime-extractor-rk84p" Jul 07 23:14:45.866057 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.865942 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/896a6145-9c7e-4bb8-9e71-d35415f005dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rk84p\" (UID: \"896a6145-9c7e-4bb8-9e71-d35415f005dc\") " pod="openshift-insights/insights-runtime-extractor-rk84p" Jul 07 23:14:45.868732 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.867920 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68cf46c6d4-xqn8z"] Jul 07 23:14:45.870382 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.870352 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68cf46c6d4-xqn8z" Jul 07 23:14:45.886745 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.886276 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68cf46c6d4-xqn8z"] Jul 07 23:14:45.958288 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.958253 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f0a96de-93ca-46f7-b977-cf324778db5f-tmp\") pod \"klusterlet-addon-workmgr-6b5df7959d-vxw5n\" (UID: \"8f0a96de-93ca-46f7-b977-cf324778db5f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b5df7959d-vxw5n" Jul 07 23:14:45.958508 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.958318 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-registry-tls\") pod \"image-registry-85b4878b74-75lvx\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:45.958508 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.958366 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3-installation-pull-secrets\") pod \"image-registry-68cf46c6d4-xqn8z\" (UID: \"3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3\") " pod="openshift-image-registry/image-registry-68cf46c6d4-xqn8z" Jul 07 23:14:45.958508 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.958461 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3-image-registry-private-configuration\") pod \"image-registry-68cf46c6d4-xqn8z\" (UID: \"3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3\") " pod="openshift-image-registry/image-registry-68cf46c6d4-xqn8z" Jul 07 23:14:45.958696 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.958592 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3-registry-tls\") pod \"image-registry-68cf46c6d4-xqn8z\" (UID: \"3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3\") " pod="openshift-image-registry/image-registry-68cf46c6d4-xqn8z" Jul 07 23:14:45.958747 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.958717 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e765c070-c042-471c-ad06-5842ceb85178-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bd9c5747d-22g9s\" (UID: \"e765c070-c042-471c-ad06-5842ceb85178\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd9c5747d-22g9s" Jul 07 23:14:45.958801 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.958749 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxs2p\" (UniqueName: \"kubernetes.io/projected/3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3-kube-api-access-jxs2p\") pod \"image-registry-68cf46c6d4-xqn8z\" (UID: \"3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3\") " pod="openshift-image-registry/image-registry-68cf46c6d4-xqn8z" Jul 07 23:14:45.958801 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.958788 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3-ca-trust-extracted\") pod \"image-registry-68cf46c6d4-xqn8z\" (UID: \"3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3\") " pod="openshift-image-registry/image-registry-68cf46c6d4-xqn8z" Jul 07 23:14:45.958899 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.958822 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3-registry-certificates\") pod \"image-registry-68cf46c6d4-xqn8z\" (UID: \"3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3\") " pod="openshift-image-registry/image-registry-68cf46c6d4-xqn8z" Jul 07 23:14:45.958899 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.958888 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3-bound-sa-token\") pod \"image-registry-68cf46c6d4-xqn8z\" (UID: \"3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3\") " pod="openshift-image-registry/image-registry-68cf46c6d4-xqn8z" Jul 07 23:14:45.959003 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.958958 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8f0a96de-93ca-46f7-b977-cf324778db5f-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b5df7959d-vxw5n\" (UID: \"8f0a96de-93ca-46f7-b977-cf324778db5f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b5df7959d-vxw5n" Jul 07 23:14:45.959054 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.959015 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3-trusted-ca\") pod \"image-registry-68cf46c6d4-xqn8z\" (UID: \"3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3\") " pod="openshift-image-registry/image-registry-68cf46c6d4-xqn8z" Jul 07 23:14:45.959111 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.959083 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhnds\" (UniqueName: \"kubernetes.io/projected/8f0a96de-93ca-46f7-b977-cf324778db5f-kube-api-access-bhnds\") pod \"klusterlet-addon-workmgr-6b5df7959d-vxw5n\" (UID: \"8f0a96de-93ca-46f7-b977-cf324778db5f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b5df7959d-vxw5n" Jul 07 23:14:45.959165 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.959119 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jrjw\" (UniqueName: \"kubernetes.io/projected/e765c070-c042-471c-ad06-5842ceb85178-kube-api-access-4jrjw\") pod \"managed-serviceaccount-addon-agent-bd9c5747d-22g9s\" (UID: \"e765c070-c042-471c-ad06-5842ceb85178\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd9c5747d-22g9s" Jul 07 23:14:45.960010 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.959979 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f0a96de-93ca-46f7-b977-cf324778db5f-tmp\") pod \"klusterlet-addon-workmgr-6b5df7959d-vxw5n\" (UID: \"8f0a96de-93ca-46f7-b977-cf324778db5f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b5df7959d-vxw5n" Jul 07 23:14:45.964154 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.964120 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-registry-tls\") pod \"image-registry-85b4878b74-75lvx\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:45.964265 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.964178 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e765c070-c042-471c-ad06-5842ceb85178-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bd9c5747d-22g9s\" (UID: \"e765c070-c042-471c-ad06-5842ceb85178\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd9c5747d-22g9s" Jul 07 23:14:45.966554 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.966502 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8f0a96de-93ca-46f7-b977-cf324778db5f-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b5df7959d-vxw5n\" (UID: \"8f0a96de-93ca-46f7-b977-cf324778db5f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b5df7959d-vxw5n" Jul 07 23:14:45.977830 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.977785 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jrjw\" (UniqueName: \"kubernetes.io/projected/e765c070-c042-471c-ad06-5842ceb85178-kube-api-access-4jrjw\") pod \"managed-serviceaccount-addon-agent-bd9c5747d-22g9s\" (UID: \"e765c070-c042-471c-ad06-5842ceb85178\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd9c5747d-22g9s" Jul 07 23:14:45.979151 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:45.979123 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhnds\" (UniqueName: \"kubernetes.io/projected/8f0a96de-93ca-46f7-b977-cf324778db5f-kube-api-access-bhnds\") pod \"klusterlet-addon-workmgr-6b5df7959d-vxw5n\" (UID: \"8f0a96de-93ca-46f7-b977-cf324778db5f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b5df7959d-vxw5n" Jul 07 23:14:46.060753 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.060230 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3-installation-pull-secrets\") pod \"image-registry-68cf46c6d4-xqn8z\" (UID: \"3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3\") " pod="openshift-image-registry/image-registry-68cf46c6d4-xqn8z" Jul 07 23:14:46.060753 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.060286 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3-image-registry-private-configuration\") pod \"image-registry-68cf46c6d4-xqn8z\" (UID: \"3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3\") " pod="openshift-image-registry/image-registry-68cf46c6d4-xqn8z" Jul 07 23:14:46.060753 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.060316 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3-registry-tls\") pod \"image-registry-68cf46c6d4-xqn8z\" (UID: \"3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3\") " pod="openshift-image-registry/image-registry-68cf46c6d4-xqn8z" Jul 07 23:14:46.060753 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.060345 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxs2p\" (UniqueName: \"kubernetes.io/projected/3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3-kube-api-access-jxs2p\") pod \"image-registry-68cf46c6d4-xqn8z\" (UID: \"3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3\") " pod="openshift-image-registry/image-registry-68cf46c6d4-xqn8z" Jul 07 23:14:46.060753 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.060372 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3-ca-trust-extracted\") pod \"image-registry-68cf46c6d4-xqn8z\" (UID: \"3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3\") " pod="openshift-image-registry/image-registry-68cf46c6d4-xqn8z" Jul 07 23:14:46.060753 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.060397 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3-registry-certificates\") pod \"image-registry-68cf46c6d4-xqn8z\" (UID: \"3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3\") " pod="openshift-image-registry/image-registry-68cf46c6d4-xqn8z" Jul 07 23:14:46.060753 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.060421 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3-bound-sa-token\") pod \"image-registry-68cf46c6d4-xqn8z\" (UID: \"3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3\") " pod="openshift-image-registry/image-registry-68cf46c6d4-xqn8z" Jul 07 23:14:46.060753 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.060456 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3-trusted-ca\") pod \"image-registry-68cf46c6d4-xqn8z\" (UID: \"3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3\") " pod="openshift-image-registry/image-registry-68cf46c6d4-xqn8z" Jul 07 23:14:46.062417 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.062027 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3-registry-certificates\") pod \"image-registry-68cf46c6d4-xqn8z\" (UID: \"3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3\") " pod="openshift-image-registry/image-registry-68cf46c6d4-xqn8z" Jul 07 23:14:46.062417 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.062063 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3-trusted-ca\") pod \"image-registry-68cf46c6d4-xqn8z\" (UID: \"3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3\") " pod="openshift-image-registry/image-registry-68cf46c6d4-xqn8z" Jul 07 23:14:46.062417 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.062314 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3-ca-trust-extracted\") pod \"image-registry-68cf46c6d4-xqn8z\" (UID: \"3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3\") " pod="openshift-image-registry/image-registry-68cf46c6d4-xqn8z" Jul 07 23:14:46.064939 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.064904 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3-installation-pull-secrets\") pod \"image-registry-68cf46c6d4-xqn8z\" (UID: \"3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3\") " pod="openshift-image-registry/image-registry-68cf46c6d4-xqn8z" Jul 07 23:14:46.065067 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.064969 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3-image-registry-private-configuration\") pod \"image-registry-68cf46c6d4-xqn8z\" (UID: \"3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3\") " pod="openshift-image-registry/image-registry-68cf46c6d4-xqn8z" Jul 07 23:14:46.065569 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.065540 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3-registry-tls\") pod \"image-registry-68cf46c6d4-xqn8z\" (UID: \"3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3\") " pod="openshift-image-registry/image-registry-68cf46c6d4-xqn8z" Jul 07 23:14:46.079585 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.079556 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxs2p\" (UniqueName: \"kubernetes.io/projected/3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3-kube-api-access-jxs2p\") pod \"image-registry-68cf46c6d4-xqn8z\" (UID: \"3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3\") " pod="openshift-image-registry/image-registry-68cf46c6d4-xqn8z" Jul 07 23:14:46.084126 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.083840 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3-bound-sa-token\") pod \"image-registry-68cf46c6d4-xqn8z\" (UID: \"3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3\") " pod="openshift-image-registry/image-registry-68cf46c6d4-xqn8z" Jul 07 23:14:46.097836 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.097802 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd9c5747d-22g9s" Jul 07 23:14:46.107703 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.107447 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b5df7959d-vxw5n" Jul 07 23:14:46.136238 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.136205 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wxtn5\"" Jul 07 23:14:46.143907 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.143867 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rk84p" Jul 07 23:14:46.199287 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.199079 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wgd2s\"" Jul 07 23:14:46.201666 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.201638 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68cf46c6d4-xqn8z" Jul 07 23:14:46.379655 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.378918 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:46.388756 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.388624 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:46.466095 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.464544 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/56cbfa43-9143-4c33-a92c-4fff6872e85b-installation-pull-secrets\") pod \"56cbfa43-9143-4c33-a92c-4fff6872e85b\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " Jul 07 23:14:46.466095 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.464592 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8g8c7\" (UniqueName: \"kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-kube-api-access-8g8c7\") pod \"56cbfa43-9143-4c33-a92c-4fff6872e85b\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " Jul 07 23:14:46.466095 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.464635 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56cbfa43-9143-4c33-a92c-4fff6872e85b-trusted-ca\") pod \"56cbfa43-9143-4c33-a92c-4fff6872e85b\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " Jul 07 23:14:46.466095 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.464682 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/56cbfa43-9143-4c33-a92c-4fff6872e85b-image-registry-private-configuration\") pod \"56cbfa43-9143-4c33-a92c-4fff6872e85b\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " Jul 07 23:14:46.466095 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.464713 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/56cbfa43-9143-4c33-a92c-4fff6872e85b-registry-certificates\") pod \"56cbfa43-9143-4c33-a92c-4fff6872e85b\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " Jul 07 23:14:46.466095 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.464743 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-bound-sa-token\") pod \"56cbfa43-9143-4c33-a92c-4fff6872e85b\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " Jul 07 23:14:46.466095 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.464778 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-registry-tls\") pod \"56cbfa43-9143-4c33-a92c-4fff6872e85b\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " Jul 07 23:14:46.466095 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.464803 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/56cbfa43-9143-4c33-a92c-4fff6872e85b-ca-trust-extracted\") pod \"56cbfa43-9143-4c33-a92c-4fff6872e85b\" (UID: \"56cbfa43-9143-4c33-a92c-4fff6872e85b\") " Jul 07 23:14:46.466095 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.465806 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56cbfa43-9143-4c33-a92c-4fff6872e85b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "56cbfa43-9143-4c33-a92c-4fff6872e85b" (UID: "56cbfa43-9143-4c33-a92c-4fff6872e85b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 23:14:46.470237 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.470193 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56cbfa43-9143-4c33-a92c-4fff6872e85b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "56cbfa43-9143-4c33-a92c-4fff6872e85b" (UID: "56cbfa43-9143-4c33-a92c-4fff6872e85b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 23:14:46.470461 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.470432 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56cbfa43-9143-4c33-a92c-4fff6872e85b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "56cbfa43-9143-4c33-a92c-4fff6872e85b" (UID: "56cbfa43-9143-4c33-a92c-4fff6872e85b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 23:14:46.473226 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.473177 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56cbfa43-9143-4c33-a92c-4fff6872e85b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "56cbfa43-9143-4c33-a92c-4fff6872e85b" (UID: "56cbfa43-9143-4c33-a92c-4fff6872e85b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 23:14:46.473682 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.473644 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "56cbfa43-9143-4c33-a92c-4fff6872e85b" (UID: "56cbfa43-9143-4c33-a92c-4fff6872e85b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 23:14:46.473784 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.473686 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "56cbfa43-9143-4c33-a92c-4fff6872e85b" (UID: "56cbfa43-9143-4c33-a92c-4fff6872e85b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 23:14:46.494460 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.494397 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56cbfa43-9143-4c33-a92c-4fff6872e85b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "56cbfa43-9143-4c33-a92c-4fff6872e85b" (UID: "56cbfa43-9143-4c33-a92c-4fff6872e85b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 23:14:46.503225 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.503144 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-kube-api-access-8g8c7" (OuterVolumeSpecName: "kube-api-access-8g8c7") pod "56cbfa43-9143-4c33-a92c-4fff6872e85b" (UID: "56cbfa43-9143-4c33-a92c-4fff6872e85b"). InnerVolumeSpecName "kube-api-access-8g8c7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 23:14:46.548291 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.548258 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b5df7959d-vxw5n"] Jul 07 23:14:46.550932 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.550900 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rk84p"] Jul 07 23:14:46.558792 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:14:46.558746 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod896a6145_9c7e_4bb8_9e71_d35415f005dc.slice/crio-f39d07ece2fcbbe75405ff8a9f6038bbfd49b74a834f195b38dd62fdd5f64d66 WatchSource:0}: Error finding container f39d07ece2fcbbe75405ff8a9f6038bbfd49b74a834f195b38dd62fdd5f64d66: Status 404 returned error can't find the container with id f39d07ece2fcbbe75405ff8a9f6038bbfd49b74a834f195b38dd62fdd5f64d66 Jul 07 23:14:46.565917 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.565656 2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/56cbfa43-9143-4c33-a92c-4fff6872e85b-image-registry-private-configuration\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:14:46.565917 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.565679 2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/56cbfa43-9143-4c33-a92c-4fff6872e85b-registry-certificates\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:14:46.565917 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.565696 2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-bound-sa-token\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:14:46.565917 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.565709 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-registry-tls\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:14:46.565917 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.565722 2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/56cbfa43-9143-4c33-a92c-4fff6872e85b-ca-trust-extracted\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:14:46.565917 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.565735 2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/56cbfa43-9143-4c33-a92c-4fff6872e85b-installation-pull-secrets\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:14:46.565917 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.565749 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8g8c7\" (UniqueName: \"kubernetes.io/projected/56cbfa43-9143-4c33-a92c-4fff6872e85b-kube-api-access-8g8c7\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:14:46.565917 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.565762 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56cbfa43-9143-4c33-a92c-4fff6872e85b-trusted-ca\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:14:46.578789 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.578760 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd9c5747d-22g9s"] Jul 07 23:14:46.584204 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:46.583977 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68cf46c6d4-xqn8z"] Jul 07 23:14:46.584508 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:14:46.584458 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode765c070_c042_471c_ad06_5842ceb85178.slice/crio-e5ae1e0badada4a2ba53945dd72636889172781ca3c2348ec6a9330dfd960bc4 WatchSource:0}: Error finding container e5ae1e0badada4a2ba53945dd72636889172781ca3c2348ec6a9330dfd960bc4: Status 404 returned error can't find the container with id e5ae1e0badada4a2ba53945dd72636889172781ca3c2348ec6a9330dfd960bc4 Jul 07 23:14:46.587939 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:14:46.587913 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bc75ab8_cfa1_489d_a3ad_9386b3bab5e3.slice/crio-1dfbf73c2d346ba9341394bc37baa7f63967880da648b1e799e7cc38f3a58958 WatchSource:0}: Error finding container 1dfbf73c2d346ba9341394bc37baa7f63967880da648b1e799e7cc38f3a58958: Status 404 returned error can't find the container with id 1dfbf73c2d346ba9341394bc37baa7f63967880da648b1e799e7cc38f3a58958 Jul 07 23:14:47.385127 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:47.385079 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b5df7959d-vxw5n" event={"ID":"8f0a96de-93ca-46f7-b977-cf324778db5f","Type":"ContainerStarted","Data":"81dcf5bbc1a624caf18b8992429f436e9288be688f7f1c896a7a19fc8e7bb330"} Jul 07 23:14:47.387266 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:47.387236 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rk84p" event={"ID":"896a6145-9c7e-4bb8-9e71-d35415f005dc","Type":"ContainerStarted","Data":"f39d07ece2fcbbe75405ff8a9f6038bbfd49b74a834f195b38dd62fdd5f64d66"} Jul 07 23:14:47.391525 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:47.391495 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jcr7v" event={"ID":"f1f655ca-5728-4b21-b5ba-298b1d9fa0f7","Type":"ContainerStarted","Data":"79f966144f80fcde9d8a48bc2c0980a18b252979935a4ead18cba1e51e59a403"} Jul 07 23:14:47.391649 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:47.391555 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jcr7v" event={"ID":"f1f655ca-5728-4b21-b5ba-298b1d9fa0f7","Type":"ContainerStarted","Data":"38d3f6302df6877afe9a33708f325ec993288c243c8a5b678a66a9a6152f710d"} Jul 07 23:14:47.395223 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:47.395195 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68cf46c6d4-xqn8z" event={"ID":"3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3","Type":"ContainerStarted","Data":"7bc339a76d0f77d8b278d1e0e9dc9836b1fe3d28caa36b19448edc8b7f7cecff"} Jul 07 23:14:47.395359 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:47.395244 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68cf46c6d4-xqn8z" event={"ID":"3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3","Type":"ContainerStarted","Data":"1dfbf73c2d346ba9341394bc37baa7f63967880da648b1e799e7cc38f3a58958"} Jul 07 23:14:47.395773 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:47.395755 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68cf46c6d4-xqn8z" Jul 07 23:14:47.400435 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:47.400415 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85b4878b74-75lvx" Jul 07 23:14:47.400902 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:47.400879 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd9c5747d-22g9s" event={"ID":"e765c070-c042-471c-ad06-5842ceb85178","Type":"ContainerStarted","Data":"e5ae1e0badada4a2ba53945dd72636889172781ca3c2348ec6a9330dfd960bc4"} Jul 07 23:14:47.415975 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:47.414826 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jcr7v" podStartSLOduration=67.245415133 podStartE2EDuration="1m8.414804168s" totalImagesPullingTime="1.169389035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:14:47.41334542 +0000 UTC m=+68.823407658" watchObservedRunningTime="2026-07-07 23:14:47.414804168 +0000 UTC m=+68.824866407" Jul 07 23:14:47.437715 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:47.437655 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68cf46c6d4-xqn8z" podStartSLOduration=2.4376309369999998 podStartE2EDuration="2.437630937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:14:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:14:47.435646591 +0000 UTC m=+68.845708842" watchObservedRunningTime="2026-07-07 23:14:47.437630937 +0000 UTC m=+68.847693178" Jul 07 23:14:47.473061 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:47.472972 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85b4878b74-75lvx"] Jul 07 23:14:47.473061 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:47.473026 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-85b4878b74-75lvx"] Jul 07 23:14:49.126343 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:49.126309 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56cbfa43-9143-4c33-a92c-4fff6872e85b" path="/var/lib/kubelet/pods/56cbfa43-9143-4c33-a92c-4fff6872e85b/volumes" Jul 07 23:14:50.307535 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:50.307470 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-cknll"] Jul 07 23:14:50.310330 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:50.310308 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cknll" Jul 07 23:14:50.314400 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:50.314373 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 07 23:14:50.314566 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:50.314399 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 23:14:50.314676 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:50.314660 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 07 23:14:50.314884 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:50.314868 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 23:14:50.315086 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:50.315068 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 23:14:50.315188 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:50.315150 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6h5mk\"" Jul 07 23:14:50.323612 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:50.323543 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-cknll"] Jul 07 23:14:50.405602 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:50.405567 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2qv2\" (UniqueName: \"kubernetes.io/projected/4e32f21f-f756-461f-8fd7-2dc3ac84a598-kube-api-access-s2qv2\") pod \"prometheus-operator-567f7b8b7c-cknll\" (UID: \"4e32f21f-f756-461f-8fd7-2dc3ac84a598\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cknll" Jul 07 23:14:50.405764 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:50.405623 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e32f21f-f756-461f-8fd7-2dc3ac84a598-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-cknll\" (UID: \"4e32f21f-f756-461f-8fd7-2dc3ac84a598\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cknll" Jul 07 23:14:50.405764 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:50.405725 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e32f21f-f756-461f-8fd7-2dc3ac84a598-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-cknll\" (UID: \"4e32f21f-f756-461f-8fd7-2dc3ac84a598\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cknll" Jul 07 23:14:50.405764 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:50.405743 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e32f21f-f756-461f-8fd7-2dc3ac84a598-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-cknll\" (UID: \"4e32f21f-f756-461f-8fd7-2dc3ac84a598\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cknll" Jul 07 23:14:50.506355 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:50.506317 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e32f21f-f756-461f-8fd7-2dc3ac84a598-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-cknll\" (UID: \"4e32f21f-f756-461f-8fd7-2dc3ac84a598\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cknll" Jul 07 23:14:50.506355 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:50.506362 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e32f21f-f756-461f-8fd7-2dc3ac84a598-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-cknll\" (UID: \"4e32f21f-f756-461f-8fd7-2dc3ac84a598\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cknll" Jul 07 23:14:50.506633 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:50.506382 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2qv2\" (UniqueName: \"kubernetes.io/projected/4e32f21f-f756-461f-8fd7-2dc3ac84a598-kube-api-access-s2qv2\") pod \"prometheus-operator-567f7b8b7c-cknll\" (UID: \"4e32f21f-f756-461f-8fd7-2dc3ac84a598\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cknll" Jul 07 23:14:50.506633 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:50.506416 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e32f21f-f756-461f-8fd7-2dc3ac84a598-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-cknll\" (UID: \"4e32f21f-f756-461f-8fd7-2dc3ac84a598\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cknll" Jul 07 23:14:50.506633 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:50.506566 2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 07 23:14:50.506633 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:14:50.506629 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e32f21f-f756-461f-8fd7-2dc3ac84a598-prometheus-operator-tls podName:4e32f21f-f756-461f-8fd7-2dc3ac84a598 nodeName:}" failed. No retries permitted until 2026-07-07 23:14:51.006609202 +0000 UTC m=+72.416671419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/4e32f21f-f756-461f-8fd7-2dc3ac84a598-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-cknll" (UID: "4e32f21f-f756-461f-8fd7-2dc3ac84a598") : secret "prometheus-operator-tls" not found Jul 07 23:14:50.507134 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:50.507111 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e32f21f-f756-461f-8fd7-2dc3ac84a598-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-cknll\" (UID: \"4e32f21f-f756-461f-8fd7-2dc3ac84a598\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cknll" Jul 07 23:14:50.509332 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:50.509309 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e32f21f-f756-461f-8fd7-2dc3ac84a598-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-cknll\" (UID: \"4e32f21f-f756-461f-8fd7-2dc3ac84a598\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cknll" Jul 07 23:14:50.516258 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:50.516223 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2qv2\" (UniqueName: \"kubernetes.io/projected/4e32f21f-f756-461f-8fd7-2dc3ac84a598-kube-api-access-s2qv2\") pod \"prometheus-operator-567f7b8b7c-cknll\" (UID: \"4e32f21f-f756-461f-8fd7-2dc3ac84a598\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cknll" Jul 07 23:14:51.011060 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:51.011018 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e32f21f-f756-461f-8fd7-2dc3ac84a598-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-cknll\" (UID: \"4e32f21f-f756-461f-8fd7-2dc3ac84a598\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cknll" Jul 07 23:14:51.013944 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:51.013916 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e32f21f-f756-461f-8fd7-2dc3ac84a598-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-cknll\" (UID: \"4e32f21f-f756-461f-8fd7-2dc3ac84a598\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cknll" Jul 07 23:14:51.222046 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:51.222003 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cknll" Jul 07 23:14:56.216162 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:56.216077 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-cknll"] Jul 07 23:14:56.221689 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:14:56.221578 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e32f21f_f756_461f_8fd7_2dc3ac84a598.slice/crio-6cd464f5a6fac63debe9b1fa5078733cca9aadb4773c2f402f8279bb6ec91098 WatchSource:0}: Error finding container 6cd464f5a6fac63debe9b1fa5078733cca9aadb4773c2f402f8279bb6ec91098: Status 404 returned error can't find the container with id 6cd464f5a6fac63debe9b1fa5078733cca9aadb4773c2f402f8279bb6ec91098 Jul 07 23:14:56.443220 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:56.443125 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l8cls" event={"ID":"dea746d7-4d19-4bbf-b437-4ddf238117b5","Type":"ContainerStarted","Data":"b0d50d4e9af11e27fc32e24e30eddd6ae789f713e29445eeb67ae4c7e60e77a4"} Jul 07 23:14:56.443220 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:56.443213 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-l8cls" Jul 07 23:14:56.444630 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:56.444607 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd9c5747d-22g9s" event={"ID":"e765c070-c042-471c-ad06-5842ceb85178","Type":"ContainerStarted","Data":"f4002e44ee2d25ebbfeaea11860a2d5227bf62bc461398d77b888f4367305ddb"} Jul 07 23:14:56.445677 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:56.445658 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cknll" event={"ID":"4e32f21f-f756-461f-8fd7-2dc3ac84a598","Type":"ContainerStarted","Data":"6cd464f5a6fac63debe9b1fa5078733cca9aadb4773c2f402f8279bb6ec91098"} Jul 07 23:14:56.446931 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:56.446910 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rksdr" event={"ID":"fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8","Type":"ContainerStarted","Data":"8432748781e0cd9a2ea767d2330f9a1c2958ca8aa6982f763713e7e573f625dd"} Jul 07 23:14:56.448148 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:56.448130 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b5df7959d-vxw5n" event={"ID":"8f0a96de-93ca-46f7-b977-cf324778db5f","Type":"ContainerStarted","Data":"4c040b7570cf314acd2e3a92ff00e76df9fff7b5dd12ac09c5f26cca4f9b3b56"} Jul 07 23:14:56.448246 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:56.448232 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b5df7959d-vxw5n" Jul 07 23:14:56.449880 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:56.449857 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rk84p" event={"ID":"896a6145-9c7e-4bb8-9e71-d35415f005dc","Type":"ContainerStarted","Data":"0694a25cc804e4f0639a82858799af26d6e86aea1d1309e5538413fc01e0d46a"} Jul 07 23:14:56.450355 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:56.450338 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b5df7959d-vxw5n" Jul 07 23:14:56.462286 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:56.462234 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-l8cls" podStartSLOduration=66.611117897 podStartE2EDuration="1m17.462217047s" totalImagesPullingTime="10.85109915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:14:56.46184998 +0000 UTC m=+77.871912232" watchObservedRunningTime="2026-07-07 23:14:56.462217047 +0000 UTC m=+77.872279289" Jul 07 23:14:56.478208 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:56.478159 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b5df7959d-vxw5n" podStartSLOduration=1.976412724 podStartE2EDuration="11.478144745s" totalImagesPullingTime="9.501732021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:14:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:14:56.477621302 +0000 UTC m=+77.887683581" watchObservedRunningTime="2026-07-07 23:14:56.478144745 +0000 UTC m=+77.888206981" Jul 07 23:14:56.499138 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:56.498802 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rksdr" podStartSLOduration=66.626631526 podStartE2EDuration="1m17.498769965s" totalImagesPullingTime="10.872138439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:14:56.494614392 +0000 UTC m=+77.904676643" watchObservedRunningTime="2026-07-07 23:14:56.498769965 +0000 UTC m=+77.908832394" Jul 07 23:14:56.515073 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:56.515016 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd9c5747d-22g9s" podStartSLOduration=2.047556462 podStartE2EDuration="11.514994056s" totalImagesPullingTime="9.467437594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:14:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:14:56.513939574 +0000 UTC m=+77.924001813" watchObservedRunningTime="2026-07-07 23:14:56.514994056 +0000 UTC m=+77.925056295" Jul 07 23:14:57.455700 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:57.455658 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rk84p" event={"ID":"896a6145-9c7e-4bb8-9e71-d35415f005dc","Type":"ContainerStarted","Data":"ad566a752047c281508347dbdc5dc849028a7f5febf4b0a1132b48ad99fedb31"} Jul 07 23:14:58.461690 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:58.461653 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cknll" event={"ID":"4e32f21f-f756-461f-8fd7-2dc3ac84a598","Type":"ContainerStarted","Data":"1ce72b2fd0d6da9a317229018707b187e064a3aa33a3870c1ffed8b9d3900a94"} Jul 07 23:14:58.462108 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:58.461719 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cknll" event={"ID":"4e32f21f-f756-461f-8fd7-2dc3ac84a598","Type":"ContainerStarted","Data":"74ba4281ea610613d8a4a678b98c9e77f39a427407df97cf52da080ae675a7bb"} Jul 07 23:14:58.482800 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:58.482749 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cknll" podStartSLOduration=7.072946633 podStartE2EDuration="8.482731447s" totalImagesPullingTime="1.409784814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:14:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:14:58.481975383 +0000 UTC m=+79.892037622" watchObservedRunningTime="2026-07-07 23:14:58.482731447 +0000 UTC m=+79.892793684" Jul 07 23:14:59.467492 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:14:59.467440 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rk84p" event={"ID":"896a6145-9c7e-4bb8-9e71-d35415f005dc","Type":"ContainerStarted","Data":"b35ce5e8c3dffdd0a9a80abe4faf9064fed34075d9c4a318035809d34803d6b9"} Jul 07 23:15:00.745539 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.745461 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rk84p" podStartSLOduration=35.215331533 podStartE2EDuration="47.745441497s" totalImagesPullingTime="12.530109964s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:14:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:14:59.500895941 +0000 UTC m=+80.910958179" watchObservedRunningTime="2026-07-07 23:15:00.745441497 +0000 UTC m=+82.155503734" Jul 07 23:15:00.746267 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.746252 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-q2t8j"] Jul 07 23:15:00.748680 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.748665 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q2t8j" Jul 07 23:15:00.751341 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.751309 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9nqnm\"" Jul 07 23:15:00.751562 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.751542 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 23:15:00.752370 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.752345 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 23:15:00.752437 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.752411 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 23:15:00.893318 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.893273 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9e24f5f5-188d-40af-9696-7779fbe6c9a1-node-exporter-accelerators-collector-config\") pod \"node-exporter-q2t8j\" (UID: \"9e24f5f5-188d-40af-9696-7779fbe6c9a1\") " pod="openshift-monitoring/node-exporter-q2t8j" Jul 07 23:15:00.893547 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.893322 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9e24f5f5-188d-40af-9696-7779fbe6c9a1-node-exporter-wtmp\") pod \"node-exporter-q2t8j\" (UID: \"9e24f5f5-188d-40af-9696-7779fbe6c9a1\") " pod="openshift-monitoring/node-exporter-q2t8j" Jul 07 23:15:00.893547 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.893411 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e24f5f5-188d-40af-9696-7779fbe6c9a1-sys\") pod \"node-exporter-q2t8j\" (UID: \"9e24f5f5-188d-40af-9696-7779fbe6c9a1\") " pod="openshift-monitoring/node-exporter-q2t8j" Jul 07 23:15:00.893547 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.893471 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9e24f5f5-188d-40af-9696-7779fbe6c9a1-node-exporter-textfile\") pod \"node-exporter-q2t8j\" (UID: \"9e24f5f5-188d-40af-9696-7779fbe6c9a1\") " pod="openshift-monitoring/node-exporter-q2t8j" Jul 07 23:15:00.893547 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.893525 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9e24f5f5-188d-40af-9696-7779fbe6c9a1-node-exporter-tls\") pod \"node-exporter-q2t8j\" (UID: \"9e24f5f5-188d-40af-9696-7779fbe6c9a1\") " pod="openshift-monitoring/node-exporter-q2t8j" Jul 07 23:15:00.893733 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.893556 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9e24f5f5-188d-40af-9696-7779fbe6c9a1-root\") pod \"node-exporter-q2t8j\" (UID: \"9e24f5f5-188d-40af-9696-7779fbe6c9a1\") " pod="openshift-monitoring/node-exporter-q2t8j" Jul 07 23:15:00.893733 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.893581 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e24f5f5-188d-40af-9696-7779fbe6c9a1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q2t8j\" (UID: \"9e24f5f5-188d-40af-9696-7779fbe6c9a1\") " pod="openshift-monitoring/node-exporter-q2t8j" Jul 07 23:15:00.893733 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.893609 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twm8l\" (UniqueName: \"kubernetes.io/projected/9e24f5f5-188d-40af-9696-7779fbe6c9a1-kube-api-access-twm8l\") pod \"node-exporter-q2t8j\" (UID: \"9e24f5f5-188d-40af-9696-7779fbe6c9a1\") " pod="openshift-monitoring/node-exporter-q2t8j" Jul 07 23:15:00.893733 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.893639 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e24f5f5-188d-40af-9696-7779fbe6c9a1-metrics-client-ca\") pod \"node-exporter-q2t8j\" (UID: \"9e24f5f5-188d-40af-9696-7779fbe6c9a1\") " pod="openshift-monitoring/node-exporter-q2t8j" Jul 07 23:15:00.994955 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.994913 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9e24f5f5-188d-40af-9696-7779fbe6c9a1-node-exporter-textfile\") pod \"node-exporter-q2t8j\" (UID: \"9e24f5f5-188d-40af-9696-7779fbe6c9a1\") " pod="openshift-monitoring/node-exporter-q2t8j" Jul 07 23:15:00.994955 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.994954 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9e24f5f5-188d-40af-9696-7779fbe6c9a1-node-exporter-tls\") pod \"node-exporter-q2t8j\" (UID: \"9e24f5f5-188d-40af-9696-7779fbe6c9a1\") " pod="openshift-monitoring/node-exporter-q2t8j" Jul 07 23:15:00.995207 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.994979 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9e24f5f5-188d-40af-9696-7779fbe6c9a1-root\") pod \"node-exporter-q2t8j\" (UID: \"9e24f5f5-188d-40af-9696-7779fbe6c9a1\") " pod="openshift-monitoring/node-exporter-q2t8j" Jul 07 23:15:00.995207 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.994995 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e24f5f5-188d-40af-9696-7779fbe6c9a1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q2t8j\" (UID: \"9e24f5f5-188d-40af-9696-7779fbe6c9a1\") " pod="openshift-monitoring/node-exporter-q2t8j" Jul 07 23:15:00.995207 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.995010 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twm8l\" (UniqueName: \"kubernetes.io/projected/9e24f5f5-188d-40af-9696-7779fbe6c9a1-kube-api-access-twm8l\") pod \"node-exporter-q2t8j\" (UID: \"9e24f5f5-188d-40af-9696-7779fbe6c9a1\") " pod="openshift-monitoring/node-exporter-q2t8j" Jul 07 23:15:00.995207 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.995039 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e24f5f5-188d-40af-9696-7779fbe6c9a1-metrics-client-ca\") pod \"node-exporter-q2t8j\" (UID: \"9e24f5f5-188d-40af-9696-7779fbe6c9a1\") " pod="openshift-monitoring/node-exporter-q2t8j" Jul 07 23:15:00.995207 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.995067 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9e24f5f5-188d-40af-9696-7779fbe6c9a1-node-exporter-accelerators-collector-config\") pod \"node-exporter-q2t8j\" (UID: \"9e24f5f5-188d-40af-9696-7779fbe6c9a1\") " pod="openshift-monitoring/node-exporter-q2t8j" Jul 07 23:15:00.995207 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.995070 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9e24f5f5-188d-40af-9696-7779fbe6c9a1-root\") pod \"node-exporter-q2t8j\" (UID: \"9e24f5f5-188d-40af-9696-7779fbe6c9a1\") " pod="openshift-monitoring/node-exporter-q2t8j" Jul 07 23:15:00.995207 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.995157 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9e24f5f5-188d-40af-9696-7779fbe6c9a1-node-exporter-wtmp\") pod \"node-exporter-q2t8j\" (UID: \"9e24f5f5-188d-40af-9696-7779fbe6c9a1\") " pod="openshift-monitoring/node-exporter-q2t8j" Jul 07 23:15:00.995591 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.995218 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e24f5f5-188d-40af-9696-7779fbe6c9a1-sys\") pod \"node-exporter-q2t8j\" (UID: \"9e24f5f5-188d-40af-9696-7779fbe6c9a1\") " pod="openshift-monitoring/node-exporter-q2t8j" Jul 07 23:15:00.995591 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.995315 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e24f5f5-188d-40af-9696-7779fbe6c9a1-sys\") pod \"node-exporter-q2t8j\" (UID: \"9e24f5f5-188d-40af-9696-7779fbe6c9a1\") " pod="openshift-monitoring/node-exporter-q2t8j" Jul 07 23:15:00.995591 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.995328 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9e24f5f5-188d-40af-9696-7779fbe6c9a1-node-exporter-textfile\") pod \"node-exporter-q2t8j\" (UID: \"9e24f5f5-188d-40af-9696-7779fbe6c9a1\") " pod="openshift-monitoring/node-exporter-q2t8j" Jul 07 23:15:00.995591 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.995429 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9e24f5f5-188d-40af-9696-7779fbe6c9a1-node-exporter-wtmp\") pod \"node-exporter-q2t8j\" (UID: \"9e24f5f5-188d-40af-9696-7779fbe6c9a1\") " pod="openshift-monitoring/node-exporter-q2t8j" Jul 07 23:15:00.995747 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.995677 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9e24f5f5-188d-40af-9696-7779fbe6c9a1-node-exporter-accelerators-collector-config\") pod \"node-exporter-q2t8j\" (UID: \"9e24f5f5-188d-40af-9696-7779fbe6c9a1\") " pod="openshift-monitoring/node-exporter-q2t8j" Jul 07 23:15:00.995747 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.995686 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e24f5f5-188d-40af-9696-7779fbe6c9a1-metrics-client-ca\") pod \"node-exporter-q2t8j\" (UID: \"9e24f5f5-188d-40af-9696-7779fbe6c9a1\") " pod="openshift-monitoring/node-exporter-q2t8j" Jul 07 23:15:00.997542 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.997519 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e24f5f5-188d-40af-9696-7779fbe6c9a1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q2t8j\" (UID: \"9e24f5f5-188d-40af-9696-7779fbe6c9a1\") " pod="openshift-monitoring/node-exporter-q2t8j" Jul 07 23:15:00.997668 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:00.997620 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9e24f5f5-188d-40af-9696-7779fbe6c9a1-node-exporter-tls\") pod \"node-exporter-q2t8j\" (UID: \"9e24f5f5-188d-40af-9696-7779fbe6c9a1\") " pod="openshift-monitoring/node-exporter-q2t8j" Jul 07 23:15:01.003974 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:01.003954 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twm8l\" (UniqueName: \"kubernetes.io/projected/9e24f5f5-188d-40af-9696-7779fbe6c9a1-kube-api-access-twm8l\") pod \"node-exporter-q2t8j\" (UID: \"9e24f5f5-188d-40af-9696-7779fbe6c9a1\") " pod="openshift-monitoring/node-exporter-q2t8j" Jul 07 23:15:01.058218 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:01.058178 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q2t8j" Jul 07 23:15:01.068714 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:15:01.068689 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e24f5f5_188d_40af_9696_7779fbe6c9a1.slice/crio-da97b01d32a310cce3bd4c2af9a68eb26c9601fc34bf465db875bb4a580e5707 WatchSource:0}: Error finding container da97b01d32a310cce3bd4c2af9a68eb26c9601fc34bf465db875bb4a580e5707: Status 404 returned error can't find the container with id da97b01d32a310cce3bd4c2af9a68eb26c9601fc34bf465db875bb4a580e5707 Jul 07 23:15:01.475092 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:01.475057 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q2t8j" event={"ID":"9e24f5f5-188d-40af-9696-7779fbe6c9a1","Type":"ContainerStarted","Data":"da97b01d32a310cce3bd4c2af9a68eb26c9601fc34bf465db875bb4a580e5707"} Jul 07 23:15:02.480926 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:02.480884 2564 generic.go:356] "Generic (PLEG): container finished" podID="9e24f5f5-188d-40af-9696-7779fbe6c9a1" containerID="7e554a3f3ea62056dd8e475616f34cb57dee931d3c2dd86b4a9d1f20aa2ed8e7" exitCode=0 Jul 07 23:15:02.481394 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:02.480973 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q2t8j" event={"ID":"9e24f5f5-188d-40af-9696-7779fbe6c9a1","Type":"ContainerDied","Data":"7e554a3f3ea62056dd8e475616f34cb57dee931d3c2dd86b4a9d1f20aa2ed8e7"} Jul 07 23:15:03.487262 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:03.487225 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q2t8j" event={"ID":"9e24f5f5-188d-40af-9696-7779fbe6c9a1","Type":"ContainerStarted","Data":"605ac5de1684406c03549c132cdf0fa483fcdff7b4bcf00df4f337eefad48812"} Jul 07 23:15:03.487688 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:03.487279 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q2t8j" event={"ID":"9e24f5f5-188d-40af-9696-7779fbe6c9a1","Type":"ContainerStarted","Data":"857044c9745f5911f13ce0eb75062d541c69d35301c091f263949c367561912b"} Jul 07 23:15:03.766239 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:03.766120 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-q2t8j" podStartSLOduration=2.502840042 podStartE2EDuration="3.766095943s" totalImagesPullingTime="1.18997382s" totalInitContainerRuntime="73.282081ms" isStatefulPod=true podCreationTimestamp="2026-07-07 23:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:15:03.512935033 +0000 UTC m=+84.922997272" watchObservedRunningTime="2026-07-07 23:15:03.766095943 +0000 UTC m=+85.176158181" Jul 07 23:15:03.767059 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:03.767034 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-8f5d7964f-kzf7g"] Jul 07 23:15:03.769888 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:03.769873 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" Jul 07 23:15:03.773115 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:03.773093 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 07 23:15:03.773225 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:03.773147 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 07 23:15:03.773561 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:03.773537 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 07 23:15:03.773662 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:03.773636 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4rrvh\"" Jul 07 23:15:03.773779 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:03.773756 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 07 23:15:03.773850 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:03.773783 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-nds4c9nhb8j9\"" Jul 07 23:15:03.774502 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:03.774459 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 07 23:15:03.791548 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:03.791520 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8f5d7964f-kzf7g"] Jul 07 23:15:03.916679 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:03.916638 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/59c2d43c-d5cd-4095-aee9-01dd91973f0c-secret-thanos-querier-tls\") pod \"thanos-querier-8f5d7964f-kzf7g\" (UID: \"59c2d43c-d5cd-4095-aee9-01dd91973f0c\") " pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" Jul 07 23:15:03.916679 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:03.916677 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59c2d43c-d5cd-4095-aee9-01dd91973f0c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8f5d7964f-kzf7g\" (UID: \"59c2d43c-d5cd-4095-aee9-01dd91973f0c\") " pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" Jul 07 23:15:03.916946 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:03.916703 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/59c2d43c-d5cd-4095-aee9-01dd91973f0c-secret-grpc-tls\") pod \"thanos-querier-8f5d7964f-kzf7g\" (UID: \"59c2d43c-d5cd-4095-aee9-01dd91973f0c\") " pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" Jul 07 23:15:03.916946 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:03.916808 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59c2d43c-d5cd-4095-aee9-01dd91973f0c-metrics-client-ca\") pod \"thanos-querier-8f5d7964f-kzf7g\" (UID: \"59c2d43c-d5cd-4095-aee9-01dd91973f0c\") " pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" Jul 07 23:15:03.916946 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:03.916857 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/59c2d43c-d5cd-4095-aee9-01dd91973f0c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8f5d7964f-kzf7g\" (UID: \"59c2d43c-d5cd-4095-aee9-01dd91973f0c\") " pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" Jul 07 23:15:03.916946 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:03.916886 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59c2d43c-d5cd-4095-aee9-01dd91973f0c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8f5d7964f-kzf7g\" (UID: \"59c2d43c-d5cd-4095-aee9-01dd91973f0c\") " pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" Jul 07 23:15:03.916946 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:03.916923 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cdbp\" (UniqueName: \"kubernetes.io/projected/59c2d43c-d5cd-4095-aee9-01dd91973f0c-kube-api-access-8cdbp\") pod \"thanos-querier-8f5d7964f-kzf7g\" (UID: \"59c2d43c-d5cd-4095-aee9-01dd91973f0c\") " pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" Jul 07 23:15:03.917134 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:03.916958 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/59c2d43c-d5cd-4095-aee9-01dd91973f0c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8f5d7964f-kzf7g\" (UID: \"59c2d43c-d5cd-4095-aee9-01dd91973f0c\") " pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" Jul 07 23:15:03.920977 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:03.920907 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-wvhgt"] Jul 07 23:15:03.922967 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:03.922950 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-wvhgt" Jul 07 23:15:03.926924 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:15:03.926893 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-dockercfg-zp2xn\" is forbidden: User \"system:node:ip-10-0-143-195.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-143-195.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"default-dockercfg-zp2xn\"" type="*v1.Secret" Jul 07 23:15:03.926924 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:15:03.926893 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-143-195.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-143-195.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jul 07 23:15:03.927088 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:15:03.926893 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-143-195.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-143-195.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jul 07 23:15:03.927088 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:15:03.926965 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"downloads-685bfb5f64-wvhgt\" is forbidden: User \"system:node:ip-10-0-143-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-143-195.ec2.internal' and this object" podUID="9f8d8912-c527-402a-b669-984a4335f0fe" pod="openshift-console/downloads-685bfb5f64-wvhgt" Jul 07 23:15:03.941169 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:03.941133 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-wvhgt"] Jul 07 23:15:04.018010 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:04.017911 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59c2d43c-d5cd-4095-aee9-01dd91973f0c-metrics-client-ca\") pod \"thanos-querier-8f5d7964f-kzf7g\" (UID: \"59c2d43c-d5cd-4095-aee9-01dd91973f0c\") " pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" Jul 07 23:15:04.018010 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:04.017965 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/59c2d43c-d5cd-4095-aee9-01dd91973f0c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8f5d7964f-kzf7g\" (UID: \"59c2d43c-d5cd-4095-aee9-01dd91973f0c\") " pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" Jul 07 23:15:04.018010 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:04.017992 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59c2d43c-d5cd-4095-aee9-01dd91973f0c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8f5d7964f-kzf7g\" (UID: \"59c2d43c-d5cd-4095-aee9-01dd91973f0c\") " pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" Jul 07 23:15:04.018299 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:04.018028 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjf8n\" (UniqueName: \"kubernetes.io/projected/9f8d8912-c527-402a-b669-984a4335f0fe-kube-api-access-gjf8n\") pod \"downloads-685bfb5f64-wvhgt\" (UID: \"9f8d8912-c527-402a-b669-984a4335f0fe\") " pod="openshift-console/downloads-685bfb5f64-wvhgt" Jul 07 23:15:04.018299 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:04.018053 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cdbp\" (UniqueName: \"kubernetes.io/projected/59c2d43c-d5cd-4095-aee9-01dd91973f0c-kube-api-access-8cdbp\") pod \"thanos-querier-8f5d7964f-kzf7g\" (UID: \"59c2d43c-d5cd-4095-aee9-01dd91973f0c\") " pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" Jul 07 23:15:04.018299 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:04.018129 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/59c2d43c-d5cd-4095-aee9-01dd91973f0c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8f5d7964f-kzf7g\" (UID: \"59c2d43c-d5cd-4095-aee9-01dd91973f0c\") " pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" Jul 07 23:15:04.018299 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:04.018201 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/59c2d43c-d5cd-4095-aee9-01dd91973f0c-secret-thanos-querier-tls\") pod \"thanos-querier-8f5d7964f-kzf7g\" (UID: \"59c2d43c-d5cd-4095-aee9-01dd91973f0c\") " pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" Jul 07 23:15:04.018299 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:04.018228 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59c2d43c-d5cd-4095-aee9-01dd91973f0c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8f5d7964f-kzf7g\" (UID: \"59c2d43c-d5cd-4095-aee9-01dd91973f0c\") " pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" Jul 07 23:15:04.018299 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:04.018269 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/59c2d43c-d5cd-4095-aee9-01dd91973f0c-secret-grpc-tls\") pod \"thanos-querier-8f5d7964f-kzf7g\" (UID: \"59c2d43c-d5cd-4095-aee9-01dd91973f0c\") " pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" Jul 07 23:15:04.018808 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:04.018785 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59c2d43c-d5cd-4095-aee9-01dd91973f0c-metrics-client-ca\") pod \"thanos-querier-8f5d7964f-kzf7g\" (UID: \"59c2d43c-d5cd-4095-aee9-01dd91973f0c\") " pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" Jul 07 23:15:04.021296 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:04.021219 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/59c2d43c-d5cd-4095-aee9-01dd91973f0c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8f5d7964f-kzf7g\" (UID: \"59c2d43c-d5cd-4095-aee9-01dd91973f0c\") " pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" Jul 07 23:15:04.021296 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:04.021240 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59c2d43c-d5cd-4095-aee9-01dd91973f0c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8f5d7964f-kzf7g\" (UID: \"59c2d43c-d5cd-4095-aee9-01dd91973f0c\") " pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" Jul 07 23:15:04.021459 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:04.021377 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/59c2d43c-d5cd-4095-aee9-01dd91973f0c-secret-grpc-tls\") pod \"thanos-querier-8f5d7964f-kzf7g\" (UID: \"59c2d43c-d5cd-4095-aee9-01dd91973f0c\") " pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" Jul 07 23:15:04.021459 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:04.021443 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59c2d43c-d5cd-4095-aee9-01dd91973f0c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8f5d7964f-kzf7g\" (UID: \"59c2d43c-d5cd-4095-aee9-01dd91973f0c\") " pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" Jul 07 23:15:04.021594 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:04.021541 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/59c2d43c-d5cd-4095-aee9-01dd91973f0c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8f5d7964f-kzf7g\" (UID: \"59c2d43c-d5cd-4095-aee9-01dd91973f0c\") " pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" Jul 07 23:15:04.022077 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:04.022060 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/59c2d43c-d5cd-4095-aee9-01dd91973f0c-secret-thanos-querier-tls\") pod \"thanos-querier-8f5d7964f-kzf7g\" (UID: \"59c2d43c-d5cd-4095-aee9-01dd91973f0c\") " pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" Jul 07 23:15:04.031385 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:04.031359 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cdbp\" (UniqueName: \"kubernetes.io/projected/59c2d43c-d5cd-4095-aee9-01dd91973f0c-kube-api-access-8cdbp\") pod \"thanos-querier-8f5d7964f-kzf7g\" (UID: \"59c2d43c-d5cd-4095-aee9-01dd91973f0c\") " pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" Jul 07 23:15:04.078750 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:04.078707 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" Jul 07 23:15:04.119225 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:04.119185 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjf8n\" (UniqueName: \"kubernetes.io/projected/9f8d8912-c527-402a-b669-984a4335f0fe-kube-api-access-gjf8n\") pod \"downloads-685bfb5f64-wvhgt\" (UID: \"9f8d8912-c527-402a-b669-984a4335f0fe\") " pod="openshift-console/downloads-685bfb5f64-wvhgt" Jul 07 23:15:04.221667 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:04.221640 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8f5d7964f-kzf7g"] Jul 07 23:15:04.223044 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:15:04.223019 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59c2d43c_d5cd_4095_aee9_01dd91973f0c.slice/crio-f9db02aacdcc70c165510691cfd13751cd9f6f6fd56ec34941c31e37af297b3e WatchSource:0}: Error finding container f9db02aacdcc70c165510691cfd13751cd9f6f6fd56ec34941c31e37af297b3e: Status 404 returned error can't find the container with id f9db02aacdcc70c165510691cfd13751cd9f6f6fd56ec34941c31e37af297b3e Jul 07 23:15:04.492237 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:04.492194 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" event={"ID":"59c2d43c-d5cd-4095-aee9-01dd91973f0c","Type":"ContainerStarted","Data":"f9db02aacdcc70c165510691cfd13751cd9f6f6fd56ec34941c31e37af297b3e"} Jul 07 23:15:05.050653 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.050616 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-fcfd9d454-fnqgp"] Jul 07 23:15:05.052894 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.052871 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-fcfd9d454-fnqgp" Jul 07 23:15:05.056889 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.056858 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 07 23:15:05.056889 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.056859 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 07 23:15:05.057076 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.056953 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-8rfmj\"" Jul 07 23:15:05.057076 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.057031 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 07 23:15:05.057185 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.057115 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-98c8q5kmnhv7t\"" Jul 07 23:15:05.057297 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.057282 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 07 23:15:05.065055 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.065030 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-fcfd9d454-fnqgp"] Jul 07 23:15:05.071643 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.071617 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-zp2xn\"" Jul 07 23:15:05.104304 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.104181 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 23:15:05.125796 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.125759 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4d261ede-e316-419e-9aa6-e1e0c1f944a6-secret-metrics-server-tls\") pod \"metrics-server-fcfd9d454-fnqgp\" (UID: \"4d261ede-e316-419e-9aa6-e1e0c1f944a6\") " pod="openshift-monitoring/metrics-server-fcfd9d454-fnqgp" Jul 07 23:15:05.125972 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.125810 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4d261ede-e316-419e-9aa6-e1e0c1f944a6-metrics-server-audit-profiles\") pod \"metrics-server-fcfd9d454-fnqgp\" (UID: \"4d261ede-e316-419e-9aa6-e1e0c1f944a6\") " pod="openshift-monitoring/metrics-server-fcfd9d454-fnqgp" Jul 07 23:15:05.125972 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.125858 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj9wg\" (UniqueName: \"kubernetes.io/projected/4d261ede-e316-419e-9aa6-e1e0c1f944a6-kube-api-access-nj9wg\") pod \"metrics-server-fcfd9d454-fnqgp\" (UID: \"4d261ede-e316-419e-9aa6-e1e0c1f944a6\") " pod="openshift-monitoring/metrics-server-fcfd9d454-fnqgp" Jul 07 23:15:05.125972 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.125888 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4d261ede-e316-419e-9aa6-e1e0c1f944a6-audit-log\") pod \"metrics-server-fcfd9d454-fnqgp\" (UID: \"4d261ede-e316-419e-9aa6-e1e0c1f944a6\") " pod="openshift-monitoring/metrics-server-fcfd9d454-fnqgp" Jul 07 23:15:05.125972 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.125915 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4d261ede-e316-419e-9aa6-e1e0c1f944a6-secret-metrics-server-client-certs\") pod \"metrics-server-fcfd9d454-fnqgp\" (UID: \"4d261ede-e316-419e-9aa6-e1e0c1f944a6\") " pod="openshift-monitoring/metrics-server-fcfd9d454-fnqgp" Jul 07 23:15:05.125972 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.125939 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d261ede-e316-419e-9aa6-e1e0c1f944a6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-fcfd9d454-fnqgp\" (UID: \"4d261ede-e316-419e-9aa6-e1e0c1f944a6\") " pod="openshift-monitoring/metrics-server-fcfd9d454-fnqgp" Jul 07 23:15:05.126275 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.126064 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d261ede-e316-419e-9aa6-e1e0c1f944a6-client-ca-bundle\") pod \"metrics-server-fcfd9d454-fnqgp\" (UID: \"4d261ede-e316-419e-9aa6-e1e0c1f944a6\") " pod="openshift-monitoring/metrics-server-fcfd9d454-fnqgp" Jul 07 23:15:05.128659 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:15:05.128637 2564 projected.go:291] Couldn't get configMap openshift-console/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jul 07 23:15:05.128760 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:15:05.128676 2564 projected.go:196] Error preparing data for projected volume kube-api-access-gjf8n for pod openshift-console/downloads-685bfb5f64-wvhgt: failed to sync configmap cache: timed out waiting for the condition Jul 07 23:15:05.128760 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:15:05.128746 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f8d8912-c527-402a-b669-984a4335f0fe-kube-api-access-gjf8n podName:9f8d8912-c527-402a-b669-984a4335f0fe nodeName:}" failed. No retries permitted until 2026-07-07 23:15:05.628724907 +0000 UTC m=+87.038787136 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gjf8n" (UniqueName: "kubernetes.io/projected/9f8d8912-c527-402a-b669-984a4335f0fe-kube-api-access-gjf8n") pod "downloads-685bfb5f64-wvhgt" (UID: "9f8d8912-c527-402a-b669-984a4335f0fe") : failed to sync configmap cache: timed out waiting for the condition Jul 07 23:15:05.226911 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.226867 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d261ede-e316-419e-9aa6-e1e0c1f944a6-client-ca-bundle\") pod \"metrics-server-fcfd9d454-fnqgp\" (UID: \"4d261ede-e316-419e-9aa6-e1e0c1f944a6\") " pod="openshift-monitoring/metrics-server-fcfd9d454-fnqgp" Jul 07 23:15:05.227084 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.226925 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4d261ede-e316-419e-9aa6-e1e0c1f944a6-secret-metrics-server-tls\") pod \"metrics-server-fcfd9d454-fnqgp\" (UID: \"4d261ede-e316-419e-9aa6-e1e0c1f944a6\") " pod="openshift-monitoring/metrics-server-fcfd9d454-fnqgp" Jul 07 23:15:05.227161 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.227126 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4d261ede-e316-419e-9aa6-e1e0c1f944a6-metrics-server-audit-profiles\") pod \"metrics-server-fcfd9d454-fnqgp\" (UID: \"4d261ede-e316-419e-9aa6-e1e0c1f944a6\") " pod="openshift-monitoring/metrics-server-fcfd9d454-fnqgp" Jul 07 23:15:05.227218 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.227186 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj9wg\" (UniqueName: \"kubernetes.io/projected/4d261ede-e316-419e-9aa6-e1e0c1f944a6-kube-api-access-nj9wg\") pod \"metrics-server-fcfd9d454-fnqgp\" (UID: \"4d261ede-e316-419e-9aa6-e1e0c1f944a6\") " pod="openshift-monitoring/metrics-server-fcfd9d454-fnqgp" Jul 07 23:15:05.227269 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.227216 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4d261ede-e316-419e-9aa6-e1e0c1f944a6-audit-log\") pod \"metrics-server-fcfd9d454-fnqgp\" (UID: \"4d261ede-e316-419e-9aa6-e1e0c1f944a6\") " pod="openshift-monitoring/metrics-server-fcfd9d454-fnqgp" Jul 07 23:15:05.227269 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.227246 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4d261ede-e316-419e-9aa6-e1e0c1f944a6-secret-metrics-server-client-certs\") pod \"metrics-server-fcfd9d454-fnqgp\" (UID: \"4d261ede-e316-419e-9aa6-e1e0c1f944a6\") " pod="openshift-monitoring/metrics-server-fcfd9d454-fnqgp" Jul 07 23:15:05.227365 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.227268 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d261ede-e316-419e-9aa6-e1e0c1f944a6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-fcfd9d454-fnqgp\" (UID: \"4d261ede-e316-419e-9aa6-e1e0c1f944a6\") " pod="openshift-monitoring/metrics-server-fcfd9d454-fnqgp" Jul 07 23:15:05.227649 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.227620 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4d261ede-e316-419e-9aa6-e1e0c1f944a6-audit-log\") pod \"metrics-server-fcfd9d454-fnqgp\" (UID: \"4d261ede-e316-419e-9aa6-e1e0c1f944a6\") " pod="openshift-monitoring/metrics-server-fcfd9d454-fnqgp" Jul 07 23:15:05.228037 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.228010 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d261ede-e316-419e-9aa6-e1e0c1f944a6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-fcfd9d454-fnqgp\" (UID: \"4d261ede-e316-419e-9aa6-e1e0c1f944a6\") " pod="openshift-monitoring/metrics-server-fcfd9d454-fnqgp" Jul 07 23:15:05.228151 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.228076 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4d261ede-e316-419e-9aa6-e1e0c1f944a6-metrics-server-audit-profiles\") pod \"metrics-server-fcfd9d454-fnqgp\" (UID: \"4d261ede-e316-419e-9aa6-e1e0c1f944a6\") " pod="openshift-monitoring/metrics-server-fcfd9d454-fnqgp" Jul 07 23:15:05.229700 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.229679 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4d261ede-e316-419e-9aa6-e1e0c1f944a6-secret-metrics-server-tls\") pod \"metrics-server-fcfd9d454-fnqgp\" (UID: \"4d261ede-e316-419e-9aa6-e1e0c1f944a6\") " pod="openshift-monitoring/metrics-server-fcfd9d454-fnqgp" Jul 07 23:15:05.229954 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.229914 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d261ede-e316-419e-9aa6-e1e0c1f944a6-client-ca-bundle\") pod \"metrics-server-fcfd9d454-fnqgp\" (UID: \"4d261ede-e316-419e-9aa6-e1e0c1f944a6\") " pod="openshift-monitoring/metrics-server-fcfd9d454-fnqgp" Jul 07 23:15:05.230498 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.230451 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4d261ede-e316-419e-9aa6-e1e0c1f944a6-secret-metrics-server-client-certs\") pod \"metrics-server-fcfd9d454-fnqgp\" (UID: \"4d261ede-e316-419e-9aa6-e1e0c1f944a6\") " pod="openshift-monitoring/metrics-server-fcfd9d454-fnqgp" Jul 07 23:15:05.238045 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.238017 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj9wg\" (UniqueName: \"kubernetes.io/projected/4d261ede-e316-419e-9aa6-e1e0c1f944a6-kube-api-access-nj9wg\") pod \"metrics-server-fcfd9d454-fnqgp\" (UID: \"4d261ede-e316-419e-9aa6-e1e0c1f944a6\") " pod="openshift-monitoring/metrics-server-fcfd9d454-fnqgp" Jul 07 23:15:05.320649 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.320562 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 23:15:05.362416 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.362383 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-fcfd9d454-fnqgp" Jul 07 23:15:05.458784 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.458750 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-5kdc2"] Jul 07 23:15:05.464212 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.463365 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5kdc2" Jul 07 23:15:05.466999 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.466975 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 07 23:15:05.467790 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.467049 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-mkcnx\"" Jul 07 23:15:05.473969 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.473940 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-5kdc2"] Jul 07 23:15:05.530844 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.530808 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dc85054e-a314-4443-bc6b-3abaf4c8ea9a-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-5kdc2\" (UID: \"dc85054e-a314-4443-bc6b-3abaf4c8ea9a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5kdc2" Jul 07 23:15:05.531366 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.530912 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v99fq\" (UniqueName: \"kubernetes.io/projected/dc85054e-a314-4443-bc6b-3abaf4c8ea9a-kube-api-access-v99fq\") pod \"monitoring-plugin-d5dcff7cf-5kdc2\" (UID: \"dc85054e-a314-4443-bc6b-3abaf4c8ea9a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5kdc2" Jul 07 23:15:05.531366 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.531208 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-fcfd9d454-fnqgp"] Jul 07 23:15:05.534794 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:15:05.534764 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d261ede_e316_419e_9aa6_e1e0c1f944a6.slice/crio-f86521d2ed150f8eaef31aaa886d737db777a0845b14b9db1b7201040cf878ab WatchSource:0}: Error finding container f86521d2ed150f8eaef31aaa886d737db777a0845b14b9db1b7201040cf878ab: Status 404 returned error can't find the container with id f86521d2ed150f8eaef31aaa886d737db777a0845b14b9db1b7201040cf878ab Jul 07 23:15:05.632382 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.632283 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dc85054e-a314-4443-bc6b-3abaf4c8ea9a-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-5kdc2\" (UID: \"dc85054e-a314-4443-bc6b-3abaf4c8ea9a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5kdc2" Jul 07 23:15:05.632382 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.632337 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v99fq\" (UniqueName: \"kubernetes.io/projected/dc85054e-a314-4443-bc6b-3abaf4c8ea9a-kube-api-access-v99fq\") pod \"monitoring-plugin-d5dcff7cf-5kdc2\" (UID: \"dc85054e-a314-4443-bc6b-3abaf4c8ea9a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5kdc2" Jul 07 23:15:05.632613 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.632401 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjf8n\" (UniqueName: \"kubernetes.io/projected/9f8d8912-c527-402a-b669-984a4335f0fe-kube-api-access-gjf8n\") pod \"downloads-685bfb5f64-wvhgt\" (UID: \"9f8d8912-c527-402a-b669-984a4335f0fe\") " pod="openshift-console/downloads-685bfb5f64-wvhgt" Jul 07 23:15:05.635623 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.635590 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dc85054e-a314-4443-bc6b-3abaf4c8ea9a-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-5kdc2\" (UID: \"dc85054e-a314-4443-bc6b-3abaf4c8ea9a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5kdc2" Jul 07 23:15:05.635623 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.635613 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjf8n\" (UniqueName: \"kubernetes.io/projected/9f8d8912-c527-402a-b669-984a4335f0fe-kube-api-access-gjf8n\") pod \"downloads-685bfb5f64-wvhgt\" (UID: \"9f8d8912-c527-402a-b669-984a4335f0fe\") " pod="openshift-console/downloads-685bfb5f64-wvhgt" Jul 07 23:15:05.642245 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.642216 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v99fq\" (UniqueName: \"kubernetes.io/projected/dc85054e-a314-4443-bc6b-3abaf4c8ea9a-kube-api-access-v99fq\") pod \"monitoring-plugin-d5dcff7cf-5kdc2\" (UID: \"dc85054e-a314-4443-bc6b-3abaf4c8ea9a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5kdc2" Jul 07 23:15:05.731147 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.731102 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-wvhgt" Jul 07 23:15:05.777395 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:05.777357 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5kdc2" Jul 07 23:15:06.196022 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:06.195986 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-5kdc2"] Jul 07 23:15:06.200668 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:15:06.200633 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc85054e_a314_4443_bc6b_3abaf4c8ea9a.slice/crio-5636d0af6838d7e770861dde3e83118522c9704944ca1a8dd73ba1d7bad461bb WatchSource:0}: Error finding container 5636d0af6838d7e770861dde3e83118522c9704944ca1a8dd73ba1d7bad461bb: Status 404 returned error can't find the container with id 5636d0af6838d7e770861dde3e83118522c9704944ca1a8dd73ba1d7bad461bb Jul 07 23:15:06.226763 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:06.226638 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-wvhgt"] Jul 07 23:15:06.229741 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:15:06.229706 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f8d8912_c527_402a_b669_984a4335f0fe.slice/crio-2d268f357b974aedbce964db3c3d7bd0d103cd6ad6c76d9daf47f886d283b14e WatchSource:0}: Error finding container 2d268f357b974aedbce964db3c3d7bd0d103cd6ad6c76d9daf47f886d283b14e: Status 404 returned error can't find the container with id 2d268f357b974aedbce964db3c3d7bd0d103cd6ad6c76d9daf47f886d283b14e Jul 07 23:15:06.504757 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:06.504720 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" event={"ID":"59c2d43c-d5cd-4095-aee9-01dd91973f0c","Type":"ContainerStarted","Data":"48f4250abc6400d73a10d6d1915e7d1a0b131a0dbd2d3e39f1aee5ef4c8169c5"} Jul 07 23:15:06.504953 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:06.504806 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" event={"ID":"59c2d43c-d5cd-4095-aee9-01dd91973f0c","Type":"ContainerStarted","Data":"23df7805507de80d71fa5de086e4eadb310309cd7e6f806a27b895e9ffb4b28f"} Jul 07 23:15:06.504953 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:06.504843 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" event={"ID":"59c2d43c-d5cd-4095-aee9-01dd91973f0c","Type":"ContainerStarted","Data":"c8b47e0c66b8c49d238522f3d2950ac077f408c139241abfdda35f5016829a3f"} Jul 07 23:15:06.505953 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:06.505918 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5kdc2" event={"ID":"dc85054e-a314-4443-bc6b-3abaf4c8ea9a","Type":"ContainerStarted","Data":"5636d0af6838d7e770861dde3e83118522c9704944ca1a8dd73ba1d7bad461bb"} Jul 07 23:15:06.507057 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:06.507028 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-wvhgt" event={"ID":"9f8d8912-c527-402a-b669-984a4335f0fe","Type":"ContainerStarted","Data":"2d268f357b974aedbce964db3c3d7bd0d103cd6ad6c76d9daf47f886d283b14e"} Jul 07 23:15:06.508165 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:06.508141 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-fcfd9d454-fnqgp" event={"ID":"4d261ede-e316-419e-9aa6-e1e0c1f944a6","Type":"ContainerStarted","Data":"f86521d2ed150f8eaef31aaa886d737db777a0845b14b9db1b7201040cf878ab"} Jul 07 23:15:06.952161 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:06.952082 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 23:15:06.957376 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:06.957353 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:06.960815 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:06.960791 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 07 23:15:06.960815 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:06.960808 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 07 23:15:06.961380 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:06.960854 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 07 23:15:06.961380 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:06.960977 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 07 23:15:06.961380 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:06.961073 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 07 23:15:06.961380 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:06.961193 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 07 23:15:06.961380 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:06.961271 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 07 23:15:06.962231 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:06.962202 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 07 23:15:06.962409 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:06.962259 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 07 23:15:06.962409 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:06.962210 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vf4tf\"" Jul 07 23:15:06.962537 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:06.962429 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 07 23:15:06.963320 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:06.963127 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 07 23:15:06.964778 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:06.964759 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6ia93qfj4tqrp\"" Jul 07 23:15:06.965269 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:06.964965 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 07 23:15:06.965375 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:06.965306 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 07 23:15:06.970985 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:06.970964 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 23:15:06.978752 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:06.978724 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 07 23:15:07.051189 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.051030 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-config\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.051189 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.051082 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.051189 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.051121 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.051189 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.051148 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.051474 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.051226 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.051474 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.051279 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-web-config\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.051474 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.051308 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.051474 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.051324 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.051474 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.051341 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.051474 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.051366 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.051474 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.051454 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.051795 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.051553 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.051795 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.051585 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.051795 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.051607 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-config-out\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.051795 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.051633 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.051795 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.051720 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd95h\" (UniqueName: \"kubernetes.io/projected/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-kube-api-access-fd95h\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.051795 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.051755 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.052007 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.051811 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.052007 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.051877 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.052007 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.051903 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.153074 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.153038 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd95h\" (UniqueName: \"kubernetes.io/projected/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-kube-api-access-fd95h\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.153074 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.153077 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.153325 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.153110 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.153325 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.153136 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.153325 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.153156 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.153325 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.153172 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-config\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.153325 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.153192 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.153325 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.153219 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.153325 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.153251 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.153325 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.153282 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.153325 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.153309 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-web-config\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.153810 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.153336 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.153810 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.153360 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.153810 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.153375 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.153810 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.153393 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.153810 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.153411 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.153810 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.153441 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.153810 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.153456 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.153810 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.153471 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-config-out\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.153810 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.153510 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.154405 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.154374 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.154590 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.154569 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.154590 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.154580 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.154777 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.154752 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.155656 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.155629 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.156831 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.156284 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.159699 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.156944 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.159699 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.157992 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.160422 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.160397 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.161261 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.161173 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-web-config\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.161894 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.161862 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.162618 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.162188 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.162618 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.162365 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.162618 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.162441 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.162618 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.162469 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.162618 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.162575 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-config\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.163969 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.163631 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.163969 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.163913 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.164518 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.164496 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-config-out\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.164685 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.164667 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd95h\" (UniqueName: \"kubernetes.io/projected/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-kube-api-access-fd95h\") pod \"prometheus-k8s-0\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.273225 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.273178 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:07.517949 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.517805 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" event={"ID":"59c2d43c-d5cd-4095-aee9-01dd91973f0c","Type":"ContainerStarted","Data":"86b52af7ca40f5968a0a6cbea7ade982ecdbf7af6475a2731bd86713ad0dd377"} Jul 07 23:15:07.523506 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.522743 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-fcfd9d454-fnqgp" event={"ID":"4d261ede-e316-419e-9aa6-e1e0c1f944a6","Type":"ContainerStarted","Data":"6664a7800424c6d34debd3c94e6e57d304d4f289d04e74eeae2ebfc931d2419e"} Jul 07 23:15:07.536524 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.536493 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 23:15:07.538769 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:15:07.538733 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bca2f93_da1d_437d_a180_c0d65d8c4ed7.slice/crio-d84300e36d412b25318159f0dd6e15e957ec692f2355da7383fc62e014338edc WatchSource:0}: Error finding container d84300e36d412b25318159f0dd6e15e957ec692f2355da7383fc62e014338edc: Status 404 returned error can't find the container with id d84300e36d412b25318159f0dd6e15e957ec692f2355da7383fc62e014338edc Jul 07 23:15:07.546646 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:07.546586 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-fcfd9d454-fnqgp" podStartSLOduration=0.753143629 podStartE2EDuration="2.54656527s" totalImagesPullingTime="1.793421641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:15:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:15:07.544857258 +0000 UTC m=+88.954919498" watchObservedRunningTime="2026-07-07 23:15:07.54656527 +0000 UTC m=+88.956627508" Jul 07 23:15:08.531688 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:08.531652 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" event={"ID":"59c2d43c-d5cd-4095-aee9-01dd91973f0c","Type":"ContainerStarted","Data":"934cc56a2d2e025c98e62b3019aa5241ea958e5c5d0f9451569d9c5bfc1bb24b"} Jul 07 23:15:08.532126 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:08.531725 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" event={"ID":"59c2d43c-d5cd-4095-aee9-01dd91973f0c","Type":"ContainerStarted","Data":"e76f870e9b60533443a3ca4bae431fa6e523a54cdc1a2f4cd0d6ef221ee66c50"} Jul 07 23:15:08.532126 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:08.531801 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" Jul 07 23:15:08.533031 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:08.533008 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bca2f93-da1d-437d-a180-c0d65d8c4ed7","Type":"ContainerStarted","Data":"d84300e36d412b25318159f0dd6e15e957ec692f2355da7383fc62e014338edc"} Jul 07 23:15:08.564016 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:08.563963 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" podStartSLOduration=2.6741139130000002 podStartE2EDuration="5.563940765s" totalImagesPullingTime="2.889826852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:15:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:15:08.561320487 +0000 UTC m=+89.971382725" watchObservedRunningTime="2026-07-07 23:15:08.563940765 +0000 UTC m=+89.974003002" Jul 07 23:15:09.421515 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:09.421448 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68cf46c6d4-xqn8z" Jul 07 23:15:09.539697 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:09.539663 2564 generic.go:356] "Generic (PLEG): container finished" podID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerID="71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350" exitCode=0 Jul 07 23:15:09.540126 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:09.539760 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bca2f93-da1d-437d-a180-c0d65d8c4ed7","Type":"ContainerDied","Data":"71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350"} Jul 07 23:15:09.541797 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:09.541768 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5kdc2" event={"ID":"dc85054e-a314-4443-bc6b-3abaf4c8ea9a","Type":"ContainerStarted","Data":"aabb848a9793a646e1ce7c9b3b153e738074621ada8f6917c9c66a06ecf15d7d"} Jul 07 23:15:09.645172 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:09.645119 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5kdc2" podStartSLOduration=2.221244906 podStartE2EDuration="4.645101626s" totalImagesPullingTime="2.42385672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:15:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:15:09.640014713 +0000 UTC m=+91.050076953" watchObservedRunningTime="2026-07-07 23:15:09.645101626 +0000 UTC m=+91.055163863" Jul 07 23:15:10.547048 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:10.547014 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5kdc2" Jul 07 23:15:10.553306 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:10.553273 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5kdc2" Jul 07 23:15:13.564609 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:13.564467 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bca2f93-da1d-437d-a180-c0d65d8c4ed7","Type":"ContainerStarted","Data":"1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b"} Jul 07 23:15:13.564609 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:13.564591 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bca2f93-da1d-437d-a180-c0d65d8c4ed7","Type":"ContainerStarted","Data":"50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d"} Jul 07 23:15:13.565052 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:13.564641 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bca2f93-da1d-437d-a180-c0d65d8c4ed7","Type":"ContainerStarted","Data":"109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39"} Jul 07 23:15:14.549707 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:14.549669 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-8f5d7964f-kzf7g" Jul 07 23:15:14.573455 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:14.573419 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bca2f93-da1d-437d-a180-c0d65d8c4ed7","Type":"ContainerStarted","Data":"7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7"} Jul 07 23:15:14.573940 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:14.573531 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bca2f93-da1d-437d-a180-c0d65d8c4ed7","Type":"ContainerStarted","Data":"6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4"} Jul 07 23:15:14.573940 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:14.573559 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bca2f93-da1d-437d-a180-c0d65d8c4ed7","Type":"ContainerStarted","Data":"c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838"} Jul 07 23:15:17.273311 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:17.273277 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:15:25.362618 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:25.362571 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-fcfd9d454-fnqgp" Jul 07 23:15:25.363109 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:25.362648 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-fcfd9d454-fnqgp" Jul 07 23:15:27.459182 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:27.459100 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-l8cls" Jul 07 23:15:27.476387 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:27.476340 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=16.604345912 podStartE2EDuration="21.4763233s" totalImagesPullingTime="4.849732568s" totalInitContainerRuntime="22.24482ms" isStatefulPod=false podCreationTimestamp="2026-07-07 23:15:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:15:14.614864102 +0000 UTC m=+96.024926365" watchObservedRunningTime="2026-07-07 23:15:27.4763233 +0000 UTC m=+108.886385532" Jul 07 23:15:27.631241 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:27.631197 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-wvhgt" event={"ID":"9f8d8912-c527-402a-b669-984a4335f0fe","Type":"ContainerStarted","Data":"9207bab95167aa37f1a1b395456dc32942aa62b762f081b29432fa97e352b530"} Jul 07 23:15:27.631451 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:27.631432 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-wvhgt" Jul 07 23:15:27.650764 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:27.650733 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-wvhgt" Jul 07 23:15:27.655121 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:27.655029 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-wvhgt" podStartSLOduration=3.677298114 podStartE2EDuration="24.655008563s" totalImagesPullingTime="20.977710449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:15:27.654667784 +0000 UTC m=+109.064730022" watchObservedRunningTime="2026-07-07 23:15:27.655008563 +0000 UTC m=+109.065070802" Jul 07 23:15:45.368425 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:45.368393 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-fcfd9d454-fnqgp" Jul 07 23:15:45.372326 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:15:45.372301 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-fcfd9d454-fnqgp" Jul 07 23:16:07.274325 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:07.274289 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:07.324614 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:07.324583 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:07.811011 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:07.810978 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:25.375879 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.375838 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 23:16:25.376456 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.376202 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerName="prometheus" containerID="cri-o://109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39" gracePeriod=600 Jul 07 23:16:25.376456 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.376258 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerName="thanos-sidecar" containerID="cri-o://1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b" gracePeriod=600 Jul 07 23:16:25.376456 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.376286 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerName="kube-rbac-proxy" containerID="cri-o://6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4" gracePeriod=600 Jul 07 23:16:25.376456 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.376317 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerName="config-reloader" containerID="cri-o://50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d" gracePeriod=600 Jul 07 23:16:25.376456 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.376254 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerName="kube-rbac-proxy-web" containerID="cri-o://c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838" gracePeriod=600 Jul 07 23:16:25.376724 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.376443 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerName="kube-rbac-proxy-thanos" containerID="cri-o://7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7" gracePeriod=600 Jul 07 23:16:25.642498 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.642458 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:25.735474 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.735447 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-metrics-client-certs\") pod \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " Jul 07 23:16:25.735474 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.735501 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-config\") pod \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " Jul 07 23:16:25.735734 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.735519 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-kube-rbac-proxy\") pod \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " Jul 07 23:16:25.735734 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.735536 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-tls-assets\") pod \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " Jul 07 23:16:25.735734 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.735558 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-grpc-tls\") pod \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " Jul 07 23:16:25.735734 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.735589 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-configmap-metrics-client-ca\") pod \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " Jul 07 23:16:25.735734 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.735621 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-web-config\") pod \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " Jul 07 23:16:25.735734 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.735671 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-prometheus-k8s-rulefiles-2\") pod \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " Jul 07 23:16:25.735734 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.735700 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " Jul 07 23:16:25.735734 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.735734 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-configmap-kubelet-serving-ca-bundle\") pod \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " Jul 07 23:16:25.736130 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.735758 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fd95h\" (UniqueName: \"kubernetes.io/projected/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-kube-api-access-fd95h\") pod \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " Jul 07 23:16:25.736130 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.735790 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " Jul 07 23:16:25.736130 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.735823 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-thanos-prometheus-http-client-file\") pod \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " Jul 07 23:16:25.736130 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.735850 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-prometheus-k8s-rulefiles-1\") pod \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " Jul 07 23:16:25.736130 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.735877 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-prometheus-k8s-rulefiles-0\") pod \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " Jul 07 23:16:25.736130 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.735910 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-prometheus-k8s-tls\") pod \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " Jul 07 23:16:25.736130 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.735933 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-config-out\") pod \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " Jul 07 23:16:25.736130 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.735977 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-prometheus-k8s-db\") pod \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " Jul 07 23:16:25.736130 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.735971 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "2bca2f93-da1d-437d-a180-c0d65d8c4ed7" (UID: "2bca2f93-da1d-437d-a180-c0d65d8c4ed7"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 23:16:25.736130 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.736002 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-prometheus-trusted-ca-bundle\") pod \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " Jul 07 23:16:25.736130 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.736069 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-configmap-serving-certs-ca-bundle\") pod \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\" (UID: \"2bca2f93-da1d-437d-a180-c0d65d8c4ed7\") " Jul 07 23:16:25.736738 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.736462 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-configmap-metrics-client-ca\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:16:25.736738 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.736704 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "2bca2f93-da1d-437d-a180-c0d65d8c4ed7" (UID: "2bca2f93-da1d-437d-a180-c0d65d8c4ed7"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 23:16:25.736905 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.736876 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "2bca2f93-da1d-437d-a180-c0d65d8c4ed7" (UID: "2bca2f93-da1d-437d-a180-c0d65d8c4ed7"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 23:16:25.739793 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.738720 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "2bca2f93-da1d-437d-a180-c0d65d8c4ed7" (UID: "2bca2f93-da1d-437d-a180-c0d65d8c4ed7"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 23:16:25.739793 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.738797 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "2bca2f93-da1d-437d-a180-c0d65d8c4ed7" (UID: "2bca2f93-da1d-437d-a180-c0d65d8c4ed7"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 23:16:25.739793 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.738845 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "2bca2f93-da1d-437d-a180-c0d65d8c4ed7" (UID: "2bca2f93-da1d-437d-a180-c0d65d8c4ed7"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 23:16:25.739793 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.739343 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-config" (OuterVolumeSpecName: "config") pod "2bca2f93-da1d-437d-a180-c0d65d8c4ed7" (UID: "2bca2f93-da1d-437d-a180-c0d65d8c4ed7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 23:16:25.739793 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.739552 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "2bca2f93-da1d-437d-a180-c0d65d8c4ed7" (UID: "2bca2f93-da1d-437d-a180-c0d65d8c4ed7"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 23:16:25.739793 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.739637 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "2bca2f93-da1d-437d-a180-c0d65d8c4ed7" (UID: "2bca2f93-da1d-437d-a180-c0d65d8c4ed7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 23:16:25.739793 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.739738 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "2bca2f93-da1d-437d-a180-c0d65d8c4ed7" (UID: "2bca2f93-da1d-437d-a180-c0d65d8c4ed7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 23:16:25.740195 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.739802 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "2bca2f93-da1d-437d-a180-c0d65d8c4ed7" (UID: "2bca2f93-da1d-437d-a180-c0d65d8c4ed7"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 23:16:25.740195 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.740066 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "2bca2f93-da1d-437d-a180-c0d65d8c4ed7" (UID: "2bca2f93-da1d-437d-a180-c0d65d8c4ed7"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 23:16:25.740195 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.740139 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-config-out" (OuterVolumeSpecName: "config-out") pod "2bca2f93-da1d-437d-a180-c0d65d8c4ed7" (UID: "2bca2f93-da1d-437d-a180-c0d65d8c4ed7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 23:16:25.740368 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.740250 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "2bca2f93-da1d-437d-a180-c0d65d8c4ed7" (UID: "2bca2f93-da1d-437d-a180-c0d65d8c4ed7"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 23:16:25.740586 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.740562 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "2bca2f93-da1d-437d-a180-c0d65d8c4ed7" (UID: "2bca2f93-da1d-437d-a180-c0d65d8c4ed7"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 23:16:25.740683 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.740594 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2bca2f93-da1d-437d-a180-c0d65d8c4ed7" (UID: "2bca2f93-da1d-437d-a180-c0d65d8c4ed7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 23:16:25.741168 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.741145 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "2bca2f93-da1d-437d-a180-c0d65d8c4ed7" (UID: "2bca2f93-da1d-437d-a180-c0d65d8c4ed7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 23:16:25.741337 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.741321 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-kube-api-access-fd95h" (OuterVolumeSpecName: "kube-api-access-fd95h") pod "2bca2f93-da1d-437d-a180-c0d65d8c4ed7" (UID: "2bca2f93-da1d-437d-a180-c0d65d8c4ed7"). InnerVolumeSpecName "kube-api-access-fd95h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 23:16:25.742141 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.742122 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "2bca2f93-da1d-437d-a180-c0d65d8c4ed7" (UID: "2bca2f93-da1d-437d-a180-c0d65d8c4ed7"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 23:16:25.752027 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.752000 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-web-config" (OuterVolumeSpecName: "web-config") pod "2bca2f93-da1d-437d-a180-c0d65d8c4ed7" (UID: "2bca2f93-da1d-437d-a180-c0d65d8c4ed7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 23:16:25.837220 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.837178 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:16:25.837220 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.837208 2564 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-metrics-client-certs\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:16:25.837220 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.837220 2564 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-config\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:16:25.837220 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.837230 2564 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-kube-rbac-proxy\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:16:25.837520 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.837239 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-tls-assets\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:16:25.837520 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.837248 2564 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-grpc-tls\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:16:25.837520 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.837255 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-web-config\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:16:25.837520 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.837263 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:16:25.837520 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.837271 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:16:25.837520 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.837280 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:16:25.837520 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.837290 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fd95h\" (UniqueName: \"kubernetes.io/projected/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-kube-api-access-fd95h\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:16:25.837520 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.837298 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:16:25.837520 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.837307 2564 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:16:25.837520 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.837314 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:16:25.837520 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.837322 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:16:25.837520 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.837330 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:16:25.837520 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.837338 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-config-out\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:16:25.837520 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.837345 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-prometheus-k8s-db\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:16:25.837520 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.837352 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bca2f93-da1d-437d-a180-c0d65d8c4ed7-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:16:25.861073 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.861037 2564 generic.go:356] "Generic (PLEG): container finished" podID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerID="7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7" exitCode=0 Jul 07 23:16:25.861073 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.861061 2564 generic.go:356] "Generic (PLEG): container finished" podID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerID="6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4" exitCode=0 Jul 07 23:16:25.861073 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.861072 2564 generic.go:356] "Generic (PLEG): container finished" podID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerID="c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838" exitCode=0 Jul 07 23:16:25.861073 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.861079 2564 generic.go:356] "Generic (PLEG): container finished" podID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerID="1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b" exitCode=0 Jul 07 23:16:25.861382 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.861087 2564 generic.go:356] "Generic (PLEG): container finished" podID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerID="50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d" exitCode=0 Jul 07 23:16:25.861382 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.861095 2564 generic.go:356] "Generic (PLEG): container finished" podID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerID="109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39" exitCode=0 Jul 07 23:16:25.861382 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.861118 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:25.861382 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.861119 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bca2f93-da1d-437d-a180-c0d65d8c4ed7","Type":"ContainerDied","Data":"7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7"} Jul 07 23:16:25.861382 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.861271 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bca2f93-da1d-437d-a180-c0d65d8c4ed7","Type":"ContainerDied","Data":"6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4"} Jul 07 23:16:25.861382 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.861320 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bca2f93-da1d-437d-a180-c0d65d8c4ed7","Type":"ContainerDied","Data":"c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838"} Jul 07 23:16:25.861382 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.861344 2564 scope.go:117] "RemoveContainer" containerID="7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7" Jul 07 23:16:25.861382 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.861364 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bca2f93-da1d-437d-a180-c0d65d8c4ed7","Type":"ContainerDied","Data":"1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b"} Jul 07 23:16:25.861779 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.861404 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bca2f93-da1d-437d-a180-c0d65d8c4ed7","Type":"ContainerDied","Data":"50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d"} Jul 07 23:16:25.861779 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.861446 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bca2f93-da1d-437d-a180-c0d65d8c4ed7","Type":"ContainerDied","Data":"109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39"} Jul 07 23:16:25.861779 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.861515 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bca2f93-da1d-437d-a180-c0d65d8c4ed7","Type":"ContainerDied","Data":"d84300e36d412b25318159f0dd6e15e957ec692f2355da7383fc62e014338edc"} Jul 07 23:16:25.870750 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.870731 2564 scope.go:117] "RemoveContainer" containerID="6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4" Jul 07 23:16:25.878012 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.877995 2564 scope.go:117] "RemoveContainer" containerID="c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838" Jul 07 23:16:25.885253 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.885233 2564 scope.go:117] "RemoveContainer" containerID="1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b" Jul 07 23:16:25.896067 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.896040 2564 scope.go:117] "RemoveContainer" containerID="50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d" Jul 07 23:16:25.897800 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.897203 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 23:16:25.898929 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.898909 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 23:16:25.904018 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.903996 2564 scope.go:117] "RemoveContainer" containerID="109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39" Jul 07 23:16:25.911375 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.911357 2564 scope.go:117] "RemoveContainer" containerID="71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350" Jul 07 23:16:25.918651 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.918626 2564 scope.go:117] "RemoveContainer" containerID="7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7" Jul 07 23:16:25.918934 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:16:25.918911 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7\": container with ID starting with 7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7 not found: ID does not exist" containerID="7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7" Jul 07 23:16:25.918986 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.918944 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7"} err="failed to get container status \"7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7\": rpc error: code = NotFound desc = could not find container \"7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7\": container with ID starting with 7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7 not found: ID does not exist" Jul 07 23:16:25.918986 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.918980 2564 scope.go:117] "RemoveContainer" containerID="6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4" Jul 07 23:16:25.919222 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:16:25.919204 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4\": container with ID starting with 6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4 not found: ID does not exist" containerID="6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4" Jul 07 23:16:25.919303 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.919231 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4"} err="failed to get container status \"6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4\": rpc error: code = NotFound desc = could not find container \"6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4\": container with ID starting with 6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4 not found: ID does not exist" Jul 07 23:16:25.919303 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.919255 2564 scope.go:117] "RemoveContainer" containerID="c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838" Jul 07 23:16:25.919497 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:16:25.919465 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838\": container with ID starting with c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838 not found: ID does not exist" containerID="c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838" Jul 07 23:16:25.919538 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.919500 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838"} err="failed to get container status \"c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838\": rpc error: code = NotFound desc = could not find container \"c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838\": container with ID starting with c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838 not found: ID does not exist" Jul 07 23:16:25.919538 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.919514 2564 scope.go:117] "RemoveContainer" containerID="1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b" Jul 07 23:16:25.919768 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:16:25.919751 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b\": container with ID starting with 1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b not found: ID does not exist" containerID="1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b" Jul 07 23:16:25.919804 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.919772 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b"} err="failed to get container status \"1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b\": rpc error: code = NotFound desc = could not find container \"1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b\": container with ID starting with 1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b not found: ID does not exist" Jul 07 23:16:25.919804 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.919786 2564 scope.go:117] "RemoveContainer" containerID="50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d" Jul 07 23:16:25.920029 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:16:25.920011 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d\": container with ID starting with 50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d not found: ID does not exist" containerID="50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d" Jul 07 23:16:25.920085 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.920033 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d"} err="failed to get container status \"50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d\": rpc error: code = NotFound desc = could not find container \"50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d\": container with ID starting with 50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d not found: ID does not exist" Jul 07 23:16:25.920085 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.920047 2564 scope.go:117] "RemoveContainer" containerID="109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39" Jul 07 23:16:25.920275 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:16:25.920258 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39\": container with ID starting with 109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39 not found: ID does not exist" containerID="109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39" Jul 07 23:16:25.920314 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.920280 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39"} err="failed to get container status \"109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39\": rpc error: code = NotFound desc = could not find container \"109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39\": container with ID starting with 109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39 not found: ID does not exist" Jul 07 23:16:25.920314 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.920304 2564 scope.go:117] "RemoveContainer" containerID="71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350" Jul 07 23:16:25.920534 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:16:25.920518 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350\": container with ID starting with 71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350 not found: ID does not exist" containerID="71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350" Jul 07 23:16:25.920589 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.920537 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350"} err="failed to get container status \"71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350\": rpc error: code = NotFound desc = could not find container \"71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350\": container with ID starting with 71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350 not found: ID does not exist" Jul 07 23:16:25.920589 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.920550 2564 scope.go:117] "RemoveContainer" containerID="7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7" Jul 07 23:16:25.920787 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.920771 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7"} err="failed to get container status \"7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7\": rpc error: code = NotFound desc = could not find container \"7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7\": container with ID starting with 7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7 not found: ID does not exist" Jul 07 23:16:25.920824 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.920788 2564 scope.go:117] "RemoveContainer" containerID="6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4" Jul 07 23:16:25.921016 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.921000 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4"} err="failed to get container status \"6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4\": rpc error: code = NotFound desc = could not find container \"6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4\": container with ID starting with 6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4 not found: ID does not exist" Jul 07 23:16:25.921075 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.921016 2564 scope.go:117] "RemoveContainer" containerID="c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838" Jul 07 23:16:25.921250 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.921234 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838"} err="failed to get container status \"c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838\": rpc error: code = NotFound desc = could not find container \"c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838\": container with ID starting with c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838 not found: ID does not exist" Jul 07 23:16:25.921292 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.921250 2564 scope.go:117] "RemoveContainer" containerID="1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b" Jul 07 23:16:25.921457 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.921439 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b"} err="failed to get container status \"1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b\": rpc error: code = NotFound desc = could not find container \"1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b\": container with ID starting with 1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b not found: ID does not exist" Jul 07 23:16:25.921548 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.921457 2564 scope.go:117] "RemoveContainer" containerID="50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d" Jul 07 23:16:25.921765 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.921749 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d"} err="failed to get container status \"50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d\": rpc error: code = NotFound desc = could not find container \"50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d\": container with ID starting with 50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d not found: ID does not exist" Jul 07 23:16:25.921849 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.921765 2564 scope.go:117] "RemoveContainer" containerID="109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39" Jul 07 23:16:25.921961 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.921944 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39"} err="failed to get container status \"109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39\": rpc error: code = NotFound desc = could not find container \"109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39\": container with ID starting with 109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39 not found: ID does not exist" Jul 07 23:16:25.921997 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.921962 2564 scope.go:117] "RemoveContainer" containerID="71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350" Jul 07 23:16:25.922163 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.922146 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350"} err="failed to get container status \"71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350\": rpc error: code = NotFound desc = could not find container \"71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350\": container with ID starting with 71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350 not found: ID does not exist" Jul 07 23:16:25.922208 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.922163 2564 scope.go:117] "RemoveContainer" containerID="7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7" Jul 07 23:16:25.922398 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.922382 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7"} err="failed to get container status \"7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7\": rpc error: code = NotFound desc = could not find container \"7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7\": container with ID starting with 7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7 not found: ID does not exist" Jul 07 23:16:25.922442 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.922399 2564 scope.go:117] "RemoveContainer" containerID="6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4" Jul 07 23:16:25.922635 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.922610 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4"} err="failed to get container status \"6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4\": rpc error: code = NotFound desc = could not find container \"6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4\": container with ID starting with 6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4 not found: ID does not exist" Jul 07 23:16:25.922699 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.922635 2564 scope.go:117] "RemoveContainer" containerID="c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838" Jul 07 23:16:25.922840 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.922820 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838"} err="failed to get container status \"c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838\": rpc error: code = NotFound desc = could not find container \"c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838\": container with ID starting with c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838 not found: ID does not exist" Jul 07 23:16:25.922886 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.922841 2564 scope.go:117] "RemoveContainer" containerID="1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b" Jul 07 23:16:25.923031 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.923009 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b"} err="failed to get container status \"1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b\": rpc error: code = NotFound desc = could not find container \"1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b\": container with ID starting with 1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b not found: ID does not exist" Jul 07 23:16:25.923100 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.923033 2564 scope.go:117] "RemoveContainer" containerID="50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d" Jul 07 23:16:25.923266 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.923250 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d"} err="failed to get container status \"50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d\": rpc error: code = NotFound desc = could not find container \"50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d\": container with ID starting with 50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d not found: ID does not exist" Jul 07 23:16:25.923312 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.923266 2564 scope.go:117] "RemoveContainer" containerID="109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39" Jul 07 23:16:25.923443 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.923425 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39"} err="failed to get container status \"109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39\": rpc error: code = NotFound desc = could not find container \"109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39\": container with ID starting with 109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39 not found: ID does not exist" Jul 07 23:16:25.923542 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.923445 2564 scope.go:117] "RemoveContainer" containerID="71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350" Jul 07 23:16:25.923699 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.923683 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350"} err="failed to get container status \"71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350\": rpc error: code = NotFound desc = could not find container \"71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350\": container with ID starting with 71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350 not found: ID does not exist" Jul 07 23:16:25.923699 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.923699 2564 scope.go:117] "RemoveContainer" containerID="7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7" Jul 07 23:16:25.923965 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.923938 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7"} err="failed to get container status \"7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7\": rpc error: code = NotFound desc = could not find container \"7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7\": container with ID starting with 7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7 not found: ID does not exist" Jul 07 23:16:25.924066 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.923966 2564 scope.go:117] "RemoveContainer" containerID="6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4" Jul 07 23:16:25.924207 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.924189 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4"} err="failed to get container status \"6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4\": rpc error: code = NotFound desc = could not find container \"6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4\": container with ID starting with 6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4 not found: ID does not exist" Jul 07 23:16:25.924260 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.924208 2564 scope.go:117] "RemoveContainer" containerID="c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838" Jul 07 23:16:25.924436 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.924417 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838"} err="failed to get container status \"c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838\": rpc error: code = NotFound desc = could not find container \"c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838\": container with ID starting with c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838 not found: ID does not exist" Jul 07 23:16:25.924475 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.924440 2564 scope.go:117] "RemoveContainer" containerID="1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b" Jul 07 23:16:25.924682 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.924665 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b"} err="failed to get container status \"1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b\": rpc error: code = NotFound desc = could not find container \"1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b\": container with ID starting with 1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b not found: ID does not exist" Jul 07 23:16:25.924725 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.924683 2564 scope.go:117] "RemoveContainer" containerID="50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d" Jul 07 23:16:25.924902 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.924883 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d"} err="failed to get container status \"50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d\": rpc error: code = NotFound desc = could not find container \"50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d\": container with ID starting with 50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d not found: ID does not exist" Jul 07 23:16:25.924988 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.924903 2564 scope.go:117] "RemoveContainer" containerID="109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39" Jul 07 23:16:25.925141 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.925121 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39"} err="failed to get container status \"109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39\": rpc error: code = NotFound desc = could not find container \"109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39\": container with ID starting with 109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39 not found: ID does not exist" Jul 07 23:16:25.925141 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.925141 2564 scope.go:117] "RemoveContainer" containerID="71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350" Jul 07 23:16:25.925350 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.925331 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350"} err="failed to get container status \"71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350\": rpc error: code = NotFound desc = could not find container \"71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350\": container with ID starting with 71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350 not found: ID does not exist" Jul 07 23:16:25.925446 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.925351 2564 scope.go:117] "RemoveContainer" containerID="7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7" Jul 07 23:16:25.925652 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.925633 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7"} err="failed to get container status \"7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7\": rpc error: code = NotFound desc = could not find container \"7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7\": container with ID starting with 7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7 not found: ID does not exist" Jul 07 23:16:25.925721 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.925653 2564 scope.go:117] "RemoveContainer" containerID="6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4" Jul 07 23:16:25.925865 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.925849 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4"} err="failed to get container status \"6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4\": rpc error: code = NotFound desc = could not find container \"6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4\": container with ID starting with 6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4 not found: ID does not exist" Jul 07 23:16:25.925930 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.925868 2564 scope.go:117] "RemoveContainer" containerID="c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838" Jul 07 23:16:25.926062 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.926046 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838"} err="failed to get container status \"c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838\": rpc error: code = NotFound desc = could not find container \"c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838\": container with ID starting with c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838 not found: ID does not exist" Jul 07 23:16:25.926126 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.926063 2564 scope.go:117] "RemoveContainer" containerID="1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b" Jul 07 23:16:25.926298 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.926280 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b"} err="failed to get container status \"1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b\": rpc error: code = NotFound desc = could not find container \"1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b\": container with ID starting with 1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b not found: ID does not exist" Jul 07 23:16:25.926343 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.926299 2564 scope.go:117] "RemoveContainer" containerID="50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d" Jul 07 23:16:25.926531 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.926514 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d"} err="failed to get container status \"50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d\": rpc error: code = NotFound desc = could not find container \"50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d\": container with ID starting with 50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d not found: ID does not exist" Jul 07 23:16:25.926602 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.926532 2564 scope.go:117] "RemoveContainer" containerID="109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39" Jul 07 23:16:25.926740 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.926724 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39"} err="failed to get container status \"109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39\": rpc error: code = NotFound desc = could not find container \"109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39\": container with ID starting with 109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39 not found: ID does not exist" Jul 07 23:16:25.926789 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.926741 2564 scope.go:117] "RemoveContainer" containerID="71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350" Jul 07 23:16:25.926902 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.926886 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350"} err="failed to get container status \"71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350\": rpc error: code = NotFound desc = could not find container \"71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350\": container with ID starting with 71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350 not found: ID does not exist" Jul 07 23:16:25.926944 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.926904 2564 scope.go:117] "RemoveContainer" containerID="7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7" Jul 07 23:16:25.927096 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.927079 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7"} err="failed to get container status \"7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7\": rpc error: code = NotFound desc = could not find container \"7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7\": container with ID starting with 7b05132f53bbdf72dfd71508f2498917e0a1dfd7e9bd8fb1c6d061cb97173cb7 not found: ID does not exist" Jul 07 23:16:25.927155 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.927098 2564 scope.go:117] "RemoveContainer" containerID="6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4" Jul 07 23:16:25.927307 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.927288 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4"} err="failed to get container status \"6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4\": rpc error: code = NotFound desc = could not find container \"6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4\": container with ID starting with 6ce58aba65a0d726481dac6b86f3cc19c443a517bb04574796ad8d8cc18fcee4 not found: ID does not exist" Jul 07 23:16:25.927357 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.927308 2564 scope.go:117] "RemoveContainer" containerID="c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838" Jul 07 23:16:25.927508 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.927491 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838"} err="failed to get container status \"c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838\": rpc error: code = NotFound desc = could not find container \"c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838\": container with ID starting with c48443e72216ceb4e1e9a932d05c2864f26b5301ab0d980e9515118c3be22838 not found: ID does not exist" Jul 07 23:16:25.927569 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.927509 2564 scope.go:117] "RemoveContainer" containerID="1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b" Jul 07 23:16:25.927744 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.927722 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b"} err="failed to get container status \"1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b\": rpc error: code = NotFound desc = could not find container \"1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b\": container with ID starting with 1751800e74f96e10a2077ed89e96ab09fd88d90fe2a42b0fbf247803a0cad18b not found: ID does not exist" Jul 07 23:16:25.927791 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.927745 2564 scope.go:117] "RemoveContainer" containerID="50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d" Jul 07 23:16:25.927933 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.927916 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d"} err="failed to get container status \"50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d\": rpc error: code = NotFound desc = could not find container \"50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d\": container with ID starting with 50c4b73cdc0e6af33eb1fae6f601f8177be184d761984e17a486a9493b52f11d not found: ID does not exist" Jul 07 23:16:25.928002 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.927934 2564 scope.go:117] "RemoveContainer" containerID="109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39" Jul 07 23:16:25.928143 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.928123 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39"} err="failed to get container status \"109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39\": rpc error: code = NotFound desc = could not find container \"109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39\": container with ID starting with 109bacbf31a59d30e871a212860f7264267ecd4fa78db1cda45c87643ccc1d39 not found: ID does not exist" Jul 07 23:16:25.928186 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.928145 2564 scope.go:117] "RemoveContainer" containerID="71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350" Jul 07 23:16:25.928331 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.928316 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350"} err="failed to get container status \"71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350\": rpc error: code = NotFound desc = could not find container \"71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350\": container with ID starting with 71647dde679f6b6ea28044cbbfb6ec9348060e1fb0d0114c23bd5c9b08fac350 not found: ID does not exist" Jul 07 23:16:25.954604 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.954571 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 23:16:25.954884 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.954871 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerName="init-config-reloader" Jul 07 23:16:25.954927 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.954886 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerName="init-config-reloader" Jul 07 23:16:25.954927 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.954897 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerName="thanos-sidecar" Jul 07 23:16:25.954927 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.954902 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerName="thanos-sidecar" Jul 07 23:16:25.954927 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.954911 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerName="kube-rbac-proxy-thanos" Jul 07 23:16:25.954927 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.954917 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerName="kube-rbac-proxy-thanos" Jul 07 23:16:25.954927 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.954927 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerName="kube-rbac-proxy" Jul 07 23:16:25.955134 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.954933 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerName="kube-rbac-proxy" Jul 07 23:16:25.955134 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.954940 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerName="prometheus" Jul 07 23:16:25.955134 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.954945 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerName="prometheus" Jul 07 23:16:25.955134 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.954952 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerName="kube-rbac-proxy-web" Jul 07 23:16:25.955134 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.954957 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerName="kube-rbac-proxy-web" Jul 07 23:16:25.955134 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.954965 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerName="config-reloader" Jul 07 23:16:25.955134 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.954970 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerName="config-reloader" Jul 07 23:16:25.955134 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.955014 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerName="kube-rbac-proxy" Jul 07 23:16:25.955134 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.955023 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerName="config-reloader" Jul 07 23:16:25.955134 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.955027 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerName="kube-rbac-proxy-thanos" Jul 07 23:16:25.955134 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.955033 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerName="kube-rbac-proxy-web" Jul 07 23:16:25.955134 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.955039 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerName="prometheus" Jul 07 23:16:25.955134 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.955043 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" containerName="thanos-sidecar" Jul 07 23:16:25.958703 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.958684 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:25.968897 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.968876 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 07 23:16:25.969092 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.969078 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 07 23:16:25.969196 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.969088 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 07 23:16:25.969196 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.969176 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 07 23:16:25.969319 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.969294 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6ia93qfj4tqrp\"" Jul 07 23:16:25.969418 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.969401 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 07 23:16:25.969558 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.969542 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 07 23:16:25.969617 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.969557 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 07 23:16:25.969838 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.969821 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 07 23:16:25.969934 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.969919 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 07 23:16:25.970211 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.970198 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vf4tf\"" Jul 07 23:16:25.973636 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.973616 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 07 23:16:25.974356 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.974341 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 07 23:16:25.978919 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.978902 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 07 23:16:25.980082 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.980067 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 07 23:16:25.980249 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:25.980233 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 07 23:16:26.039940 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.039905 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/43153c5e-45ce-4949-8b44-ff18e13db248-config\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.039940 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.039939 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/43153c5e-45ce-4949-8b44-ff18e13db248-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.040180 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.039958 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/43153c5e-45ce-4949-8b44-ff18e13db248-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.040180 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.039978 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/43153c5e-45ce-4949-8b44-ff18e13db248-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.040180 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.039994 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/43153c5e-45ce-4949-8b44-ff18e13db248-config-out\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.040180 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.040064 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43153c5e-45ce-4949-8b44-ff18e13db248-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.040180 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.040100 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/43153c5e-45ce-4949-8b44-ff18e13db248-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.040180 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.040131 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/43153c5e-45ce-4949-8b44-ff18e13db248-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.040180 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.040177 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/43153c5e-45ce-4949-8b44-ff18e13db248-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.040543 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.040221 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/43153c5e-45ce-4949-8b44-ff18e13db248-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.040543 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.040247 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/43153c5e-45ce-4949-8b44-ff18e13db248-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.040543 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.040285 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/43153c5e-45ce-4949-8b44-ff18e13db248-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.040543 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.040307 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43153c5e-45ce-4949-8b44-ff18e13db248-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.040543 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.040331 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/43153c5e-45ce-4949-8b44-ff18e13db248-web-config\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.040543 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.040361 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43153c5e-45ce-4949-8b44-ff18e13db248-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.040543 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.040401 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/43153c5e-45ce-4949-8b44-ff18e13db248-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.040543 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.040427 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9thl\" (UniqueName: \"kubernetes.io/projected/43153c5e-45ce-4949-8b44-ff18e13db248-kube-api-access-z9thl\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.040543 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.040464 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43153c5e-45ce-4949-8b44-ff18e13db248-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.040543 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.040532 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/43153c5e-45ce-4949-8b44-ff18e13db248-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.040835 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.040552 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/43153c5e-45ce-4949-8b44-ff18e13db248-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.063165 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.063133 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 23:16:26.141161 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.141051 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/43153c5e-45ce-4949-8b44-ff18e13db248-config\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.141161 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.141107 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/43153c5e-45ce-4949-8b44-ff18e13db248-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.141402 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.141219 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/43153c5e-45ce-4949-8b44-ff18e13db248-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.141402 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.141258 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/43153c5e-45ce-4949-8b44-ff18e13db248-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.141402 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.141280 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/43153c5e-45ce-4949-8b44-ff18e13db248-config-out\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.141402 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.141312 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43153c5e-45ce-4949-8b44-ff18e13db248-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.141402 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.141330 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/43153c5e-45ce-4949-8b44-ff18e13db248-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.141402 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.141348 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/43153c5e-45ce-4949-8b44-ff18e13db248-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.141402 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.141382 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/43153c5e-45ce-4949-8b44-ff18e13db248-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.141779 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.141420 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/43153c5e-45ce-4949-8b44-ff18e13db248-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.141779 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.141442 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/43153c5e-45ce-4949-8b44-ff18e13db248-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.141779 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.141505 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/43153c5e-45ce-4949-8b44-ff18e13db248-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.141779 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.141528 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43153c5e-45ce-4949-8b44-ff18e13db248-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.141779 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.141548 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/43153c5e-45ce-4949-8b44-ff18e13db248-web-config\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.141779 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.141582 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43153c5e-45ce-4949-8b44-ff18e13db248-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.141779 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.141611 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/43153c5e-45ce-4949-8b44-ff18e13db248-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.141779 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.141634 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9thl\" (UniqueName: \"kubernetes.io/projected/43153c5e-45ce-4949-8b44-ff18e13db248-kube-api-access-z9thl\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.141779 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.141663 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43153c5e-45ce-4949-8b44-ff18e13db248-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.141779 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.141698 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/43153c5e-45ce-4949-8b44-ff18e13db248-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.141779 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.141730 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/43153c5e-45ce-4949-8b44-ff18e13db248-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.142289 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.141815 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/43153c5e-45ce-4949-8b44-ff18e13db248-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.142289 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.141996 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/43153c5e-45ce-4949-8b44-ff18e13db248-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.142289 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.142067 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43153c5e-45ce-4949-8b44-ff18e13db248-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.142931 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.142908 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43153c5e-45ce-4949-8b44-ff18e13db248-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.144731 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.144703 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/43153c5e-45ce-4949-8b44-ff18e13db248-config\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.144839 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.144819 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43153c5e-45ce-4949-8b44-ff18e13db248-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.144912 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.144874 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/43153c5e-45ce-4949-8b44-ff18e13db248-config-out\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.145060 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.145032 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/43153c5e-45ce-4949-8b44-ff18e13db248-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.145060 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.145052 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/43153c5e-45ce-4949-8b44-ff18e13db248-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.145378 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.145354 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/43153c5e-45ce-4949-8b44-ff18e13db248-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.145378 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.145366 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/43153c5e-45ce-4949-8b44-ff18e13db248-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.145535 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.145426 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/43153c5e-45ce-4949-8b44-ff18e13db248-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.145695 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.145630 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43153c5e-45ce-4949-8b44-ff18e13db248-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.145942 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.145914 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/43153c5e-45ce-4949-8b44-ff18e13db248-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.146745 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.146694 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/43153c5e-45ce-4949-8b44-ff18e13db248-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.147407 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.147381 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/43153c5e-45ce-4949-8b44-ff18e13db248-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.147753 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.147727 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/43153c5e-45ce-4949-8b44-ff18e13db248-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.147925 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.147902 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/43153c5e-45ce-4949-8b44-ff18e13db248-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.148027 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.148012 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/43153c5e-45ce-4949-8b44-ff18e13db248-web-config\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.156109 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.156082 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9thl\" (UniqueName: \"kubernetes.io/projected/43153c5e-45ce-4949-8b44-ff18e13db248-kube-api-access-z9thl\") pod \"prometheus-k8s-0\" (UID: \"43153c5e-45ce-4949-8b44-ff18e13db248\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.267701 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.267664 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:16:26.413561 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.413529 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 23:16:26.415614 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:16:26.415589 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43153c5e_45ce_4949_8b44_ff18e13db248.slice/crio-6aacb5c2801b1d0c81c13b1c29d7b58827c76adba9a16b221fbd62d7fff986ff WatchSource:0}: Error finding container 6aacb5c2801b1d0c81c13b1c29d7b58827c76adba9a16b221fbd62d7fff986ff: Status 404 returned error can't find the container with id 6aacb5c2801b1d0c81c13b1c29d7b58827c76adba9a16b221fbd62d7fff986ff Jul 07 23:16:26.870158 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.870128 2564 generic.go:356] "Generic (PLEG): container finished" podID="43153c5e-45ce-4949-8b44-ff18e13db248" containerID="2121df6aee93e3449099f3331631d1eb5d190ddd6733c6cb8f8277db0757c314" exitCode=0 Jul 07 23:16:26.870330 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.870182 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43153c5e-45ce-4949-8b44-ff18e13db248","Type":"ContainerDied","Data":"2121df6aee93e3449099f3331631d1eb5d190ddd6733c6cb8f8277db0757c314"} Jul 07 23:16:26.870330 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:26.870232 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43153c5e-45ce-4949-8b44-ff18e13db248","Type":"ContainerStarted","Data":"6aacb5c2801b1d0c81c13b1c29d7b58827c76adba9a16b221fbd62d7fff986ff"} Jul 07 23:16:27.119525 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:27.119474 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bca2f93-da1d-437d-a180-c0d65d8c4ed7" path="/var/lib/kubelet/pods/2bca2f93-da1d-437d-a180-c0d65d8c4ed7/volumes" Jul 07 23:16:27.878098 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:27.878063 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43153c5e-45ce-4949-8b44-ff18e13db248","Type":"ContainerStarted","Data":"9f9f364cc006ec2344c6140d85cb7aee352f55ae0b3d91ae19487730a740be52"} Jul 07 23:16:27.878502 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:27.878168 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43153c5e-45ce-4949-8b44-ff18e13db248","Type":"ContainerStarted","Data":"c9f497c0c1964d6346bcdcf00398dbf7887f47f0f6d6c9b1ac0a3c3d21b12d88"} Jul 07 23:16:27.878502 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:27.878197 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43153c5e-45ce-4949-8b44-ff18e13db248","Type":"ContainerStarted","Data":"1e7c144a991c48fa1664534f5c28c43d4751576103b0a41b474a26cff6760d29"} Jul 07 23:16:27.878502 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:27.878229 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43153c5e-45ce-4949-8b44-ff18e13db248","Type":"ContainerStarted","Data":"5591379d297b2944def7ee6adbb1ebb92213965e1ddf0f48e819c1c1b5c25404"} Jul 07 23:16:27.878502 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:27.878266 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43153c5e-45ce-4949-8b44-ff18e13db248","Type":"ContainerStarted","Data":"7a6e5c15fe507fd421fa5a0b94a9b6f45cd6dbc692912aae82a3b203b9d768b5"} Jul 07 23:16:27.878502 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:27.878302 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43153c5e-45ce-4949-8b44-ff18e13db248","Type":"ContainerStarted","Data":"9c92ce4b28093a8abe3ddfc8f3b143044fc8f13e614f7251f2538b23c9ce7b2f"} Jul 07 23:16:27.915678 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:27.915297 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.895572712 podStartE2EDuration="2.915276093s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.703381ms" isStatefulPod=false podCreationTimestamp="2026-07-07 23:16:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:16:27.912214195 +0000 UTC m=+169.322276434" watchObservedRunningTime="2026-07-07 23:16:27.915276093 +0000 UTC m=+169.325338333" Jul 07 23:16:31.268663 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:16:31.268565 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:17:26.268109 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:17:26.268061 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:17:26.285341 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:17:26.285315 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:17:27.105198 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:17:27.105172 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 23:18:38.968238 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:18:38.968211 2564 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 23:19:44.320669 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:44.320637 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c9859966d-m24rn"] Jul 07 23:19:44.322922 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:44.322905 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c9859966d-m24rn" Jul 07 23:19:44.327878 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:44.327854 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 23:19:44.327998 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:44.327937 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 23:19:44.328433 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:44.328402 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 23:19:44.328551 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:44.328524 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 23:19:44.328635 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:44.328619 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-z2ktg\"" Jul 07 23:19:44.380502 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:44.380454 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c9859966d-m24rn"] Jul 07 23:19:44.442268 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:44.442228 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e715ba5d-1b60-421b-8ec6-563c818211e5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c9859966d-m24rn\" (UID: \"e715ba5d-1b60-421b-8ec6-563c818211e5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9859966d-m24rn" Jul 07 23:19:44.442472 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:44.442299 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hrxv\" (UniqueName: \"kubernetes.io/projected/e715ba5d-1b60-421b-8ec6-563c818211e5-kube-api-access-8hrxv\") pod \"opendatahub-operator-controller-manager-7c9859966d-m24rn\" (UID: \"e715ba5d-1b60-421b-8ec6-563c818211e5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9859966d-m24rn" Jul 07 23:19:44.442472 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:44.442387 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e715ba5d-1b60-421b-8ec6-563c818211e5-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c9859966d-m24rn\" (UID: \"e715ba5d-1b60-421b-8ec6-563c818211e5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9859966d-m24rn" Jul 07 23:19:44.442472 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:44.442429 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e715ba5d-1b60-421b-8ec6-563c818211e5-tmp\") pod \"opendatahub-operator-controller-manager-7c9859966d-m24rn\" (UID: \"e715ba5d-1b60-421b-8ec6-563c818211e5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9859966d-m24rn" Jul 07 23:19:44.442472 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:44.442449 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e715ba5d-1b60-421b-8ec6-563c818211e5-manifests\") pod \"opendatahub-operator-controller-manager-7c9859966d-m24rn\" (UID: \"e715ba5d-1b60-421b-8ec6-563c818211e5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9859966d-m24rn" Jul 07 23:19:44.542834 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:44.542792 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hrxv\" (UniqueName: \"kubernetes.io/projected/e715ba5d-1b60-421b-8ec6-563c818211e5-kube-api-access-8hrxv\") pod \"opendatahub-operator-controller-manager-7c9859966d-m24rn\" (UID: \"e715ba5d-1b60-421b-8ec6-563c818211e5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9859966d-m24rn" Jul 07 23:19:44.543046 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:44.542864 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e715ba5d-1b60-421b-8ec6-563c818211e5-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c9859966d-m24rn\" (UID: \"e715ba5d-1b60-421b-8ec6-563c818211e5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9859966d-m24rn" Jul 07 23:19:44.543046 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:44.542906 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e715ba5d-1b60-421b-8ec6-563c818211e5-tmp\") pod \"opendatahub-operator-controller-manager-7c9859966d-m24rn\" (UID: \"e715ba5d-1b60-421b-8ec6-563c818211e5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9859966d-m24rn" Jul 07 23:19:44.543046 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:44.542937 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e715ba5d-1b60-421b-8ec6-563c818211e5-manifests\") pod \"opendatahub-operator-controller-manager-7c9859966d-m24rn\" (UID: \"e715ba5d-1b60-421b-8ec6-563c818211e5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9859966d-m24rn" Jul 07 23:19:44.543046 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:44.542987 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e715ba5d-1b60-421b-8ec6-563c818211e5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c9859966d-m24rn\" (UID: \"e715ba5d-1b60-421b-8ec6-563c818211e5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9859966d-m24rn" Jul 07 23:19:44.543446 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:44.543421 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e715ba5d-1b60-421b-8ec6-563c818211e5-manifests\") pod \"opendatahub-operator-controller-manager-7c9859966d-m24rn\" (UID: \"e715ba5d-1b60-421b-8ec6-563c818211e5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9859966d-m24rn" Jul 07 23:19:44.545626 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:44.545599 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e715ba5d-1b60-421b-8ec6-563c818211e5-tmp\") pod \"opendatahub-operator-controller-manager-7c9859966d-m24rn\" (UID: \"e715ba5d-1b60-421b-8ec6-563c818211e5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9859966d-m24rn" Jul 07 23:19:44.545743 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:44.545698 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e715ba5d-1b60-421b-8ec6-563c818211e5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c9859966d-m24rn\" (UID: \"e715ba5d-1b60-421b-8ec6-563c818211e5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9859966d-m24rn" Jul 07 23:19:44.545743 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:44.545705 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e715ba5d-1b60-421b-8ec6-563c818211e5-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c9859966d-m24rn\" (UID: \"e715ba5d-1b60-421b-8ec6-563c818211e5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9859966d-m24rn" Jul 07 23:19:44.570063 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:44.570036 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hrxv\" (UniqueName: \"kubernetes.io/projected/e715ba5d-1b60-421b-8ec6-563c818211e5-kube-api-access-8hrxv\") pod \"opendatahub-operator-controller-manager-7c9859966d-m24rn\" (UID: \"e715ba5d-1b60-421b-8ec6-563c818211e5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9859966d-m24rn" Jul 07 23:19:44.633766 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:44.633673 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c9859966d-m24rn" Jul 07 23:19:44.784882 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:44.784856 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c9859966d-m24rn"] Jul 07 23:19:44.787701 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:19:44.787672 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode715ba5d_1b60_421b_8ec6_563c818211e5.slice/crio-fefd2fe618d113f0d94a90acc76c9528eb49046cb1ca28979e4a7ca3d4345005 WatchSource:0}: Error finding container fefd2fe618d113f0d94a90acc76c9528eb49046cb1ca28979e4a7ca3d4345005: Status 404 returned error can't find the container with id fefd2fe618d113f0d94a90acc76c9528eb49046cb1ca28979e4a7ca3d4345005 Jul 07 23:19:44.789365 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:44.789349 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 23:19:45.602887 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:45.602849 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c9859966d-m24rn" event={"ID":"e715ba5d-1b60-421b-8ec6-563c818211e5","Type":"ContainerStarted","Data":"fefd2fe618d113f0d94a90acc76c9528eb49046cb1ca28979e4a7ca3d4345005"} Jul 07 23:19:48.624688 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:48.624648 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c9859966d-m24rn" event={"ID":"e715ba5d-1b60-421b-8ec6-563c818211e5","Type":"ContainerStarted","Data":"e86164bf5586abd887acfe221d9f8e3dff1eb727c86912570415f48a6f6207dc"} Jul 07 23:19:49.629798 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:49.629760 2564 generic.go:356] "Generic (PLEG): container finished" podID="e715ba5d-1b60-421b-8ec6-563c818211e5" containerID="e86164bf5586abd887acfe221d9f8e3dff1eb727c86912570415f48a6f6207dc" exitCode=0 Jul 07 23:19:49.630403 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:49.629817 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c9859966d-m24rn" event={"ID":"e715ba5d-1b60-421b-8ec6-563c818211e5","Type":"ContainerDied","Data":"e86164bf5586abd887acfe221d9f8e3dff1eb727c86912570415f48a6f6207dc"} Jul 07 23:19:50.635091 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:50.635053 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c9859966d-m24rn" event={"ID":"e715ba5d-1b60-421b-8ec6-563c818211e5","Type":"ContainerStarted","Data":"74623b204f100310ea6e3afcb42d9e342a2c03ca62dd530c07c9fbcff74e6e64"} Jul 07 23:19:50.635587 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:50.635175 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c9859966d-m24rn" Jul 07 23:19:50.681795 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:19:50.681740 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c9859966d-m24rn" podStartSLOduration=2.270555156 podStartE2EDuration="6.681723027s" totalImagesPullingTime="3.320801097s" totalInitContainerRuntime="1.090366774s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:19:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:19:50.681611013 +0000 UTC m=+372.091673262" watchObservedRunningTime="2026-07-07 23:19:50.681723027 +0000 UTC m=+372.091785264" Jul 07 23:20:01.642106 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:01.642075 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c9859966d-m24rn" Jul 07 23:20:01.876722 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:01.876691 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7895d9b5-lkzpv"] Jul 07 23:20:01.882338 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:01.882321 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7895d9b5-lkzpv" Jul 07 23:20:01.885428 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:01.885401 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 07 23:20:01.885580 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:01.885470 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 07 23:20:01.885724 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:01.885709 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 07 23:20:01.885766 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:01.885732 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 07 23:20:01.885910 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:01.885894 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 07 23:20:01.885963 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:01.885947 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ghd6g\"" Jul 07 23:20:01.892740 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:01.892688 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7895d9b5-lkzpv"] Jul 07 23:20:01.983552 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:01.983511 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e76f1a6f-1cac-4367-bc44-4b6411480f07-cert\") pod \"lws-controller-manager-7895d9b5-lkzpv\" (UID: \"e76f1a6f-1cac-4367-bc44-4b6411480f07\") " pod="openshift-lws-operator/lws-controller-manager-7895d9b5-lkzpv" Jul 07 23:20:01.983701 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:01.983590 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e76f1a6f-1cac-4367-bc44-4b6411480f07-metrics-cert\") pod \"lws-controller-manager-7895d9b5-lkzpv\" (UID: \"e76f1a6f-1cac-4367-bc44-4b6411480f07\") " pod="openshift-lws-operator/lws-controller-manager-7895d9b5-lkzpv" Jul 07 23:20:01.983701 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:01.983610 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxs85\" (UniqueName: \"kubernetes.io/projected/e76f1a6f-1cac-4367-bc44-4b6411480f07-kube-api-access-qxs85\") pod \"lws-controller-manager-7895d9b5-lkzpv\" (UID: \"e76f1a6f-1cac-4367-bc44-4b6411480f07\") " pod="openshift-lws-operator/lws-controller-manager-7895d9b5-lkzpv" Jul 07 23:20:01.983701 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:01.983647 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e76f1a6f-1cac-4367-bc44-4b6411480f07-manager-config\") pod \"lws-controller-manager-7895d9b5-lkzpv\" (UID: \"e76f1a6f-1cac-4367-bc44-4b6411480f07\") " pod="openshift-lws-operator/lws-controller-manager-7895d9b5-lkzpv" Jul 07 23:20:02.084040 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:02.084001 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e76f1a6f-1cac-4367-bc44-4b6411480f07-cert\") pod \"lws-controller-manager-7895d9b5-lkzpv\" (UID: \"e76f1a6f-1cac-4367-bc44-4b6411480f07\") " pod="openshift-lws-operator/lws-controller-manager-7895d9b5-lkzpv" Jul 07 23:20:02.084229 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:02.084065 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e76f1a6f-1cac-4367-bc44-4b6411480f07-metrics-cert\") pod \"lws-controller-manager-7895d9b5-lkzpv\" (UID: \"e76f1a6f-1cac-4367-bc44-4b6411480f07\") " pod="openshift-lws-operator/lws-controller-manager-7895d9b5-lkzpv" Jul 07 23:20:02.084229 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:02.084084 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxs85\" (UniqueName: \"kubernetes.io/projected/e76f1a6f-1cac-4367-bc44-4b6411480f07-kube-api-access-qxs85\") pod \"lws-controller-manager-7895d9b5-lkzpv\" (UID: \"e76f1a6f-1cac-4367-bc44-4b6411480f07\") " pod="openshift-lws-operator/lws-controller-manager-7895d9b5-lkzpv" Jul 07 23:20:02.084229 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:02.084111 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e76f1a6f-1cac-4367-bc44-4b6411480f07-manager-config\") pod \"lws-controller-manager-7895d9b5-lkzpv\" (UID: \"e76f1a6f-1cac-4367-bc44-4b6411480f07\") " pod="openshift-lws-operator/lws-controller-manager-7895d9b5-lkzpv" Jul 07 23:20:02.084801 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:02.084775 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e76f1a6f-1cac-4367-bc44-4b6411480f07-manager-config\") pod \"lws-controller-manager-7895d9b5-lkzpv\" (UID: \"e76f1a6f-1cac-4367-bc44-4b6411480f07\") " pod="openshift-lws-operator/lws-controller-manager-7895d9b5-lkzpv" Jul 07 23:20:02.086696 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:02.086667 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e76f1a6f-1cac-4367-bc44-4b6411480f07-metrics-cert\") pod \"lws-controller-manager-7895d9b5-lkzpv\" (UID: \"e76f1a6f-1cac-4367-bc44-4b6411480f07\") " pod="openshift-lws-operator/lws-controller-manager-7895d9b5-lkzpv" Jul 07 23:20:02.086696 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:02.086687 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e76f1a6f-1cac-4367-bc44-4b6411480f07-cert\") pod \"lws-controller-manager-7895d9b5-lkzpv\" (UID: \"e76f1a6f-1cac-4367-bc44-4b6411480f07\") " pod="openshift-lws-operator/lws-controller-manager-7895d9b5-lkzpv" Jul 07 23:20:02.095960 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:02.095933 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxs85\" (UniqueName: \"kubernetes.io/projected/e76f1a6f-1cac-4367-bc44-4b6411480f07-kube-api-access-qxs85\") pod \"lws-controller-manager-7895d9b5-lkzpv\" (UID: \"e76f1a6f-1cac-4367-bc44-4b6411480f07\") " pod="openshift-lws-operator/lws-controller-manager-7895d9b5-lkzpv" Jul 07 23:20:02.192730 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:02.192630 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7895d9b5-lkzpv" Jul 07 23:20:02.336955 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:02.336931 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7895d9b5-lkzpv"] Jul 07 23:20:02.337905 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:20:02.337881 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode76f1a6f_1cac_4367_bc44_4b6411480f07.slice/crio-978ef68dc63a47657cffef57f2cbcbad701a0f831de3990a5a6d1478a5a59b97 WatchSource:0}: Error finding container 978ef68dc63a47657cffef57f2cbcbad701a0f831de3990a5a6d1478a5a59b97: Status 404 returned error can't find the container with id 978ef68dc63a47657cffef57f2cbcbad701a0f831de3990a5a6d1478a5a59b97 Jul 07 23:20:02.687710 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:02.687674 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7895d9b5-lkzpv" event={"ID":"e76f1a6f-1cac-4367-bc44-4b6411480f07","Type":"ContainerStarted","Data":"978ef68dc63a47657cffef57f2cbcbad701a0f831de3990a5a6d1478a5a59b97"} Jul 07 23:20:06.705185 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:06.705147 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7895d9b5-lkzpv" event={"ID":"e76f1a6f-1cac-4367-bc44-4b6411480f07","Type":"ContainerStarted","Data":"d22a981df40b8b32b6e484c693c19d93220027d4b489dc883e97389f80f7d048"} Jul 07 23:20:06.705645 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:06.705259 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7895d9b5-lkzpv" Jul 07 23:20:06.731630 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:06.731585 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7895d9b5-lkzpv" podStartSLOduration=2.199694654 podStartE2EDuration="5.731567567s" totalImagesPullingTime="3.531872913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:20:06.730383561 +0000 UTC m=+388.140445799" watchObservedRunningTime="2026-07-07 23:20:06.731567567 +0000 UTC m=+388.141629836" Jul 07 23:20:12.505049 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.505014 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zkbjz"] Jul 07 23:20:12.507394 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.507376 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zkbjz" Jul 07 23:20:12.517091 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.517065 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 07 23:20:12.517274 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.517256 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 07 23:20:12.517357 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.517335 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-bn98l\"" Jul 07 23:20:12.517595 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.517576 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 23:20:12.517750 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.517731 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 23:20:12.517932 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.517918 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 07 23:20:12.519571 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.519547 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 23:20:12.534957 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.534925 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zkbjz"] Jul 07 23:20:12.676209 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.676168 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-zkbjz\" (UID: \"a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zkbjz" Jul 07 23:20:12.676209 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.676219 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-zkbjz\" (UID: \"a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zkbjz" Jul 07 23:20:12.676472 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.676284 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-zkbjz\" (UID: \"a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zkbjz" Jul 07 23:20:12.676472 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.676367 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tcbt\" (UniqueName: \"kubernetes.io/projected/a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec-kube-api-access-7tcbt\") pod \"istiod-openshift-gateway-94bb8fbfd-zkbjz\" (UID: \"a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zkbjz" Jul 07 23:20:12.676472 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.676443 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-zkbjz\" (UID: \"a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zkbjz" Jul 07 23:20:12.676638 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.676501 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-zkbjz\" (UID: \"a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zkbjz" Jul 07 23:20:12.676638 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.676524 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-zkbjz\" (UID: \"a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zkbjz" Jul 07 23:20:12.777686 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.777587 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-zkbjz\" (UID: \"a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zkbjz" Jul 07 23:20:12.777686 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.777633 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-zkbjz\" (UID: \"a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zkbjz" Jul 07 23:20:12.777909 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.777768 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-zkbjz\" (UID: \"a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zkbjz" Jul 07 23:20:12.777909 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.777816 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-zkbjz\" (UID: \"a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zkbjz" Jul 07 23:20:12.777909 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.777855 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-zkbjz\" (UID: \"a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zkbjz" Jul 07 23:20:12.777909 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.777901 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-zkbjz\" (UID: \"a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zkbjz" Jul 07 23:20:12.778130 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.777977 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tcbt\" (UniqueName: \"kubernetes.io/projected/a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec-kube-api-access-7tcbt\") pod \"istiod-openshift-gateway-94bb8fbfd-zkbjz\" (UID: \"a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zkbjz" Jul 07 23:20:12.778426 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.778399 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-zkbjz\" (UID: \"a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zkbjz" Jul 07 23:20:12.780195 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.780172 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-zkbjz\" (UID: \"a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zkbjz" Jul 07 23:20:12.780427 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.780396 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-zkbjz\" (UID: \"a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zkbjz" Jul 07 23:20:12.780603 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.780589 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-zkbjz\" (UID: \"a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zkbjz" Jul 07 23:20:12.780728 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.780706 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-zkbjz\" (UID: \"a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zkbjz" Jul 07 23:20:12.790647 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.790620 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-zkbjz\" (UID: \"a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zkbjz" Jul 07 23:20:12.790794 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.790776 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tcbt\" (UniqueName: \"kubernetes.io/projected/a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec-kube-api-access-7tcbt\") pod \"istiod-openshift-gateway-94bb8fbfd-zkbjz\" (UID: \"a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zkbjz" Jul 07 23:20:12.816790 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.816755 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zkbjz" Jul 07 23:20:12.968874 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:12.968800 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zkbjz"] Jul 07 23:20:12.971569 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:20:12.971537 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda923d7ce_a66a_440b_9ad2_2ce5a03ae7ec.slice/crio-01923d1d535fd8cd9bc5f5216bd13686c54d97cb3b09ef814c770a4e2cfcf9a3 WatchSource:0}: Error finding container 01923d1d535fd8cd9bc5f5216bd13686c54d97cb3b09ef814c770a4e2cfcf9a3: Status 404 returned error can't find the container with id 01923d1d535fd8cd9bc5f5216bd13686c54d97cb3b09ef814c770a4e2cfcf9a3 Jul 07 23:20:13.733741 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:13.733704 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zkbjz" event={"ID":"a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec","Type":"ContainerStarted","Data":"01923d1d535fd8cd9bc5f5216bd13686c54d97cb3b09ef814c770a4e2cfcf9a3"} Jul 07 23:20:16.304704 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:16.304649 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 07 23:20:16.305068 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:16.304745 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 07 23:20:16.749920 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:16.749872 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zkbjz" event={"ID":"a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec","Type":"ContainerStarted","Data":"3cd8e00845dff537f19c5bc1ce0892ead71dd7fc4d2ce77ab263e16080c41572"} Jul 07 23:20:16.750111 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:16.749942 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zkbjz" Jul 07 23:20:16.776401 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:16.776346 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zkbjz" podStartSLOduration=1.4454206809999999 podStartE2EDuration="4.776327132s" totalImagesPullingTime="3.330906451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:20:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:20:16.774862734 +0000 UTC m=+398.184924983" watchObservedRunningTime="2026-07-07 23:20:16.776327132 +0000 UTC m=+398.186389370" Jul 07 23:20:17.716507 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:17.711515 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7895d9b5-lkzpv" Jul 07 23:20:17.756708 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:20:17.756679 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zkbjz" Jul 07 23:22:04.895170 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:04.895135 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8dn42"] Jul 07 23:22:04.898378 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:04.898361 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8dn42" Jul 07 23:22:04.903016 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:04.902996 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-m2xpk\"" Jul 07 23:22:04.903348 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:04.903334 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 23:22:04.903583 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:04.903563 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 23:22:04.920135 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:04.920105 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8dn42"] Jul 07 23:22:04.963547 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:04.963505 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xhhf\" (UniqueName: \"kubernetes.io/projected/6d261744-f7e2-4a6b-a030-bee06417919b-kube-api-access-4xhhf\") pod \"kuadrant-operator-controller-manager-55467d9f7-8dn42\" (UID: \"6d261744-f7e2-4a6b-a030-bee06417919b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8dn42" Jul 07 23:22:04.963704 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:04.963556 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d261744-f7e2-4a6b-a030-bee06417919b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-8dn42\" (UID: \"6d261744-f7e2-4a6b-a030-bee06417919b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8dn42" Jul 07 23:22:05.030341 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:05.030299 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8dn42"] Jul 07 23:22:05.030674 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:22:05.030649 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-4xhhf], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8dn42" podUID="6d261744-f7e2-4a6b-a030-bee06417919b" Jul 07 23:22:05.053208 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:05.053177 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8dn42"] Jul 07 23:22:05.060832 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:05.060799 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8dn42"] Jul 07 23:22:05.064400 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:05.064375 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xhhf\" (UniqueName: \"kubernetes.io/projected/6d261744-f7e2-4a6b-a030-bee06417919b-kube-api-access-4xhhf\") pod \"kuadrant-operator-controller-manager-55467d9f7-8dn42\" (UID: \"6d261744-f7e2-4a6b-a030-bee06417919b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8dn42" Jul 07 23:22:05.064543 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:05.064421 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d261744-f7e2-4a6b-a030-bee06417919b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-8dn42\" (UID: \"6d261744-f7e2-4a6b-a030-bee06417919b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8dn42" Jul 07 23:22:05.064806 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:05.064790 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d261744-f7e2-4a6b-a030-bee06417919b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-8dn42\" (UID: \"6d261744-f7e2-4a6b-a030-bee06417919b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8dn42" Jul 07 23:22:05.067119 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:22:05.067105 2564 projected.go:196] Error preparing data for projected volume kube-api-access-4xhhf for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8dn42: failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-143-195.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-143-195.ec2.internal' and this object Jul 07 23:22:05.067178 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:22:05.067168 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d261744-f7e2-4a6b-a030-bee06417919b-kube-api-access-4xhhf podName:6d261744-f7e2-4a6b-a030-bee06417919b nodeName:}" failed. No retries permitted until 2026-07-07 23:22:05.56715109 +0000 UTC m=+506.977213306 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4xhhf" (UniqueName: "kubernetes.io/projected/6d261744-f7e2-4a6b-a030-bee06417919b-kube-api-access-4xhhf") pod "kuadrant-operator-controller-manager-55467d9f7-8dn42" (UID: "6d261744-f7e2-4a6b-a030-bee06417919b") : failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-143-195.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-143-195.ec2.internal' and this object Jul 07 23:22:05.096748 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:05.096719 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gdhwf"] Jul 07 23:22:05.099732 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:05.099714 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gdhwf" Jul 07 23:22:05.127365 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:05.127313 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gdhwf"] Jul 07 23:22:05.165060 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:05.164961 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a09eb62-1d7a-42c2-85b9-9ebd46af69f2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-gdhwf\" (UID: \"1a09eb62-1d7a-42c2-85b9-9ebd46af69f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gdhwf" Jul 07 23:22:05.165060 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:05.165017 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2swkg\" (UniqueName: \"kubernetes.io/projected/1a09eb62-1d7a-42c2-85b9-9ebd46af69f2-kube-api-access-2swkg\") pod \"kuadrant-operator-controller-manager-86878c769f-gdhwf\" (UID: \"1a09eb62-1d7a-42c2-85b9-9ebd46af69f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gdhwf" Jul 07 23:22:05.197859 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:05.197826 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8dn42" Jul 07 23:22:05.204597 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:05.204572 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8dn42" Jul 07 23:22:05.207132 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:22:05.207102 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-8dn42\" is forbidden: User \"system:node:ip-10-0-143-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-195.ec2.internal' and this object" podUID="6d261744-f7e2-4a6b-a030-bee06417919b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8dn42" Jul 07 23:22:05.265526 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:05.265464 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d261744-f7e2-4a6b-a030-bee06417919b-extensions-socket-volume\") pod \"6d261744-f7e2-4a6b-a030-bee06417919b\" (UID: \"6d261744-f7e2-4a6b-a030-bee06417919b\") " Jul 07 23:22:05.265740 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:05.265719 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2swkg\" (UniqueName: \"kubernetes.io/projected/1a09eb62-1d7a-42c2-85b9-9ebd46af69f2-kube-api-access-2swkg\") pod \"kuadrant-operator-controller-manager-86878c769f-gdhwf\" (UID: \"1a09eb62-1d7a-42c2-85b9-9ebd46af69f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gdhwf" Jul 07 23:22:05.265806 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:05.265765 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d261744-f7e2-4a6b-a030-bee06417919b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6d261744-f7e2-4a6b-a030-bee06417919b" (UID: "6d261744-f7e2-4a6b-a030-bee06417919b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 23:22:05.265849 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:05.265838 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a09eb62-1d7a-42c2-85b9-9ebd46af69f2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-gdhwf\" (UID: \"1a09eb62-1d7a-42c2-85b9-9ebd46af69f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gdhwf" Jul 07 23:22:05.265916 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:05.265900 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xhhf\" (UniqueName: \"kubernetes.io/projected/6d261744-f7e2-4a6b-a030-bee06417919b-kube-api-access-4xhhf\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:22:05.265960 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:05.265919 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d261744-f7e2-4a6b-a030-bee06417919b-extensions-socket-volume\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:22:05.266244 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:05.266226 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a09eb62-1d7a-42c2-85b9-9ebd46af69f2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-gdhwf\" (UID: \"1a09eb62-1d7a-42c2-85b9-9ebd46af69f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gdhwf" Jul 07 23:22:05.276354 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:05.276329 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2swkg\" (UniqueName: \"kubernetes.io/projected/1a09eb62-1d7a-42c2-85b9-9ebd46af69f2-kube-api-access-2swkg\") pod \"kuadrant-operator-controller-manager-86878c769f-gdhwf\" (UID: \"1a09eb62-1d7a-42c2-85b9-9ebd46af69f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gdhwf" Jul 07 23:22:05.409293 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:05.409248 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gdhwf" Jul 07 23:22:05.568409 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:05.568380 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gdhwf"] Jul 07 23:22:05.570312 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:22:05.570281 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a09eb62_1d7a_42c2_85b9_9ebd46af69f2.slice/crio-caa5f43377df586c2326378059db7f75a25b679a029421c372647ee33faaba19 WatchSource:0}: Error finding container caa5f43377df586c2326378059db7f75a25b679a029421c372647ee33faaba19: Status 404 returned error can't find the container with id caa5f43377df586c2326378059db7f75a25b679a029421c372647ee33faaba19 Jul 07 23:22:06.203339 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:06.203303 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gdhwf" event={"ID":"1a09eb62-1d7a-42c2-85b9-9ebd46af69f2","Type":"ContainerStarted","Data":"caa5f43377df586c2326378059db7f75a25b679a029421c372647ee33faaba19"} Jul 07 23:22:06.203736 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:06.203344 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8dn42" Jul 07 23:22:06.212047 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:22:06.212003 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-8dn42\" is forbidden: User \"system:node:ip-10-0-143-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-195.ec2.internal' and this object" podUID="6d261744-f7e2-4a6b-a030-bee06417919b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8dn42" Jul 07 23:22:06.221793 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:22:06.221756 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-8dn42\" is forbidden: User \"system:node:ip-10-0-143-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-195.ec2.internal' and this object" podUID="6d261744-f7e2-4a6b-a030-bee06417919b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8dn42" Jul 07 23:22:07.118249 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:07.118205 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d261744-f7e2-4a6b-a030-bee06417919b" path="/var/lib/kubelet/pods/6d261744-f7e2-4a6b-a030-bee06417919b/volumes" Jul 07 23:22:12.239262 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:12.239216 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gdhwf" event={"ID":"1a09eb62-1d7a-42c2-85b9-9ebd46af69f2","Type":"ContainerStarted","Data":"44b181cbfabb189c04d92b5a545e7a95ec8451d681863b8dd7d90b8fe6afcf06"} Jul 07 23:22:12.239699 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:12.239390 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gdhwf" Jul 07 23:22:12.262417 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:12.262363 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gdhwf" podStartSLOduration=1.3877086109999999 podStartE2EDuration="7.262347154s" totalImagesPullingTime="5.874638543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:22:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:22:12.259919009 +0000 UTC m=+513.669981275" watchObservedRunningTime="2026-07-07 23:22:12.262347154 +0000 UTC m=+513.672409392" Jul 07 23:22:23.245834 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:22:23.245802 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gdhwf" Jul 07 23:23:22.059913 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:22.059873 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54cdf5d9ff-fjgx4"] Jul 07 23:23:22.063390 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:22.063363 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54cdf5d9ff-fjgx4" Jul 07 23:23:22.066345 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:22.066312 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 07 23:23:22.066533 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:22.066378 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 07 23:23:22.066533 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:22.066419 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qcd2z\"" Jul 07 23:23:22.075418 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:22.075389 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54cdf5d9ff-fjgx4"] Jul 07 23:23:22.129440 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:22.129403 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b46125a4-428b-4150-ae40-1ff690db27ff-webhook-cert\") pod \"maas-controller-54cdf5d9ff-fjgx4\" (UID: \"b46125a4-428b-4150-ae40-1ff690db27ff\") " pod="opendatahub/maas-controller-54cdf5d9ff-fjgx4" Jul 07 23:23:22.129636 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:22.129448 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4s5l\" (UniqueName: \"kubernetes.io/projected/b46125a4-428b-4150-ae40-1ff690db27ff-kube-api-access-s4s5l\") pod \"maas-controller-54cdf5d9ff-fjgx4\" (UID: \"b46125a4-428b-4150-ae40-1ff690db27ff\") " pod="opendatahub/maas-controller-54cdf5d9ff-fjgx4" Jul 07 23:23:22.230552 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:22.230507 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b46125a4-428b-4150-ae40-1ff690db27ff-webhook-cert\") pod \"maas-controller-54cdf5d9ff-fjgx4\" (UID: \"b46125a4-428b-4150-ae40-1ff690db27ff\") " pod="opendatahub/maas-controller-54cdf5d9ff-fjgx4" Jul 07 23:23:22.230552 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:22.230563 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4s5l\" (UniqueName: \"kubernetes.io/projected/b46125a4-428b-4150-ae40-1ff690db27ff-kube-api-access-s4s5l\") pod \"maas-controller-54cdf5d9ff-fjgx4\" (UID: \"b46125a4-428b-4150-ae40-1ff690db27ff\") " pod="opendatahub/maas-controller-54cdf5d9ff-fjgx4" Jul 07 23:23:22.233376 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:22.233345 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b46125a4-428b-4150-ae40-1ff690db27ff-webhook-cert\") pod \"maas-controller-54cdf5d9ff-fjgx4\" (UID: \"b46125a4-428b-4150-ae40-1ff690db27ff\") " pod="opendatahub/maas-controller-54cdf5d9ff-fjgx4" Jul 07 23:23:22.242538 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:22.242507 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4s5l\" (UniqueName: \"kubernetes.io/projected/b46125a4-428b-4150-ae40-1ff690db27ff-kube-api-access-s4s5l\") pod \"maas-controller-54cdf5d9ff-fjgx4\" (UID: \"b46125a4-428b-4150-ae40-1ff690db27ff\") " pod="opendatahub/maas-controller-54cdf5d9ff-fjgx4" Jul 07 23:23:22.374688 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:22.374587 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54cdf5d9ff-fjgx4" Jul 07 23:23:22.510854 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:22.510807 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54cdf5d9ff-fjgx4"] Jul 07 23:23:22.513828 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:23:22.513789 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb46125a4_428b_4150_ae40_1ff690db27ff.slice/crio-b8c125fc54d84ae0e9ac27dc51738b5de3595cdb33af4743417de28d7e797d6f WatchSource:0}: Error finding container b8c125fc54d84ae0e9ac27dc51738b5de3595cdb33af4743417de28d7e797d6f: Status 404 returned error can't find the container with id b8c125fc54d84ae0e9ac27dc51738b5de3595cdb33af4743417de28d7e797d6f Jul 07 23:23:22.541360 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:22.541323 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54cdf5d9ff-fjgx4" event={"ID":"b46125a4-428b-4150-ae40-1ff690db27ff","Type":"ContainerStarted","Data":"b8c125fc54d84ae0e9ac27dc51738b5de3595cdb33af4743417de28d7e797d6f"} Jul 07 23:23:25.555661 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:25.555617 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54cdf5d9ff-fjgx4" event={"ID":"b46125a4-428b-4150-ae40-1ff690db27ff","Type":"ContainerStarted","Data":"b5b708e349a6123dfc7bfd7438c6e64b9b3b5fecf2e9ca2345745a34c0298a10"} Jul 07 23:23:25.556075 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:25.555710 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54cdf5d9ff-fjgx4" Jul 07 23:23:25.599718 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:25.599664 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-54cdf5d9ff-fjgx4" podStartSLOduration=0.996858544 podStartE2EDuration="3.599648512s" totalImagesPullingTime="2.602789968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:23:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:23:25.59793045 +0000 UTC m=+587.007992688" watchObservedRunningTime="2026-07-07 23:23:25.599648512 +0000 UTC m=+587.009710749" Jul 07 23:23:36.568631 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:36.568598 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54cdf5d9ff-fjgx4" Jul 07 23:23:36.637671 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:36.637633 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54cdf5d9ff-fjgx4"] Jul 07 23:23:36.637910 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:36.637859 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-54cdf5d9ff-fjgx4" podUID="b46125a4-428b-4150-ae40-1ff690db27ff" containerName="manager" containerID="cri-o://b5b708e349a6123dfc7bfd7438c6e64b9b3b5fecf2e9ca2345745a34c0298a10" gracePeriod=30 Jul 07 23:23:36.885959 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:36.885930 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54cdf5d9ff-fjgx4" Jul 07 23:23:37.062988 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:37.062955 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b46125a4-428b-4150-ae40-1ff690db27ff-webhook-cert\") pod \"b46125a4-428b-4150-ae40-1ff690db27ff\" (UID: \"b46125a4-428b-4150-ae40-1ff690db27ff\") " Jul 07 23:23:37.063178 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:37.063070 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4s5l\" (UniqueName: \"kubernetes.io/projected/b46125a4-428b-4150-ae40-1ff690db27ff-kube-api-access-s4s5l\") pod \"b46125a4-428b-4150-ae40-1ff690db27ff\" (UID: \"b46125a4-428b-4150-ae40-1ff690db27ff\") " Jul 07 23:23:37.065355 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:37.065326 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b46125a4-428b-4150-ae40-1ff690db27ff-kube-api-access-s4s5l" (OuterVolumeSpecName: "kube-api-access-s4s5l") pod "b46125a4-428b-4150-ae40-1ff690db27ff" (UID: "b46125a4-428b-4150-ae40-1ff690db27ff"). InnerVolumeSpecName "kube-api-access-s4s5l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 23:23:37.065455 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:37.065362 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b46125a4-428b-4150-ae40-1ff690db27ff-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b46125a4-428b-4150-ae40-1ff690db27ff" (UID: "b46125a4-428b-4150-ae40-1ff690db27ff"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 23:23:37.164461 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:37.164427 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4s5l\" (UniqueName: \"kubernetes.io/projected/b46125a4-428b-4150-ae40-1ff690db27ff-kube-api-access-s4s5l\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:23:37.164461 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:37.164456 2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b46125a4-428b-4150-ae40-1ff690db27ff-webhook-cert\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:23:37.609666 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:37.609630 2564 generic.go:356] "Generic (PLEG): container finished" podID="b46125a4-428b-4150-ae40-1ff690db27ff" containerID="b5b708e349a6123dfc7bfd7438c6e64b9b3b5fecf2e9ca2345745a34c0298a10" exitCode=0 Jul 07 23:23:37.610116 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:37.609680 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54cdf5d9ff-fjgx4" Jul 07 23:23:37.610116 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:37.609700 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54cdf5d9ff-fjgx4" event={"ID":"b46125a4-428b-4150-ae40-1ff690db27ff","Type":"ContainerDied","Data":"b5b708e349a6123dfc7bfd7438c6e64b9b3b5fecf2e9ca2345745a34c0298a10"} Jul 07 23:23:37.610116 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:37.609742 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54cdf5d9ff-fjgx4" event={"ID":"b46125a4-428b-4150-ae40-1ff690db27ff","Type":"ContainerDied","Data":"b8c125fc54d84ae0e9ac27dc51738b5de3595cdb33af4743417de28d7e797d6f"} Jul 07 23:23:37.610116 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:37.609762 2564 scope.go:117] "RemoveContainer" containerID="b5b708e349a6123dfc7bfd7438c6e64b9b3b5fecf2e9ca2345745a34c0298a10" Jul 07 23:23:37.617876 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:37.617842 2564 scope.go:117] "RemoveContainer" containerID="b5b708e349a6123dfc7bfd7438c6e64b9b3b5fecf2e9ca2345745a34c0298a10" Jul 07 23:23:37.618109 ip-10-0-143-195 kubenswrapper[2564]: E0707 23:23:37.618084 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5b708e349a6123dfc7bfd7438c6e64b9b3b5fecf2e9ca2345745a34c0298a10\": container with ID starting with b5b708e349a6123dfc7bfd7438c6e64b9b3b5fecf2e9ca2345745a34c0298a10 not found: ID does not exist" containerID="b5b708e349a6123dfc7bfd7438c6e64b9b3b5fecf2e9ca2345745a34c0298a10" Jul 07 23:23:37.618181 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:37.618116 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5b708e349a6123dfc7bfd7438c6e64b9b3b5fecf2e9ca2345745a34c0298a10"} err="failed to get container status \"b5b708e349a6123dfc7bfd7438c6e64b9b3b5fecf2e9ca2345745a34c0298a10\": rpc error: code = NotFound desc = could not find container \"b5b708e349a6123dfc7bfd7438c6e64b9b3b5fecf2e9ca2345745a34c0298a10\": container with ID starting with b5b708e349a6123dfc7bfd7438c6e64b9b3b5fecf2e9ca2345745a34c0298a10 not found: ID does not exist" Jul 07 23:23:37.633913 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:37.632915 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54cdf5d9ff-fjgx4"] Jul 07 23:23:37.636307 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:37.636277 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-54cdf5d9ff-fjgx4"] Jul 07 23:23:39.117096 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:39.117060 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b46125a4-428b-4150-ae40-1ff690db27ff" path="/var/lib/kubelet/pods/b46125a4-428b-4150-ae40-1ff690db27ff/volumes" Jul 07 23:23:57.467945 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:57.467904 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-nnl7k"] Jul 07 23:23:57.468411 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:57.468261 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b46125a4-428b-4150-ae40-1ff690db27ff" containerName="manager" Jul 07 23:23:57.468411 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:57.468273 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b46125a4-428b-4150-ae40-1ff690db27ff" containerName="manager" Jul 07 23:23:57.468411 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:57.468325 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b46125a4-428b-4150-ae40-1ff690db27ff" containerName="manager" Jul 07 23:23:57.472859 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:57.472838 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-nnl7k" Jul 07 23:23:57.475342 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:57.475323 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 07 23:23:57.483124 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:57.483096 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-nnl7k"] Jul 07 23:23:57.534426 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:57.534389 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3fb2bbdb-2f2f-4f90-92dc-cf82f11d14a6-plugins-config-volume\") pod \"payload-pre-processing-7964457696-nnl7k\" (UID: \"3fb2bbdb-2f2f-4f90-92dc-cf82f11d14a6\") " pod="openshift-ingress/payload-pre-processing-7964457696-nnl7k" Jul 07 23:23:57.534634 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:57.534440 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7gl7\" (UniqueName: \"kubernetes.io/projected/3fb2bbdb-2f2f-4f90-92dc-cf82f11d14a6-kube-api-access-x7gl7\") pod \"payload-pre-processing-7964457696-nnl7k\" (UID: \"3fb2bbdb-2f2f-4f90-92dc-cf82f11d14a6\") " pod="openshift-ingress/payload-pre-processing-7964457696-nnl7k" Jul 07 23:23:57.635867 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:57.635829 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3fb2bbdb-2f2f-4f90-92dc-cf82f11d14a6-plugins-config-volume\") pod \"payload-pre-processing-7964457696-nnl7k\" (UID: \"3fb2bbdb-2f2f-4f90-92dc-cf82f11d14a6\") " pod="openshift-ingress/payload-pre-processing-7964457696-nnl7k" Jul 07 23:23:57.636037 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:57.635877 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7gl7\" (UniqueName: \"kubernetes.io/projected/3fb2bbdb-2f2f-4f90-92dc-cf82f11d14a6-kube-api-access-x7gl7\") pod \"payload-pre-processing-7964457696-nnl7k\" (UID: \"3fb2bbdb-2f2f-4f90-92dc-cf82f11d14a6\") " pod="openshift-ingress/payload-pre-processing-7964457696-nnl7k" Jul 07 23:23:57.636530 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:57.636510 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3fb2bbdb-2f2f-4f90-92dc-cf82f11d14a6-plugins-config-volume\") pod \"payload-pre-processing-7964457696-nnl7k\" (UID: \"3fb2bbdb-2f2f-4f90-92dc-cf82f11d14a6\") " pod="openshift-ingress/payload-pre-processing-7964457696-nnl7k" Jul 07 23:23:57.649405 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:57.649378 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7gl7\" (UniqueName: \"kubernetes.io/projected/3fb2bbdb-2f2f-4f90-92dc-cf82f11d14a6-kube-api-access-x7gl7\") pod \"payload-pre-processing-7964457696-nnl7k\" (UID: \"3fb2bbdb-2f2f-4f90-92dc-cf82f11d14a6\") " pod="openshift-ingress/payload-pre-processing-7964457696-nnl7k" Jul 07 23:23:57.783988 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:57.783953 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-nnl7k" Jul 07 23:23:57.935750 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:57.935714 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-nnl7k"] Jul 07 23:23:57.938900 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:23:57.938865 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fb2bbdb_2f2f_4f90_92dc_cf82f11d14a6.slice/crio-1f93bc2968d69495f7541b5fd809cd52bb29717a4aae39fed80f7f5b8dd1a91f WatchSource:0}: Error finding container 1f93bc2968d69495f7541b5fd809cd52bb29717a4aae39fed80f7f5b8dd1a91f: Status 404 returned error can't find the container with id 1f93bc2968d69495f7541b5fd809cd52bb29717a4aae39fed80f7f5b8dd1a91f Jul 07 23:23:58.701425 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:58.701345 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-nnl7k" event={"ID":"3fb2bbdb-2f2f-4f90-92dc-cf82f11d14a6","Type":"ContainerStarted","Data":"1f93bc2968d69495f7541b5fd809cd52bb29717a4aae39fed80f7f5b8dd1a91f"} Jul 07 23:23:59.706862 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:59.706823 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-nnl7k" event={"ID":"3fb2bbdb-2f2f-4f90-92dc-cf82f11d14a6","Type":"ContainerStarted","Data":"ecb18225a8d3cc35475bc4e971acacd683331453404f33a172fdd2a2d63ac2f6"} Jul 07 23:23:59.707283 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:59.706907 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-nnl7k" Jul 07 23:23:59.725317 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:23:59.725256 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-nnl7k" podStartSLOduration=1.163860051 podStartE2EDuration="2.725232236s" totalImagesPullingTime="1.561372185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:23:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:23:59.723576464 +0000 UTC m=+621.133638704" watchObservedRunningTime="2026-07-07 23:23:59.725232236 +0000 UTC m=+621.135294476" Jul 07 23:24:10.712838 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:10.712802 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-nnl7k" Jul 07 23:24:36.443333 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:36.443297 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gtddc"] Jul 07 23:24:36.446401 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:36.446378 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gtddc" Jul 07 23:24:36.449311 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:36.449286 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 07 23:24:36.450385 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:36.450367 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 07 23:24:36.450622 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:36.450601 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 07 23:24:36.450697 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:36.450645 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-99wd9\"" Jul 07 23:24:36.458387 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:36.458362 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gtddc"] Jul 07 23:24:36.483717 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:36.483679 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67f43467-b664-4541-95f3-f26e8c896c29-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gtddc\" (UID: \"67f43467-b664-4541-95f3-f26e8c896c29\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gtddc" Jul 07 23:24:36.483717 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:36.483722 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67f43467-b664-4541-95f3-f26e8c896c29-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gtddc\" (UID: \"67f43467-b664-4541-95f3-f26e8c896c29\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gtddc" Jul 07 23:24:36.483999 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:36.483781 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67f43467-b664-4541-95f3-f26e8c896c29-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gtddc\" (UID: \"67f43467-b664-4541-95f3-f26e8c896c29\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gtddc" Jul 07 23:24:36.483999 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:36.483830 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvwpq\" (UniqueName: \"kubernetes.io/projected/67f43467-b664-4541-95f3-f26e8c896c29-kube-api-access-dvwpq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gtddc\" (UID: \"67f43467-b664-4541-95f3-f26e8c896c29\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gtddc" Jul 07 23:24:36.483999 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:36.483883 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67f43467-b664-4541-95f3-f26e8c896c29-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gtddc\" (UID: \"67f43467-b664-4541-95f3-f26e8c896c29\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gtddc" Jul 07 23:24:36.483999 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:36.483924 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67f43467-b664-4541-95f3-f26e8c896c29-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gtddc\" (UID: \"67f43467-b664-4541-95f3-f26e8c896c29\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gtddc" Jul 07 23:24:36.584781 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:36.584739 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67f43467-b664-4541-95f3-f26e8c896c29-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gtddc\" (UID: \"67f43467-b664-4541-95f3-f26e8c896c29\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gtddc" Jul 07 23:24:36.584781 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:36.584786 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvwpq\" (UniqueName: \"kubernetes.io/projected/67f43467-b664-4541-95f3-f26e8c896c29-kube-api-access-dvwpq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gtddc\" (UID: \"67f43467-b664-4541-95f3-f26e8c896c29\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gtddc" Jul 07 23:24:36.585015 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:36.584817 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67f43467-b664-4541-95f3-f26e8c896c29-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gtddc\" (UID: \"67f43467-b664-4541-95f3-f26e8c896c29\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gtddc" Jul 07 23:24:36.585015 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:36.584847 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67f43467-b664-4541-95f3-f26e8c896c29-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gtddc\" (UID: \"67f43467-b664-4541-95f3-f26e8c896c29\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gtddc" Jul 07 23:24:36.585015 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:36.584870 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67f43467-b664-4541-95f3-f26e8c896c29-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gtddc\" (UID: \"67f43467-b664-4541-95f3-f26e8c896c29\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gtddc" Jul 07 23:24:36.585207 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:36.585180 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67f43467-b664-4541-95f3-f26e8c896c29-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gtddc\" (UID: \"67f43467-b664-4541-95f3-f26e8c896c29\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gtddc" Jul 07 23:24:36.585270 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:36.585232 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67f43467-b664-4541-95f3-f26e8c896c29-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gtddc\" (UID: \"67f43467-b664-4541-95f3-f26e8c896c29\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gtddc" Jul 07 23:24:36.585378 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:36.585351 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67f43467-b664-4541-95f3-f26e8c896c29-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gtddc\" (UID: \"67f43467-b664-4541-95f3-f26e8c896c29\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gtddc" Jul 07 23:24:36.585475 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:36.585457 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67f43467-b664-4541-95f3-f26e8c896c29-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gtddc\" (UID: \"67f43467-b664-4541-95f3-f26e8c896c29\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gtddc" Jul 07 23:24:36.587157 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:36.587137 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67f43467-b664-4541-95f3-f26e8c896c29-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gtddc\" (UID: \"67f43467-b664-4541-95f3-f26e8c896c29\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gtddc" Jul 07 23:24:36.587473 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:36.587451 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67f43467-b664-4541-95f3-f26e8c896c29-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gtddc\" (UID: \"67f43467-b664-4541-95f3-f26e8c896c29\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gtddc" Jul 07 23:24:36.594033 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:36.594008 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvwpq\" (UniqueName: \"kubernetes.io/projected/67f43467-b664-4541-95f3-f26e8c896c29-kube-api-access-dvwpq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gtddc\" (UID: \"67f43467-b664-4541-95f3-f26e8c896c29\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gtddc" Jul 07 23:24:36.756750 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:36.756708 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gtddc" Jul 07 23:24:36.895689 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:36.895657 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gtddc"] Jul 07 23:24:36.897942 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:24:36.897915 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67f43467_b664_4541_95f3_f26e8c896c29.slice/crio-255aa3f27c9ebeaa5826a31efd8e93cea42dba3fc76875db8c26930c023a0aa2 WatchSource:0}: Error finding container 255aa3f27c9ebeaa5826a31efd8e93cea42dba3fc76875db8c26930c023a0aa2: Status 404 returned error can't find the container with id 255aa3f27c9ebeaa5826a31efd8e93cea42dba3fc76875db8c26930c023a0aa2 Jul 07 23:24:37.879045 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:37.879008 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gtddc" event={"ID":"67f43467-b664-4541-95f3-f26e8c896c29","Type":"ContainerStarted","Data":"255aa3f27c9ebeaa5826a31efd8e93cea42dba3fc76875db8c26930c023a0aa2"} Jul 07 23:24:38.885087 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:38.885051 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gtddc" event={"ID":"67f43467-b664-4541-95f3-f26e8c896c29","Type":"ContainerStarted","Data":"a719917896e0f571aa7da18717665c82e988ef1733c2a4d7d69f513c8f7f0e39"} Jul 07 23:24:38.906117 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:38.906056 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gtddc" podStartSLOduration=1.90575221 podStartE2EDuration="2.906036089s" totalImagesPullingTime="1.000283879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:24:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:24:38.90559367 +0000 UTC m=+660.315655910" watchObservedRunningTime="2026-07-07 23:24:38.906036089 +0000 UTC m=+660.316098327" Jul 07 23:24:46.757633 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:46.757589 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gtddc" Jul 07 23:24:46.758101 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:46.757660 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gtddc" Jul 07 23:24:46.769985 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:46.769957 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gtddc" Jul 07 23:24:46.932410 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:46.932378 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gtddc" Jul 07 23:24:49.262603 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:49.262566 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7"] Jul 07 23:24:49.266206 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:49.266181 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7" Jul 07 23:24:49.269439 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:49.269415 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 07 23:24:49.276937 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:49.276914 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7"] Jul 07 23:24:49.387898 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:49.387857 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cda22477-2cac-42e0-a714-4042fff597f8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7\" (UID: \"cda22477-2cac-42e0-a714-4042fff597f8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7" Jul 07 23:24:49.388099 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:49.387901 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cda22477-2cac-42e0-a714-4042fff597f8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7\" (UID: \"cda22477-2cac-42e0-a714-4042fff597f8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7" Jul 07 23:24:49.388099 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:49.387934 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cda22477-2cac-42e0-a714-4042fff597f8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7\" (UID: \"cda22477-2cac-42e0-a714-4042fff597f8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7" Jul 07 23:24:49.388099 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:49.387966 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cda22477-2cac-42e0-a714-4042fff597f8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7\" (UID: \"cda22477-2cac-42e0-a714-4042fff597f8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7" Jul 07 23:24:49.388099 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:49.388001 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cda22477-2cac-42e0-a714-4042fff597f8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7\" (UID: \"cda22477-2cac-42e0-a714-4042fff597f8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7" Jul 07 23:24:49.388099 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:49.388025 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkpg8\" (UniqueName: \"kubernetes.io/projected/cda22477-2cac-42e0-a714-4042fff597f8-kube-api-access-nkpg8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7\" (UID: \"cda22477-2cac-42e0-a714-4042fff597f8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7" Jul 07 23:24:49.489003 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:49.488963 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cda22477-2cac-42e0-a714-4042fff597f8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7\" (UID: \"cda22477-2cac-42e0-a714-4042fff597f8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7" Jul 07 23:24:49.489003 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:49.489009 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkpg8\" (UniqueName: \"kubernetes.io/projected/cda22477-2cac-42e0-a714-4042fff597f8-kube-api-access-nkpg8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7\" (UID: \"cda22477-2cac-42e0-a714-4042fff597f8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7" Jul 07 23:24:49.489231 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:49.489066 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cda22477-2cac-42e0-a714-4042fff597f8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7\" (UID: \"cda22477-2cac-42e0-a714-4042fff597f8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7" Jul 07 23:24:49.489231 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:49.489085 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cda22477-2cac-42e0-a714-4042fff597f8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7\" (UID: \"cda22477-2cac-42e0-a714-4042fff597f8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7" Jul 07 23:24:49.489231 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:49.489102 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cda22477-2cac-42e0-a714-4042fff597f8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7\" (UID: \"cda22477-2cac-42e0-a714-4042fff597f8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7" Jul 07 23:24:49.489231 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:49.489117 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cda22477-2cac-42e0-a714-4042fff597f8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7\" (UID: \"cda22477-2cac-42e0-a714-4042fff597f8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7" Jul 07 23:24:49.489531 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:49.489509 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cda22477-2cac-42e0-a714-4042fff597f8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7\" (UID: \"cda22477-2cac-42e0-a714-4042fff597f8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7" Jul 07 23:24:49.489620 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:49.489565 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cda22477-2cac-42e0-a714-4042fff597f8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7\" (UID: \"cda22477-2cac-42e0-a714-4042fff597f8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7" Jul 07 23:24:49.489620 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:49.489605 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cda22477-2cac-42e0-a714-4042fff597f8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7\" (UID: \"cda22477-2cac-42e0-a714-4042fff597f8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7" Jul 07 23:24:49.491475 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:49.491455 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cda22477-2cac-42e0-a714-4042fff597f8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7\" (UID: \"cda22477-2cac-42e0-a714-4042fff597f8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7" Jul 07 23:24:49.491789 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:49.491770 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cda22477-2cac-42e0-a714-4042fff597f8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7\" (UID: \"cda22477-2cac-42e0-a714-4042fff597f8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7" Jul 07 23:24:49.505841 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:49.505815 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkpg8\" (UniqueName: \"kubernetes.io/projected/cda22477-2cac-42e0-a714-4042fff597f8-kube-api-access-nkpg8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7\" (UID: \"cda22477-2cac-42e0-a714-4042fff597f8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7" Jul 07 23:24:49.576734 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:49.576633 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7" Jul 07 23:24:49.719245 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:49.719220 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7"] Jul 07 23:24:49.721791 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:24:49.721761 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcda22477_2cac_42e0_a714_4042fff597f8.slice/crio-ada3ab090567dec134b21f039be05abfeea4d9d6cd749471d967aaa8d22ad449 WatchSource:0}: Error finding container ada3ab090567dec134b21f039be05abfeea4d9d6cd749471d967aaa8d22ad449: Status 404 returned error can't find the container with id ada3ab090567dec134b21f039be05abfeea4d9d6cd749471d967aaa8d22ad449 Jul 07 23:24:49.723147 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:49.723126 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 23:24:49.935847 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:49.935818 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7" event={"ID":"cda22477-2cac-42e0-a714-4042fff597f8","Type":"ContainerStarted","Data":"ada3ab090567dec134b21f039be05abfeea4d9d6cd749471d967aaa8d22ad449"} Jul 07 23:24:50.942803 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:50.942762 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7" event={"ID":"cda22477-2cac-42e0-a714-4042fff597f8","Type":"ContainerStarted","Data":"166d098f42de191a54a554ce171968d7265588df4b69fc2c7b3f30902dbe73f2"} Jul 07 23:24:50.964546 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:50.964464 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7" podStartSLOduration=1.7919638089999999 podStartE2EDuration="1.964440443s" totalImagesPullingTime="172.476634ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:24:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:24:50.962783032 +0000 UTC m=+672.372845283" watchObservedRunningTime="2026-07-07 23:24:50.964440443 +0000 UTC m=+672.374502684" Jul 07 23:24:59.577785 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:59.577734 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7" Jul 07 23:24:59.578252 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:59.577813 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7" Jul 07 23:24:59.590463 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:59.590428 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7" Jul 07 23:24:59.995771 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:24:59.995742 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7" Jul 07 23:25:05.338002 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:25:05.337969 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-njq52"] Jul 07 23:25:05.341734 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:25:05.341712 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-njq52" Jul 07 23:25:05.344599 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:25:05.344578 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 07 23:25:05.352037 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:25:05.352007 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-njq52"] Jul 07 23:25:05.435642 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:25:05.435602 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53dc4b06-618b-499c-b006-f80c35efe7af-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-njq52\" (UID: \"53dc4b06-618b-499c-b006-f80c35efe7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-njq52" Jul 07 23:25:05.435642 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:25:05.435646 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53dc4b06-618b-499c-b006-f80c35efe7af-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-njq52\" (UID: \"53dc4b06-618b-499c-b006-f80c35efe7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-njq52" Jul 07 23:25:05.435861 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:25:05.435768 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53dc4b06-618b-499c-b006-f80c35efe7af-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-njq52\" (UID: \"53dc4b06-618b-499c-b006-f80c35efe7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-njq52" Jul 07 23:25:05.435861 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:25:05.435794 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53dc4b06-618b-499c-b006-f80c35efe7af-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-njq52\" (UID: \"53dc4b06-618b-499c-b006-f80c35efe7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-njq52" Jul 07 23:25:05.435861 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:25:05.435835 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53dc4b06-618b-499c-b006-f80c35efe7af-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-njq52\" (UID: \"53dc4b06-618b-499c-b006-f80c35efe7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-njq52" Jul 07 23:25:05.435984 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:25:05.435911 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz5cj\" (UniqueName: \"kubernetes.io/projected/53dc4b06-618b-499c-b006-f80c35efe7af-kube-api-access-gz5cj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-njq52\" (UID: \"53dc4b06-618b-499c-b006-f80c35efe7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-njq52" Jul 07 23:25:05.536910 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:25:05.536866 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53dc4b06-618b-499c-b006-f80c35efe7af-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-njq52\" (UID: \"53dc4b06-618b-499c-b006-f80c35efe7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-njq52" Jul 07 23:25:05.536910 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:25:05.536909 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53dc4b06-618b-499c-b006-f80c35efe7af-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-njq52\" (UID: \"53dc4b06-618b-499c-b006-f80c35efe7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-njq52" Jul 07 23:25:05.537161 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:25:05.536936 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53dc4b06-618b-499c-b006-f80c35efe7af-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-njq52\" (UID: \"53dc4b06-618b-499c-b006-f80c35efe7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-njq52" Jul 07 23:25:05.537161 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:25:05.536982 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz5cj\" (UniqueName: \"kubernetes.io/projected/53dc4b06-618b-499c-b006-f80c35efe7af-kube-api-access-gz5cj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-njq52\" (UID: \"53dc4b06-618b-499c-b006-f80c35efe7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-njq52" Jul 07 23:25:05.537161 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:25:05.537028 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53dc4b06-618b-499c-b006-f80c35efe7af-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-njq52\" (UID: \"53dc4b06-618b-499c-b006-f80c35efe7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-njq52" Jul 07 23:25:05.537161 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:25:05.537056 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53dc4b06-618b-499c-b006-f80c35efe7af-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-njq52\" (UID: \"53dc4b06-618b-499c-b006-f80c35efe7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-njq52" Jul 07 23:25:05.537377 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:25:05.537351 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53dc4b06-618b-499c-b006-f80c35efe7af-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-njq52\" (UID: \"53dc4b06-618b-499c-b006-f80c35efe7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-njq52" Jul 07 23:25:05.537430 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:25:05.537364 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53dc4b06-618b-499c-b006-f80c35efe7af-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-njq52\" (UID: \"53dc4b06-618b-499c-b006-f80c35efe7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-njq52" Jul 07 23:25:05.537430 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:25:05.537403 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53dc4b06-618b-499c-b006-f80c35efe7af-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-njq52\" (UID: \"53dc4b06-618b-499c-b006-f80c35efe7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-njq52" Jul 07 23:25:05.539648 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:25:05.539624 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53dc4b06-618b-499c-b006-f80c35efe7af-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-njq52\" (UID: \"53dc4b06-618b-499c-b006-f80c35efe7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-njq52" Jul 07 23:25:05.539774 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:25:05.539745 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53dc4b06-618b-499c-b006-f80c35efe7af-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-njq52\" (UID: \"53dc4b06-618b-499c-b006-f80c35efe7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-njq52" Jul 07 23:25:05.546005 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:25:05.545971 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz5cj\" (UniqueName: \"kubernetes.io/projected/53dc4b06-618b-499c-b006-f80c35efe7af-kube-api-access-gz5cj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-njq52\" (UID: \"53dc4b06-618b-499c-b006-f80c35efe7af\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-njq52" Jul 07 23:25:05.653345 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:25:05.653248 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-njq52" Jul 07 23:25:05.796312 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:25:05.796187 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-njq52"] Jul 07 23:25:05.799228 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:25:05.799204 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53dc4b06_618b_499c_b006_f80c35efe7af.slice/crio-e08b084467680dc56f70079d45ec2722094a5dbc6dcc833a74e00fad9e65c2d4 WatchSource:0}: Error finding container e08b084467680dc56f70079d45ec2722094a5dbc6dcc833a74e00fad9e65c2d4: Status 404 returned error can't find the container with id e08b084467680dc56f70079d45ec2722094a5dbc6dcc833a74e00fad9e65c2d4 Jul 07 23:25:06.013246 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:25:06.013205 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-njq52" event={"ID":"53dc4b06-618b-499c-b006-f80c35efe7af","Type":"ContainerStarted","Data":"e08b084467680dc56f70079d45ec2722094a5dbc6dcc833a74e00fad9e65c2d4"} Jul 07 23:25:07.019097 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:25:07.019063 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-njq52" event={"ID":"53dc4b06-618b-499c-b006-f80c35efe7af","Type":"ContainerStarted","Data":"ebab4198e4adf14b9ec7aab547a92baaef5bf44c198c7bb4bf5ef4d4acc41a51"} Jul 07 23:25:07.039738 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:25:07.039685 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-njq52" podStartSLOduration=1.864218089 podStartE2EDuration="2.039667086s" totalImagesPullingTime="175.448997ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:25:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:25:07.038948857 +0000 UTC m=+688.449011095" watchObservedRunningTime="2026-07-07 23:25:07.039667086 +0000 UTC m=+688.449729324" Jul 07 23:25:15.653981 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:25:15.653934 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-njq52" Jul 07 23:25:15.654428 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:25:15.654005 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-njq52" Jul 07 23:25:15.668564 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:25:15.668536 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-njq52" Jul 07 23:25:16.071503 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:25:16.071445 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-njq52" Jul 07 23:32:18.947991 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:32:18.947952 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gdhwf"] Jul 07 23:32:18.948508 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:32:18.948186 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gdhwf" podUID="1a09eb62-1d7a-42c2-85b9-9ebd46af69f2" containerName="manager" containerID="cri-o://44b181cbfabb189c04d92b5a545e7a95ec8451d681863b8dd7d90b8fe6afcf06" gracePeriod=10 Jul 07 23:32:23.007009 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:32:23.006971 2564 generic.go:356] "Generic (PLEG): container finished" podID="1a09eb62-1d7a-42c2-85b9-9ebd46af69f2" containerID="44b181cbfabb189c04d92b5a545e7a95ec8451d681863b8dd7d90b8fe6afcf06" exitCode=0 Jul 07 23:32:23.007389 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:32:23.007038 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gdhwf" event={"ID":"1a09eb62-1d7a-42c2-85b9-9ebd46af69f2","Type":"ContainerDied","Data":"44b181cbfabb189c04d92b5a545e7a95ec8451d681863b8dd7d90b8fe6afcf06"} Jul 07 23:32:23.245109 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:32:23.245065 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gdhwf" podUID="1a09eb62-1d7a-42c2-85b9-9ebd46af69f2" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.24:8081/readyz\": dial tcp 10.134.0.24:8081: connect: connection refused" Jul 07 23:32:23.497926 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:32:23.497858 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gdhwf" Jul 07 23:32:23.574004 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:32:23.573963 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2swkg\" (UniqueName: \"kubernetes.io/projected/1a09eb62-1d7a-42c2-85b9-9ebd46af69f2-kube-api-access-2swkg\") pod \"1a09eb62-1d7a-42c2-85b9-9ebd46af69f2\" (UID: \"1a09eb62-1d7a-42c2-85b9-9ebd46af69f2\") " Jul 07 23:32:23.574195 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:32:23.574077 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a09eb62-1d7a-42c2-85b9-9ebd46af69f2-extensions-socket-volume\") pod \"1a09eb62-1d7a-42c2-85b9-9ebd46af69f2\" (UID: \"1a09eb62-1d7a-42c2-85b9-9ebd46af69f2\") " Jul 07 23:32:23.574468 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:32:23.574442 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a09eb62-1d7a-42c2-85b9-9ebd46af69f2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1a09eb62-1d7a-42c2-85b9-9ebd46af69f2" (UID: "1a09eb62-1d7a-42c2-85b9-9ebd46af69f2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 23:32:23.576314 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:32:23.576288 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a09eb62-1d7a-42c2-85b9-9ebd46af69f2-kube-api-access-2swkg" (OuterVolumeSpecName: "kube-api-access-2swkg") pod "1a09eb62-1d7a-42c2-85b9-9ebd46af69f2" (UID: "1a09eb62-1d7a-42c2-85b9-9ebd46af69f2"). InnerVolumeSpecName "kube-api-access-2swkg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 23:32:23.675301 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:32:23.675264 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a09eb62-1d7a-42c2-85b9-9ebd46af69f2-extensions-socket-volume\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:32:23.675301 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:32:23.675294 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2swkg\" (UniqueName: \"kubernetes.io/projected/1a09eb62-1d7a-42c2-85b9-9ebd46af69f2-kube-api-access-2swkg\") on node \"ip-10-0-143-195.ec2.internal\" DevicePath \"\"" Jul 07 23:32:24.013236 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:32:24.013198 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gdhwf" Jul 07 23:32:24.013236 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:32:24.013207 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gdhwf" event={"ID":"1a09eb62-1d7a-42c2-85b9-9ebd46af69f2","Type":"ContainerDied","Data":"caa5f43377df586c2326378059db7f75a25b679a029421c372647ee33faaba19"} Jul 07 23:32:24.013781 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:32:24.013305 2564 scope.go:117] "RemoveContainer" containerID="44b181cbfabb189c04d92b5a545e7a95ec8451d681863b8dd7d90b8fe6afcf06" Jul 07 23:32:24.037126 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:32:24.037094 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gdhwf"] Jul 07 23:32:24.040992 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:32:24.040963 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gdhwf"] Jul 07 23:32:25.117863 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:32:25.117828 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a09eb62-1d7a-42c2-85b9-9ebd46af69f2" path="/var/lib/kubelet/pods/1a09eb62-1d7a-42c2-85b9-9ebd46af69f2/volumes" Jul 07 23:33:20.103538 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:33:20.103438 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tbqtm"] Jul 07 23:33:20.103996 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:33:20.103811 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a09eb62-1d7a-42c2-85b9-9ebd46af69f2" containerName="manager" Jul 07 23:33:20.103996 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:33:20.103822 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a09eb62-1d7a-42c2-85b9-9ebd46af69f2" containerName="manager" Jul 07 23:33:20.103996 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:33:20.103877 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a09eb62-1d7a-42c2-85b9-9ebd46af69f2" containerName="manager" Jul 07 23:33:20.106559 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:33:20.106543 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tbqtm" Jul 07 23:33:20.111733 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:33:20.111708 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-m2xpk\"" Jul 07 23:33:20.112078 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:33:20.112058 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 23:33:20.112841 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:33:20.112819 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 23:33:20.119094 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:33:20.119070 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tbqtm"] Jul 07 23:33:20.188930 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:33:20.188880 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a953777a-065f-41a2-baf3-eca52d4d014d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tbqtm\" (UID: \"a953777a-065f-41a2-baf3-eca52d4d014d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tbqtm" Jul 07 23:33:20.189124 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:33:20.188950 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrmdw\" (UniqueName: \"kubernetes.io/projected/a953777a-065f-41a2-baf3-eca52d4d014d-kube-api-access-nrmdw\") pod \"kuadrant-operator-controller-manager-86878c769f-tbqtm\" (UID: \"a953777a-065f-41a2-baf3-eca52d4d014d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tbqtm" Jul 07 23:33:20.289665 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:33:20.289618 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a953777a-065f-41a2-baf3-eca52d4d014d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tbqtm\" (UID: \"a953777a-065f-41a2-baf3-eca52d4d014d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tbqtm" Jul 07 23:33:20.289839 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:33:20.289682 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrmdw\" (UniqueName: \"kubernetes.io/projected/a953777a-065f-41a2-baf3-eca52d4d014d-kube-api-access-nrmdw\") pod \"kuadrant-operator-controller-manager-86878c769f-tbqtm\" (UID: \"a953777a-065f-41a2-baf3-eca52d4d014d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tbqtm" Jul 07 23:33:20.290096 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:33:20.290072 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a953777a-065f-41a2-baf3-eca52d4d014d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tbqtm\" (UID: \"a953777a-065f-41a2-baf3-eca52d4d014d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tbqtm" Jul 07 23:33:20.301074 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:33:20.301041 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrmdw\" (UniqueName: \"kubernetes.io/projected/a953777a-065f-41a2-baf3-eca52d4d014d-kube-api-access-nrmdw\") pod \"kuadrant-operator-controller-manager-86878c769f-tbqtm\" (UID: \"a953777a-065f-41a2-baf3-eca52d4d014d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tbqtm" Jul 07 23:33:20.416582 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:33:20.416462 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tbqtm" Jul 07 23:33:20.590942 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:33:20.590907 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tbqtm"] Jul 07 23:33:20.594235 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:33:20.594204 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda953777a_065f_41a2_baf3_eca52d4d014d.slice/crio-b4e55137360c0cd6b9de192283a7b745ba283dc44b295049dfab9ed824cb2725 WatchSource:0}: Error finding container b4e55137360c0cd6b9de192283a7b745ba283dc44b295049dfab9ed824cb2725: Status 404 returned error can't find the container with id b4e55137360c0cd6b9de192283a7b745ba283dc44b295049dfab9ed824cb2725 Jul 07 23:33:21.279028 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:33:21.278992 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tbqtm" event={"ID":"a953777a-065f-41a2-baf3-eca52d4d014d","Type":"ContainerStarted","Data":"944ecce42e1989d1914bdd07451e163b490da751eac42c105037ac88b49aa0c9"} Jul 07 23:33:21.279523 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:33:21.279054 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tbqtm" event={"ID":"a953777a-065f-41a2-baf3-eca52d4d014d","Type":"ContainerStarted","Data":"b4e55137360c0cd6b9de192283a7b745ba283dc44b295049dfab9ed824cb2725"} Jul 07 23:33:21.279523 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:33:21.279086 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tbqtm" Jul 07 23:33:21.313415 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:33:21.313346 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tbqtm" podStartSLOduration=1.313324594 podStartE2EDuration="1.313324594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:33:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:33:21.313268492 +0000 UTC m=+1182.723330731" watchObservedRunningTime="2026-07-07 23:33:21.313324594 +0000 UTC m=+1182.723386833" Jul 07 23:33:32.286200 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:33:32.286163 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tbqtm" Jul 07 23:51:47.127440 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:51:47.127413 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c9859966d-m24rn_e715ba5d-1b60-421b-8ec6-563c818211e5/manager/0.log" Jul 07 23:51:47.135292 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:51:47.135274 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c9859966d-m24rn_e715ba5d-1b60-421b-8ec6-563c818211e5/copy-manifests/0.log" Jul 07 23:51:49.035516 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:51:49.035470 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-tbqtm_a953777a-065f-41a2-baf3-eca52d4d014d/manager/0.log" Jul 07 23:51:49.740923 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:51:49.740884 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zkbjz_a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec/discovery/0.log" Jul 07 23:51:51.278592 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:51:51.278563 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-nnl7k_3fb2bbdb-2f2f-4f90-92dc-cf82f11d14a6/payload-pre-processing/0.log" Jul 07 23:51:51.973870 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:51:51.973840 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-gtddc_67f43467-b664-4541-95f3-f26e8c896c29/main/0.log" Jul 07 23:51:52.198695 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:51:52.198653 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwftc7_cda22477-2cac-42e0-a714-4042fff597f8/main/0.log" Jul 07 23:51:52.307172 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:51:52.307081 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-njq52_53dc4b06-618b-499c-b006-f80c35efe7af/main/0.log" Jul 07 23:51:59.849669 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:51:59.849627 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rksdr_fb77d2b8-4f5a-446e-83bd-08a5ff41f2d8/global-pull-secret-syncer/0.log" Jul 07 23:52:00.014238 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:00.014205 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xdr5m_1d88ada1-2d4e-4b35-8079-8c893bbe41f7/konnectivity-agent/0.log" Jul 07 23:52:00.088357 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:00.088308 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-195.ec2.internal_9920e86aa1876c5dcd50b7872b122a7b/haproxy/0.log" Jul 07 23:52:06.072419 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:06.072382 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-tbqtm_a953777a-065f-41a2-baf3-eca52d4d014d/manager/0.log" Jul 07 23:52:07.898655 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:07.898630 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-fcfd9d454-fnqgp_4d261ede-e316-419e-9aa6-e1e0c1f944a6/metrics-server/0.log" Jul 07 23:52:07.932673 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:07.932647 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-5kdc2_dc85054e-a314-4443-bc6b-3abaf4c8ea9a/monitoring-plugin/0.log" Jul 07 23:52:08.044178 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:08.044147 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q2t8j_9e24f5f5-188d-40af-9696-7779fbe6c9a1/node-exporter/0.log" Jul 07 23:52:08.072704 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:08.072678 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q2t8j_9e24f5f5-188d-40af-9696-7779fbe6c9a1/kube-rbac-proxy/0.log" Jul 07 23:52:08.096333 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:08.096306 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q2t8j_9e24f5f5-188d-40af-9696-7779fbe6c9a1/init-textfile/0.log" Jul 07 23:52:08.291189 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:08.291157 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43153c5e-45ce-4949-8b44-ff18e13db248/prometheus/0.log" Jul 07 23:52:08.314356 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:08.314319 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43153c5e-45ce-4949-8b44-ff18e13db248/config-reloader/0.log" Jul 07 23:52:08.338737 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:08.338698 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43153c5e-45ce-4949-8b44-ff18e13db248/thanos-sidecar/0.log" Jul 07 23:52:08.365424 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:08.365391 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43153c5e-45ce-4949-8b44-ff18e13db248/kube-rbac-proxy-web/0.log" Jul 07 23:52:08.386822 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:08.386795 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43153c5e-45ce-4949-8b44-ff18e13db248/kube-rbac-proxy/0.log" Jul 07 23:52:08.409534 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:08.409509 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43153c5e-45ce-4949-8b44-ff18e13db248/kube-rbac-proxy-thanos/0.log" Jul 07 23:52:08.436885 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:08.436862 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43153c5e-45ce-4949-8b44-ff18e13db248/init-config-reloader/0.log" Jul 07 23:52:08.464861 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:08.464827 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-cknll_4e32f21f-f756-461f-8fd7-2dc3ac84a598/prometheus-operator/0.log" Jul 07 23:52:08.483947 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:08.483917 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-cknll_4e32f21f-f756-461f-8fd7-2dc3ac84a598/kube-rbac-proxy/0.log" Jul 07 23:52:08.625473 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:08.625393 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8f5d7964f-kzf7g_59c2d43c-d5cd-4095-aee9-01dd91973f0c/thanos-query/0.log" Jul 07 23:52:08.648197 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:08.648172 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8f5d7964f-kzf7g_59c2d43c-d5cd-4095-aee9-01dd91973f0c/kube-rbac-proxy-web/0.log" Jul 07 23:52:08.670408 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:08.670388 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8f5d7964f-kzf7g_59c2d43c-d5cd-4095-aee9-01dd91973f0c/kube-rbac-proxy/0.log" Jul 07 23:52:08.692277 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:08.692258 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8f5d7964f-kzf7g_59c2d43c-d5cd-4095-aee9-01dd91973f0c/prom-label-proxy/0.log" Jul 07 23:52:08.714873 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:08.714850 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8f5d7964f-kzf7g_59c2d43c-d5cd-4095-aee9-01dd91973f0c/kube-rbac-proxy-rules/0.log" Jul 07 23:52:08.739722 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:08.739689 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8f5d7964f-kzf7g_59c2d43c-d5cd-4095-aee9-01dd91973f0c/kube-rbac-proxy-metrics/0.log" Jul 07 23:52:09.964645 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:09.964614 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dx64r/perf-node-gather-daemonset-tnx2n"] Jul 07 23:52:09.968452 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:09.968430 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dx64r/perf-node-gather-daemonset-tnx2n" Jul 07 23:52:09.971153 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:09.971134 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dx64r\"/\"kube-root-ca.crt\"" Jul 07 23:52:09.971259 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:09.971190 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dx64r\"/\"openshift-service-ca.crt\"" Jul 07 23:52:09.971259 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:09.971204 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dx64r\"/\"default-dockercfg-52fsr\"" Jul 07 23:52:09.977178 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:09.977157 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dx64r/perf-node-gather-daemonset-tnx2n"] Jul 07 23:52:10.071017 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:10.070975 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9af95cdb-6f41-426b-8bec-6fbb2bed4084-sys\") pod \"perf-node-gather-daemonset-tnx2n\" (UID: \"9af95cdb-6f41-426b-8bec-6fbb2bed4084\") " pod="openshift-must-gather-dx64r/perf-node-gather-daemonset-tnx2n" Jul 07 23:52:10.071017 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:10.071019 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9af95cdb-6f41-426b-8bec-6fbb2bed4084-podres\") pod \"perf-node-gather-daemonset-tnx2n\" (UID: \"9af95cdb-6f41-426b-8bec-6fbb2bed4084\") " pod="openshift-must-gather-dx64r/perf-node-gather-daemonset-tnx2n" Jul 07 23:52:10.071246 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:10.071049 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9af95cdb-6f41-426b-8bec-6fbb2bed4084-proc\") pod \"perf-node-gather-daemonset-tnx2n\" (UID: \"9af95cdb-6f41-426b-8bec-6fbb2bed4084\") " pod="openshift-must-gather-dx64r/perf-node-gather-daemonset-tnx2n" Jul 07 23:52:10.071246 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:10.071080 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9vd6\" (UniqueName: \"kubernetes.io/projected/9af95cdb-6f41-426b-8bec-6fbb2bed4084-kube-api-access-x9vd6\") pod \"perf-node-gather-daemonset-tnx2n\" (UID: \"9af95cdb-6f41-426b-8bec-6fbb2bed4084\") " pod="openshift-must-gather-dx64r/perf-node-gather-daemonset-tnx2n" Jul 07 23:52:10.071246 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:10.071101 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9af95cdb-6f41-426b-8bec-6fbb2bed4084-lib-modules\") pod \"perf-node-gather-daemonset-tnx2n\" (UID: \"9af95cdb-6f41-426b-8bec-6fbb2bed4084\") " pod="openshift-must-gather-dx64r/perf-node-gather-daemonset-tnx2n" Jul 07 23:52:10.171606 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:10.171567 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9af95cdb-6f41-426b-8bec-6fbb2bed4084-sys\") pod \"perf-node-gather-daemonset-tnx2n\" (UID: \"9af95cdb-6f41-426b-8bec-6fbb2bed4084\") " pod="openshift-must-gather-dx64r/perf-node-gather-daemonset-tnx2n" Jul 07 23:52:10.171606 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:10.171609 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9af95cdb-6f41-426b-8bec-6fbb2bed4084-podres\") pod \"perf-node-gather-daemonset-tnx2n\" (UID: \"9af95cdb-6f41-426b-8bec-6fbb2bed4084\") " pod="openshift-must-gather-dx64r/perf-node-gather-daemonset-tnx2n" Jul 07 23:52:10.171812 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:10.171648 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9af95cdb-6f41-426b-8bec-6fbb2bed4084-proc\") pod \"perf-node-gather-daemonset-tnx2n\" (UID: \"9af95cdb-6f41-426b-8bec-6fbb2bed4084\") " pod="openshift-must-gather-dx64r/perf-node-gather-daemonset-tnx2n" Jul 07 23:52:10.171812 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:10.171682 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9vd6\" (UniqueName: \"kubernetes.io/projected/9af95cdb-6f41-426b-8bec-6fbb2bed4084-kube-api-access-x9vd6\") pod \"perf-node-gather-daemonset-tnx2n\" (UID: \"9af95cdb-6f41-426b-8bec-6fbb2bed4084\") " pod="openshift-must-gather-dx64r/perf-node-gather-daemonset-tnx2n" Jul 07 23:52:10.171812 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:10.171694 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9af95cdb-6f41-426b-8bec-6fbb2bed4084-sys\") pod \"perf-node-gather-daemonset-tnx2n\" (UID: \"9af95cdb-6f41-426b-8bec-6fbb2bed4084\") " pod="openshift-must-gather-dx64r/perf-node-gather-daemonset-tnx2n" Jul 07 23:52:10.171812 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:10.171705 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9af95cdb-6f41-426b-8bec-6fbb2bed4084-lib-modules\") pod \"perf-node-gather-daemonset-tnx2n\" (UID: \"9af95cdb-6f41-426b-8bec-6fbb2bed4084\") " pod="openshift-must-gather-dx64r/perf-node-gather-daemonset-tnx2n" Jul 07 23:52:10.171812 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:10.171765 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9af95cdb-6f41-426b-8bec-6fbb2bed4084-proc\") pod \"perf-node-gather-daemonset-tnx2n\" (UID: \"9af95cdb-6f41-426b-8bec-6fbb2bed4084\") " pod="openshift-must-gather-dx64r/perf-node-gather-daemonset-tnx2n" Jul 07 23:52:10.171974 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:10.171823 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9af95cdb-6f41-426b-8bec-6fbb2bed4084-podres\") pod \"perf-node-gather-daemonset-tnx2n\" (UID: \"9af95cdb-6f41-426b-8bec-6fbb2bed4084\") " pod="openshift-must-gather-dx64r/perf-node-gather-daemonset-tnx2n" Jul 07 23:52:10.171974 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:10.171879 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9af95cdb-6f41-426b-8bec-6fbb2bed4084-lib-modules\") pod \"perf-node-gather-daemonset-tnx2n\" (UID: \"9af95cdb-6f41-426b-8bec-6fbb2bed4084\") " pod="openshift-must-gather-dx64r/perf-node-gather-daemonset-tnx2n" Jul 07 23:52:10.181166 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:10.181143 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9vd6\" (UniqueName: \"kubernetes.io/projected/9af95cdb-6f41-426b-8bec-6fbb2bed4084-kube-api-access-x9vd6\") pod \"perf-node-gather-daemonset-tnx2n\" (UID: \"9af95cdb-6f41-426b-8bec-6fbb2bed4084\") " pod="openshift-must-gather-dx64r/perf-node-gather-daemonset-tnx2n" Jul 07 23:52:10.279461 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:10.279434 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dx64r/perf-node-gather-daemonset-tnx2n" Jul 07 23:52:10.418207 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:10.418184 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dx64r/perf-node-gather-daemonset-tnx2n"] Jul 07 23:52:10.420809 ip-10-0-143-195 kubenswrapper[2564]: W0707 23:52:10.420784 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9af95cdb_6f41_426b_8bec_6fbb2bed4084.slice/crio-4689b843664eaab0ea030104bd8101227295c6bac6edffa251bcc27e39abfd3b WatchSource:0}: Error finding container 4689b843664eaab0ea030104bd8101227295c6bac6edffa251bcc27e39abfd3b: Status 404 returned error can't find the container with id 4689b843664eaab0ea030104bd8101227295c6bac6edffa251bcc27e39abfd3b Jul 07 23:52:10.980630 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:10.980596 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-wvhgt_9f8d8912-c527-402a-b669-984a4335f0fe/download-server/0.log" Jul 07 23:52:11.352698 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:11.352603 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dx64r/perf-node-gather-daemonset-tnx2n" event={"ID":"9af95cdb-6f41-426b-8bec-6fbb2bed4084","Type":"ContainerStarted","Data":"8e6e0b5f3122b132931a1b423c79dd0c26c4e7ade584827d51fa2380e6540248"} Jul 07 23:52:11.352698 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:11.352653 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dx64r/perf-node-gather-daemonset-tnx2n" event={"ID":"9af95cdb-6f41-426b-8bec-6fbb2bed4084","Type":"ContainerStarted","Data":"4689b843664eaab0ea030104bd8101227295c6bac6edffa251bcc27e39abfd3b"} Jul 07 23:52:11.352888 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:11.352711 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dx64r/perf-node-gather-daemonset-tnx2n" Jul 07 23:52:11.370338 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:11.370293 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dx64r/perf-node-gather-daemonset-tnx2n" podStartSLOduration=2.370279467 podStartE2EDuration="2.370279467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:52:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:52:11.36976458 +0000 UTC m=+2312.779826818" watchObservedRunningTime="2026-07-07 23:52:11.370279467 +0000 UTC m=+2312.780341706" Jul 07 23:52:12.693945 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:12.693905 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zqnmf_dd9b2457-0512-4b0c-8f68-5e2b0091ed3e/dns/0.log" Jul 07 23:52:12.718052 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:12.718015 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zqnmf_dd9b2457-0512-4b0c-8f68-5e2b0091ed3e/kube-rbac-proxy/0.log" Jul 07 23:52:12.789654 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:12.789624 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r7trc_b2a9d0c8-6e1d-4740-8066-0f04d6e9d978/dns-node-resolver/0.log" Jul 07 23:52:13.347350 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:13.347303 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-68cf46c6d4-xqn8z_3bc75ab8-cfa1-489d-a3ad-9386b3bab5e3/registry/0.log" Jul 07 23:52:13.427145 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:13.427105 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mkht6_97e34b22-568f-4ca3-b8ca-a38ab8ed4eb2/node-ca/0.log" Jul 07 23:52:14.527423 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:14.527392 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zkbjz_a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec/discovery/0.log" Jul 07 23:52:14.726584 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:14.726544 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-nnl7k_3fb2bbdb-2f2f-4f90-92dc-cf82f11d14a6/payload-pre-processing/0.log" Jul 07 23:52:15.536581 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:15.536548 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lqh8p_b58e842e-195e-445f-b167-5f9a98fa3778/serve-healthcheck-canary/0.log" Jul 07 23:52:16.204963 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:16.204927 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rk84p_896a6145-9c7e-4bb8-9e71-d35415f005dc/kube-rbac-proxy/0.log" Jul 07 23:52:16.228371 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:16.228343 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rk84p_896a6145-9c7e-4bb8-9e71-d35415f005dc/exporter/0.log" Jul 07 23:52:16.252342 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:16.252299 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rk84p_896a6145-9c7e-4bb8-9e71-d35415f005dc/extractor/0.log" Jul 07 23:52:17.367084 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:17.367052 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dx64r/perf-node-gather-daemonset-tnx2n" Jul 07 23:52:19.145021 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:19.144928 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c9859966d-m24rn_e715ba5d-1b60-421b-8ec6-563c818211e5/manager/0.log" Jul 07 23:52:19.173399 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:19.173372 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c9859966d-m24rn_e715ba5d-1b60-421b-8ec6-563c818211e5/copy-manifests/0.log" Jul 07 23:52:20.076417 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:20.076381 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zkbjz_a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec/discovery/0.log" Jul 07 23:52:20.230996 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:20.230964 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-nnl7k_3fb2bbdb-2f2f-4f90-92dc-cf82f11d14a6/payload-pre-processing/0.log" Jul 07 23:52:20.560306 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:20.560280 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7895d9b5-lkzpv_e76f1a6f-1cac-4367-bc44-4b6411480f07/manager/0.log" Jul 07 23:52:21.672669 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:21.672636 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zkbjz_a923d7ce-a66a-440b-9ad2-2ce5a03ae7ec/discovery/0.log" Jul 07 23:52:21.834414 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:21.834318 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-nnl7k_3fb2bbdb-2f2f-4f90-92dc-cf82f11d14a6/payload-pre-processing/0.log" Jul 07 23:52:27.028179 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:27.028151 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hg4n2_7839699b-d95d-4e11-bac2-a1cca78e8b3c/kube-multus-additional-cni-plugins/0.log" Jul 07 23:52:27.052448 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:27.052418 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hg4n2_7839699b-d95d-4e11-bac2-a1cca78e8b3c/egress-router-binary-copy/0.log" Jul 07 23:52:27.077853 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:27.077827 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hg4n2_7839699b-d95d-4e11-bac2-a1cca78e8b3c/cni-plugins/0.log" Jul 07 23:52:27.099545 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:27.099510 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hg4n2_7839699b-d95d-4e11-bac2-a1cca78e8b3c/bond-cni-plugin/0.log" Jul 07 23:52:27.122635 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:27.122601 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hg4n2_7839699b-d95d-4e11-bac2-a1cca78e8b3c/routeoverride-cni/0.log" Jul 07 23:52:27.144715 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:27.144685 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hg4n2_7839699b-d95d-4e11-bac2-a1cca78e8b3c/whereabouts-cni-bincopy/0.log" Jul 07 23:52:27.167845 ip-10-0-143-195 kubenswrapper[2564]: I0707 23:52:27.167814 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hg4n2_7839699b-d95d-4e11-bac2-a1cca78e8b3c/whereabouts-cni/0.log"