Jul 28 15:32:58.427455 ip-10-0-141-87 systemd[1]: Starting Kubernetes Kubelet... Jul 28 15:32:58.765677 ip-10-0-141-87 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 15:32:58.765677 ip-10-0-141-87 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 15:32:58.765677 ip-10-0-141-87 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 15:32:58.765677 ip-10-0-141-87 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 15:32:58.765677 ip-10-0-141-87 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 15:32:58.766559 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.766476 2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 15:32:58.771597 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771577 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 15:32:58.771597 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771593 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 15:32:58.771597 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771598 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 15:32:58.771597 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771602 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 15:32:58.771597 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771606 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 15:32:58.771876 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771610 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 15:32:58.771876 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771614 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 15:32:58.771876 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771618 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 15:32:58.771876 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771622 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 15:32:58.771876 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771626 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 15:32:58.771876 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771629 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 15:32:58.771876 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771633 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 15:32:58.771876 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771636 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 15:32:58.771876 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771641 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 15:32:58.771876 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771646 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 15:32:58.771876 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771650 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 15:32:58.771876 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771653 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 15:32:58.771876 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771657 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 15:32:58.771876 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771661 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 15:32:58.771876 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771665 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 15:32:58.771876 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771669 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 15:32:58.771876 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771673 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 15:32:58.771876 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771677 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 15:32:58.771876 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771681 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 15:32:58.771876 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771685 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 15:32:58.772742 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771689 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 15:32:58.772742 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771693 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 15:32:58.772742 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771699 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 15:32:58.772742 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771703 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 15:32:58.772742 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771707 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 15:32:58.772742 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771711 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 15:32:58.772742 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771715 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 15:32:58.772742 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771719 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 15:32:58.772742 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771723 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 15:32:58.772742 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771727 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 15:32:58.772742 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771731 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 15:32:58.772742 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771736 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 28 15:32:58.772742 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771740 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 15:32:58.772742 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771745 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 15:32:58.772742 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771749 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 15:32:58.772742 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771753 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 15:32:58.772742 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771757 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 15:32:58.772742 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771762 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 15:32:58.772742 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771766 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 15:32:58.772742 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771770 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 15:32:58.773478 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771774 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 15:32:58.773478 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771778 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 15:32:58.773478 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771784 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 15:32:58.773478 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771788 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 15:32:58.773478 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771792 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 15:32:58.773478 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771796 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 15:32:58.773478 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771800 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 15:32:58.773478 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771805 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 15:32:58.773478 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771812 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 15:32:58.773478 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771818 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 15:32:58.773478 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771823 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 15:32:58.773478 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771827 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 15:32:58.773478 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771833 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 15:32:58.773478 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771837 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 15:32:58.773478 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771841 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 15:32:58.773478 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771846 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 15:32:58.773478 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771851 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 15:32:58.773478 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771855 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 15:32:58.773478 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771860 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 15:32:58.773934 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771864 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 15:32:58.773934 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771869 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 15:32:58.773934 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771873 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 15:32:58.773934 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771877 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 15:32:58.773934 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771881 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 15:32:58.773934 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771886 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 15:32:58.773934 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771890 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 15:32:58.773934 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771895 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 15:32:58.773934 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771899 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 15:32:58.773934 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771904 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 15:32:58.773934 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771908 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 15:32:58.773934 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771913 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 15:32:58.773934 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771917 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 15:32:58.773934 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771922 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 15:32:58.773934 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771926 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 15:32:58.773934 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771930 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 15:32:58.773934 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771934 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 15:32:58.773934 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771943 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 15:32:58.773934 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771949 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 15:32:58.774416 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771954 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 15:32:58.774416 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771959 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 15:32:58.774416 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771963 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 15:32:58.774416 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771970 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 15:32:58.774416 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771976 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 15:32:58.774416 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771981 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 15:32:58.774416 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771986 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 15:32:58.774416 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771991 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 15:32:58.774416 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771995 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 15:32:58.774416 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.771999 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 15:32:58.774416 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.772004 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 15:32:58.774416 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.772009 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 15:32:58.774416 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.772013 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 15:32:58.774416 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.772017 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 15:32:58.774416 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.772021 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 15:32:58.774416 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.772026 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 15:32:58.775084 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775066 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 15:32:58.775084 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775084 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 15:32:58.775138 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775088 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 15:32:58.775138 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775091 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 15:32:58.775138 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775094 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 15:32:58.775138 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775096 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 15:32:58.775138 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775099 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 15:32:58.775138 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775101 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 15:32:58.775138 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775104 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 15:32:58.775138 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775107 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 15:32:58.775138 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775109 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 15:32:58.775138 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775112 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 15:32:58.775138 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775114 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 15:32:58.775138 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775117 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 15:32:58.775138 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775119 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 15:32:58.775138 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775122 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 15:32:58.775138 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775125 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 15:32:58.775138 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775128 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 15:32:58.775138 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775133 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 15:32:58.775138 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775136 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 15:32:58.775138 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775138 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 15:32:58.775138 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775141 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 15:32:58.775654 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775144 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 15:32:58.775654 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775146 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 15:32:58.775654 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775149 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 15:32:58.775654 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775152 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 15:32:58.775654 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775155 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 15:32:58.775654 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775157 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 15:32:58.775654 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775159 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 15:32:58.775654 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775176 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 15:32:58.775654 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775180 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 15:32:58.775654 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775182 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 15:32:58.775654 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775185 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 15:32:58.775654 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775187 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 15:32:58.775654 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775190 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 15:32:58.775654 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775192 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 15:32:58.775654 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775195 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 15:32:58.775654 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775197 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 15:32:58.775654 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775199 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 15:32:58.775654 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775202 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 15:32:58.775654 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775205 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 15:32:58.775654 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775207 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 15:32:58.776214 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775209 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 15:32:58.776214 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775212 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 15:32:58.776214 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775214 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 15:32:58.776214 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775217 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 15:32:58.776214 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775219 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 15:32:58.776214 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775221 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 15:32:58.776214 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775224 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 15:32:58.776214 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775227 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 15:32:58.776214 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775230 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 15:32:58.776214 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775233 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 15:32:58.776214 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775237 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 15:32:58.776214 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775242 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 15:32:58.776214 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775245 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 15:32:58.776214 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775248 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 15:32:58.776214 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775252 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 15:32:58.776214 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775255 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 15:32:58.776214 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775257 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 15:32:58.776214 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775261 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 15:32:58.776214 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775263 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 15:32:58.776664 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775266 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 15:32:58.776664 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775269 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 15:32:58.776664 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775272 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 15:32:58.776664 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775275 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 15:32:58.776664 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775278 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 15:32:58.776664 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775280 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 15:32:58.776664 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775283 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 15:32:58.776664 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775285 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 15:32:58.776664 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775288 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 15:32:58.776664 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775290 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 28 15:32:58.776664 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775293 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 15:32:58.776664 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775295 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 15:32:58.776664 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775297 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 15:32:58.776664 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775301 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 15:32:58.776664 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775305 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 15:32:58.776664 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775308 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 15:32:58.776664 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775311 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 15:32:58.776664 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775314 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 15:32:58.776664 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775316 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 15:32:58.777143 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775319 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 15:32:58.777143 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775321 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 15:32:58.777143 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775324 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 15:32:58.777143 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775327 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 15:32:58.777143 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775329 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 15:32:58.777143 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775332 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 15:32:58.777143 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775335 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 15:32:58.777143 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775341 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 15:32:58.777143 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775345 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 15:32:58.777143 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775348 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 15:32:58.777143 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775350 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 15:32:58.777143 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775353 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 15:32:58.777143 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775356 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 15:32:58.777143 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775358 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 15:32:58.777143 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775361 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 15:32:58.777143 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775363 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 15:32:58.777143 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775366 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 15:32:58.777143 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775369 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 15:32:58.777143 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775371 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 15:32:58.777143 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775767 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 15:32:58.777634 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775772 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 15:32:58.777634 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775774 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 15:32:58.777634 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775779 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 15:32:58.777634 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775782 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 15:32:58.777634 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775785 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 15:32:58.777634 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775788 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 15:32:58.777634 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775791 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 15:32:58.777634 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775793 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 15:32:58.777634 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775796 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 15:32:58.777634 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775799 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 15:32:58.777634 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775802 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 15:32:58.777634 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775805 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 15:32:58.777634 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775808 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 15:32:58.777634 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775810 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 15:32:58.777634 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775813 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 15:32:58.777634 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775817 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 15:32:58.777634 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775819 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 15:32:58.777634 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775822 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 15:32:58.777634 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775826 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 15:32:58.778096 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775830 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 15:32:58.778096 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775834 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 15:32:58.778096 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775837 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 15:32:58.778096 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775839 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 15:32:58.778096 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775842 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 15:32:58.778096 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775845 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 15:32:58.778096 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775847 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 15:32:58.778096 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775850 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 15:32:58.778096 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775852 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 15:32:58.778096 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775855 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 15:32:58.778096 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775857 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 15:32:58.778096 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775860 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 15:32:58.778096 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775862 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 15:32:58.778096 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775865 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 15:32:58.778096 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775867 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 15:32:58.778096 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775870 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 15:32:58.778096 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775872 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 15:32:58.778096 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775874 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 15:32:58.778096 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775877 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 15:32:58.778096 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775879 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 15:32:58.778630 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775881 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 15:32:58.778630 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775885 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 15:32:58.778630 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775887 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 15:32:58.778630 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775890 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 15:32:58.778630 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775892 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 15:32:58.778630 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775895 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 15:32:58.778630 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775897 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 15:32:58.778630 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775900 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 15:32:58.778630 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775902 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 15:32:58.778630 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775906 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 15:32:58.778630 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775909 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 15:32:58.778630 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775911 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 15:32:58.778630 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775914 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 15:32:58.778630 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775917 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 15:32:58.778630 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775920 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 15:32:58.778630 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775922 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 15:32:58.778630 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775924 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 15:32:58.778630 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775927 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 15:32:58.778630 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775929 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 15:32:58.778630 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775932 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 15:32:58.779100 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775934 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 15:32:58.779100 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775936 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 15:32:58.779100 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775939 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 15:32:58.779100 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775941 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 15:32:58.779100 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775944 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 15:32:58.779100 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775946 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 15:32:58.779100 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775949 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 15:32:58.779100 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775951 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 15:32:58.779100 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775954 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 15:32:58.779100 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775956 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 15:32:58.779100 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775958 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 28 15:32:58.779100 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775961 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 15:32:58.779100 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775963 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 15:32:58.779100 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775966 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 15:32:58.779100 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775968 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 15:32:58.779100 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775970 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 15:32:58.779100 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775975 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 15:32:58.779100 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775979 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 15:32:58.779100 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775982 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 15:32:58.779588 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775985 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 15:32:58.779588 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775987 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 15:32:58.779588 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775990 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 15:32:58.779588 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775994 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 15:32:58.779588 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775996 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 15:32:58.779588 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.775999 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 15:32:58.779588 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776002 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 15:32:58.779588 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776005 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 15:32:58.779588 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776008 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 15:32:58.779588 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776010 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 15:32:58.779588 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776013 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 15:32:58.779588 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776016 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 15:32:58.779588 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776018 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 15:32:58.779588 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776020 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 15:32:58.779588 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776023 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 15:32:58.779588 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776025 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 15:32:58.779588 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776028 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 15:32:58.779588 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776030 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 15:32:58.779588 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776032 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 15:32:58.779588 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776035 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 15:32:58.780118 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776107 2554 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 15:32:58.780118 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776115 2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 15:32:58.780118 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776120 2554 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 15:32:58.780118 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776124 2554 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 15:32:58.780118 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776128 2554 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 15:32:58.780118 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776131 2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 15:32:58.780118 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776135 2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 15:32:58.780118 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776139 2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 15:32:58.780118 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776142 2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 15:32:58.780118 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776145 2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 15:32:58.780118 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776150 2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 15:32:58.780118 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776153 2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 15:32:58.780118 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776156 2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 15:32:58.780118 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776159 2554 flags.go:64] FLAG: --cgroup-root="" Jul 28 15:32:58.780118 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776179 2554 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 15:32:58.780118 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776184 2554 flags.go:64] FLAG: --client-ca-file="" Jul 28 15:32:58.780118 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776189 2554 flags.go:64] FLAG: --cloud-provider="external" Jul 28 15:32:58.780118 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776194 2554 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 15:32:58.780118 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776199 2554 flags.go:64] FLAG: --cluster-domain="" Jul 28 15:32:58.780118 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776202 2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 15:32:58.780118 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776205 2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 15:32:58.780118 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776208 2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 15:32:58.780118 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776211 2554 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 15:32:58.780118 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776215 2554 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 15:32:58.780701 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776218 2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 15:32:58.780701 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776222 2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 15:32:58.780701 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776225 2554 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 15:32:58.780701 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776228 2554 flags.go:64] FLAG: --contention-profiling="false" Jul 28 15:32:58.780701 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776231 2554 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 15:32:58.780701 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776234 2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 15:32:58.780701 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776237 2554 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 15:32:58.780701 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776240 2554 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 15:32:58.780701 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776243 2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 15:32:58.780701 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776247 2554 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 15:32:58.780701 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776249 2554 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 15:32:58.780701 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776252 2554 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 15:32:58.780701 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776255 2554 flags.go:64] FLAG: --enable-server="true" Jul 28 15:32:58.780701 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776258 2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 15:32:58.780701 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776262 2554 flags.go:64] FLAG: --event-burst="100" Jul 28 15:32:58.780701 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776265 2554 flags.go:64] FLAG: --event-qps="50" Jul 28 15:32:58.780701 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776268 2554 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 15:32:58.780701 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776270 2554 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 15:32:58.780701 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776273 2554 flags.go:64] FLAG: --eviction-hard="" Jul 28 15:32:58.780701 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776277 2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 15:32:58.780701 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776280 2554 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 15:32:58.780701 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776283 2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 15:32:58.780701 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776286 2554 flags.go:64] FLAG: --eviction-soft="" Jul 28 15:32:58.780701 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776288 2554 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 15:32:58.780701 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776291 2554 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 15:32:58.781341 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776295 2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 15:32:58.781341 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776299 2554 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 15:32:58.781341 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776301 2554 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 15:32:58.781341 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776304 2554 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 15:32:58.781341 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776307 2554 flags.go:64] FLAG: --feature-gates="" Jul 28 15:32:58.781341 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776310 2554 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 15:32:58.781341 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776313 2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 15:32:58.781341 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776316 2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 15:32:58.781341 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776319 2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 15:32:58.781341 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776322 2554 flags.go:64] FLAG: --healthz-port="10248" Jul 28 15:32:58.781341 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776325 2554 flags.go:64] FLAG: --help="false" Jul 28 15:32:58.781341 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776328 2554 flags.go:64] FLAG: --hostname-override="ip-10-0-141-87.ec2.internal" Jul 28 15:32:58.781341 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776331 2554 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 15:32:58.781341 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776334 2554 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 15:32:58.781341 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776336 2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 15:32:58.781341 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776342 2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 15:32:58.781341 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776345 2554 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 15:32:58.781341 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776348 2554 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 15:32:58.781341 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776351 2554 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 15:32:58.781341 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776353 2554 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 15:32:58.781341 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776356 2554 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 15:32:58.781341 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776359 2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 15:32:58.781341 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776362 2554 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 15:32:58.781341 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776365 2554 flags.go:64] FLAG: --kube-reserved="" Jul 28 15:32:58.781929 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776368 2554 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 15:32:58.781929 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776371 2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 15:32:58.781929 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776374 2554 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 15:32:58.781929 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776376 2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 15:32:58.781929 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776379 2554 flags.go:64] FLAG: --lock-file="" Jul 28 15:32:58.781929 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776382 2554 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 15:32:58.781929 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776385 2554 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 15:32:58.781929 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776388 2554 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 15:32:58.781929 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776393 2554 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 15:32:58.781929 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776397 2554 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 15:32:58.781929 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776400 2554 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 15:32:58.781929 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776403 2554 flags.go:64] FLAG: --logging-format="text" Jul 28 15:32:58.781929 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776406 2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 15:32:58.781929 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776409 2554 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 15:32:58.781929 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776412 2554 flags.go:64] FLAG: --manifest-url="" Jul 28 15:32:58.781929 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776414 2554 flags.go:64] FLAG: --manifest-url-header="" Jul 28 15:32:58.781929 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776419 2554 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 15:32:58.781929 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776421 2554 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 15:32:58.781929 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776425 2554 flags.go:64] FLAG: --max-pods="110" Jul 28 15:32:58.781929 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776428 2554 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 15:32:58.781929 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776431 2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 15:32:58.781929 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776434 2554 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 15:32:58.781929 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776436 2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 15:32:58.781929 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776441 2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 15:32:58.781929 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776444 2554 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 15:32:58.782561 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776446 2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 15:32:58.782561 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776453 2554 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 15:32:58.782561 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776456 2554 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 15:32:58.782561 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776459 2554 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 15:32:58.782561 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776463 2554 flags.go:64] FLAG: --pod-cidr="" Jul 28 15:32:58.782561 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776465 2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 15:32:58.782561 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776471 2554 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 15:32:58.782561 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776473 2554 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 15:32:58.782561 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776476 2554 flags.go:64] FLAG: --pods-per-core="0" Jul 28 15:32:58.782561 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776479 2554 flags.go:64] FLAG: --port="10250" Jul 28 15:32:58.782561 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776482 2554 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 15:32:58.782561 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776485 2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-061bbb816332105f2" Jul 28 15:32:58.782561 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776488 2554 flags.go:64] FLAG: --qos-reserved="" Jul 28 15:32:58.782561 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776490 2554 flags.go:64] FLAG: --read-only-port="10255" Jul 28 15:32:58.782561 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776493 2554 flags.go:64] FLAG: --register-node="true" Jul 28 15:32:58.782561 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776496 2554 flags.go:64] FLAG: --register-with-taints="" Jul 28 15:32:58.782561 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776499 2554 flags.go:64] FLAG: --registry-burst="10" Jul 28 15:32:58.782561 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776502 2554 flags.go:64] FLAG: --registry-qps="5" Jul 28 15:32:58.782561 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776505 2554 flags.go:64] FLAG: --reserved-cpus="" Jul 28 15:32:58.782561 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776508 2554 flags.go:64] FLAG: --reserved-memory="" Jul 28 15:32:58.782561 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776511 2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 15:32:58.782561 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776514 2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 15:32:58.782561 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776517 2554 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 15:32:58.782561 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776519 2554 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 15:32:58.782561 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776522 2554 flags.go:64] FLAG: --runonce="false" Jul 28 15:32:58.783158 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776525 2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 15:32:58.783158 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776527 2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 15:32:58.783158 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776530 2554 flags.go:64] FLAG: --seccomp-default="false" Jul 28 15:32:58.783158 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776533 2554 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 15:32:58.783158 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776536 2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 15:32:58.783158 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776540 2554 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 15:32:58.783158 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776542 2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 15:32:58.783158 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776545 2554 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 15:32:58.783158 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776548 2554 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 15:32:58.783158 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776551 2554 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 15:32:58.783158 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776553 2554 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 15:32:58.783158 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776556 2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 15:32:58.783158 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776559 2554 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 15:32:58.783158 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776562 2554 flags.go:64] FLAG: --system-cgroups="" Jul 28 15:32:58.783158 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776565 2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 15:32:58.783158 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776570 2554 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 15:32:58.783158 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776573 2554 flags.go:64] FLAG: --tls-cert-file="" Jul 28 15:32:58.783158 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776576 2554 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 15:32:58.783158 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776580 2554 flags.go:64] FLAG: --tls-min-version="" Jul 28 15:32:58.783158 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776583 2554 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 15:32:58.783158 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776585 2554 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 15:32:58.783158 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776588 2554 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 15:32:58.783158 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776591 2554 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 15:32:58.783158 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776593 2554 flags.go:64] FLAG: --v="2" Jul 28 15:32:58.783158 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776597 2554 flags.go:64] FLAG: --version="false" Jul 28 15:32:58.783864 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776601 2554 flags.go:64] FLAG: --vmodule="" Jul 28 15:32:58.783864 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776605 2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 15:32:58.783864 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.776608 2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 15:32:58.783864 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776741 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 15:32:58.783864 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776746 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 15:32:58.783864 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776749 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 15:32:58.783864 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776752 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 15:32:58.783864 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776756 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 15:32:58.783864 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776758 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 15:32:58.783864 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776761 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 15:32:58.783864 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776763 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 15:32:58.783864 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776766 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 15:32:58.783864 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776770 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 15:32:58.783864 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776772 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 15:32:58.783864 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776775 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 15:32:58.783864 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776778 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 15:32:58.783864 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776782 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 28 15:32:58.783864 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776785 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 15:32:58.783864 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776788 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 15:32:58.783864 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776791 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 15:32:58.784370 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776793 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 15:32:58.784370 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776796 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 15:32:58.784370 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776798 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 15:32:58.784370 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776800 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 15:32:58.784370 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776803 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 15:32:58.784370 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776806 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 15:32:58.784370 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776808 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 15:32:58.784370 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776810 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 15:32:58.784370 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776813 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 15:32:58.784370 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776816 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 15:32:58.784370 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776818 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 15:32:58.784370 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776821 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 15:32:58.784370 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776823 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 15:32:58.784370 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776827 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 15:32:58.784370 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776829 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 15:32:58.784370 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776833 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 15:32:58.784370 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776836 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 15:32:58.784370 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776839 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 15:32:58.784370 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776842 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 15:32:58.784830 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776845 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 15:32:58.784830 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776848 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 15:32:58.784830 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776850 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 15:32:58.784830 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776853 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 15:32:58.784830 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776856 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 15:32:58.784830 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776861 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 15:32:58.784830 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776863 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 15:32:58.784830 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776866 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 15:32:58.784830 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776868 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 15:32:58.784830 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776870 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 15:32:58.784830 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776873 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 15:32:58.784830 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776875 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 15:32:58.784830 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776878 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 15:32:58.784830 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776881 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 15:32:58.784830 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776883 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 15:32:58.784830 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776886 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 15:32:58.784830 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776888 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 15:32:58.784830 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776891 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 15:32:58.784830 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776893 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 15:32:58.784830 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776895 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 15:32:58.785331 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776898 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 15:32:58.785331 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776900 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 15:32:58.785331 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776903 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 15:32:58.785331 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776905 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 15:32:58.785331 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776908 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 15:32:58.785331 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776910 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 15:32:58.785331 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776912 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 15:32:58.785331 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776915 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 15:32:58.785331 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776918 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 15:32:58.785331 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776920 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 15:32:58.785331 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776923 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 15:32:58.785331 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776925 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 15:32:58.785331 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776927 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 15:32:58.785331 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776930 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 15:32:58.785331 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776932 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 15:32:58.785331 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776934 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 15:32:58.785331 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776938 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 15:32:58.785331 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776942 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 15:32:58.785331 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776945 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 15:32:58.785331 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776948 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 15:32:58.785799 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776951 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 15:32:58.785799 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776954 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 15:32:58.785799 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776956 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 15:32:58.785799 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776961 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 15:32:58.785799 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776963 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 15:32:58.785799 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776966 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 15:32:58.785799 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776969 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 15:32:58.785799 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776971 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 15:32:58.785799 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776974 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 15:32:58.785799 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776976 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 15:32:58.785799 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776979 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 15:32:58.785799 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776982 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 15:32:58.785799 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776984 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 15:32:58.785799 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776987 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 15:32:58.785799 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776990 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 15:32:58.785799 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776992 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 15:32:58.785799 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776994 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 15:32:58.785799 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776997 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 15:32:58.785799 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.776999 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 15:32:58.785799 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.777002 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 15:32:58.786312 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.777005 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 15:32:58.786312 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.777007 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 15:32:58.786312 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.777010 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 15:32:58.786312 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.777634 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 15:32:58.786312 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.784466 2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 15:32:58.786312 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.784482 2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 15:32:58.786312 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.785080 2554 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 15:32:58.786312 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.785088 2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 15:32:58.786312 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785145 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 15:32:58.786312 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785150 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 15:32:58.786312 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785154 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 15:32:58.786312 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785157 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 15:32:58.786312 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785160 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 15:32:58.786312 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785176 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 15:32:58.786312 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785179 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 15:32:58.786682 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785182 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 15:32:58.786682 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785185 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 15:32:58.786682 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785188 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 15:32:58.786682 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785190 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 15:32:58.786682 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785193 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 15:32:58.786682 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785196 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 15:32:58.786682 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785198 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 15:32:58.786682 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785201 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 15:32:58.786682 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785203 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 15:32:58.786682 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785206 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 15:32:58.786682 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785208 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 15:32:58.786682 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785211 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 15:32:58.786682 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785213 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 15:32:58.786682 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785216 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 15:32:58.786682 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785219 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 28 15:32:58.786682 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785221 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 15:32:58.786682 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785224 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 15:32:58.786682 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785228 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 15:32:58.786682 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785232 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 15:32:58.787139 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785235 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 15:32:58.787139 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785238 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 15:32:58.787139 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785241 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 15:32:58.787139 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785245 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 15:32:58.787139 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785247 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 15:32:58.787139 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785250 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 15:32:58.787139 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785252 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 15:32:58.787139 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785255 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 15:32:58.787139 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785257 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 15:32:58.787139 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785260 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 15:32:58.787139 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785262 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 15:32:58.787139 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785265 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 15:32:58.787139 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785267 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 15:32:58.787139 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785270 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 15:32:58.787139 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785272 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 15:32:58.787139 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785275 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 15:32:58.787139 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785277 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 15:32:58.787139 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785280 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 15:32:58.787139 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785282 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 15:32:58.787139 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785285 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 15:32:58.787698 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785287 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 15:32:58.787698 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785290 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 15:32:58.787698 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785292 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 15:32:58.787698 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785295 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 15:32:58.787698 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785298 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 15:32:58.787698 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785300 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 15:32:58.787698 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785303 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 15:32:58.787698 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785305 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 15:32:58.787698 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785308 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 15:32:58.787698 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785310 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 15:32:58.787698 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785313 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 15:32:58.787698 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785316 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 15:32:58.787698 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785318 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 15:32:58.787698 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785321 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 15:32:58.787698 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785325 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 15:32:58.787698 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785329 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 15:32:58.787698 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785333 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 15:32:58.787698 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785336 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 15:32:58.787698 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785338 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 15:32:58.788155 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785341 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 15:32:58.788155 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785344 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 15:32:58.788155 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785347 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 15:32:58.788155 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785351 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 15:32:58.788155 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785354 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 15:32:58.788155 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785357 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 15:32:58.788155 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785359 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 15:32:58.788155 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785362 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 15:32:58.788155 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785364 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 15:32:58.788155 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785367 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 15:32:58.788155 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785370 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 15:32:58.788155 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785372 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 15:32:58.788155 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785375 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 15:32:58.788155 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785377 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 15:32:58.788155 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785380 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 15:32:58.788155 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785382 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 15:32:58.788155 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785385 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 15:32:58.788155 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785387 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 15:32:58.788155 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785390 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 15:32:58.788155 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785393 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 15:32:58.788668 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785395 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 15:32:58.788668 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785398 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 15:32:58.788668 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785400 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 15:32:58.788668 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785403 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 15:32:58.788668 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785405 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 15:32:58.788668 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785408 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 15:32:58.788668 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785411 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 15:32:58.788668 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785413 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 15:32:58.788668 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785416 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 15:32:58.788668 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785419 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 15:32:58.788668 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785422 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 15:32:58.788668 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785424 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 15:32:58.788668 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785427 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 15:32:58.788668 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785429 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 15:32:58.788668 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.785435 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 15:32:58.789036 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785549 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 15:32:58.789036 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785553 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 15:32:58.789036 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785556 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 15:32:58.789036 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785559 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 15:32:58.789036 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785562 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 15:32:58.789036 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785564 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 15:32:58.789036 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785567 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 15:32:58.789036 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785569 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 15:32:58.789036 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785571 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 15:32:58.789036 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785574 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 15:32:58.789036 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785577 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 15:32:58.789036 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785579 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 15:32:58.789036 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785581 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 15:32:58.789036 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785584 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 15:32:58.789036 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785586 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 15:32:58.789036 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785589 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 15:32:58.789036 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785592 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 15:32:58.789036 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785594 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 15:32:58.789036 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785597 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 15:32:58.789507 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785599 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 15:32:58.789507 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785602 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 15:32:58.789507 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785604 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 15:32:58.789507 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785606 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 15:32:58.789507 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785609 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 15:32:58.789507 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785612 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 15:32:58.789507 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785615 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 15:32:58.789507 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785619 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 15:32:58.789507 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785622 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 15:32:58.789507 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785625 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 15:32:58.789507 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785628 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 15:32:58.789507 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785630 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 15:32:58.789507 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785633 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 15:32:58.789507 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785635 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 15:32:58.789507 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785638 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 15:32:58.789507 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785640 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 15:32:58.789507 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785643 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 15:32:58.789507 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785646 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 15:32:58.789507 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785648 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 15:32:58.789507 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785650 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 15:32:58.789978 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785654 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 15:32:58.789978 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785658 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 15:32:58.789978 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785660 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 15:32:58.789978 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785663 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 15:32:58.789978 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785666 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 15:32:58.789978 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785668 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 15:32:58.789978 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785670 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 15:32:58.789978 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785673 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 15:32:58.789978 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785676 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 15:32:58.789978 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785678 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 15:32:58.789978 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785681 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 15:32:58.789978 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785683 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 15:32:58.789978 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785686 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 28 15:32:58.789978 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785688 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 15:32:58.789978 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785691 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 15:32:58.789978 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785693 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 15:32:58.789978 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785695 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 15:32:58.789978 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785698 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 15:32:58.789978 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785701 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 15:32:58.790449 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785703 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 15:32:58.790449 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785705 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 15:32:58.790449 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785708 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 15:32:58.790449 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785711 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 15:32:58.790449 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785713 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 15:32:58.790449 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785715 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 15:32:58.790449 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785718 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 15:32:58.790449 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785720 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 15:32:58.790449 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785723 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 15:32:58.790449 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785726 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 15:32:58.790449 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785728 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 15:32:58.790449 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785731 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 15:32:58.790449 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785733 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 15:32:58.790449 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785736 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 15:32:58.790449 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785738 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 15:32:58.790449 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785741 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 15:32:58.790449 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785743 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 15:32:58.790449 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785746 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 15:32:58.790449 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785748 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 15:32:58.790449 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785750 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 15:32:58.790926 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785753 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 15:32:58.790926 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785755 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 15:32:58.790926 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785758 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 15:32:58.790926 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785760 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 15:32:58.790926 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785763 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 15:32:58.790926 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785765 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 15:32:58.790926 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785767 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 15:32:58.790926 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785770 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 15:32:58.790926 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785772 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 15:32:58.790926 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785774 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 15:32:58.790926 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785777 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 15:32:58.790926 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785780 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 15:32:58.790926 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785782 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 15:32:58.790926 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785785 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 15:32:58.790926 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785787 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 15:32:58.790926 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785790 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 15:32:58.790926 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785793 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 15:32:58.790926 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785795 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 15:32:58.790926 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785798 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 15:32:58.790926 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785800 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 15:32:58.791465 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:32:58.785803 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 15:32:58.791465 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.785808 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 15:32:58.791465 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.785916 2554 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 15:32:58.791465 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.788202 2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 15:32:58.791465 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.789430 2554 server.go:1019] "Starting client certificate rotation" Jul 28 15:32:58.791465 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.789527 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 15:32:58.791465 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.789563 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 15:32:58.791876 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.791862 2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 15:32:58.795449 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.795429 2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 15:32:58.806146 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.806126 2554 log.go:25] "Validated CRI v1 runtime API" Jul 28 15:32:58.808332 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.808316 2554 log.go:25] "Validated CRI v1 image API" Jul 28 15:32:58.809034 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.809019 2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 15:32:58.811244 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.811226 2554 fs.go:135] Filesystem UUIDs: map[2a9d7b0e-dd20-4f81-bc5f-3bf3c585e7f4:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f6efa3cf-9673-4957-8ea4-b1b5eff5819c:/dev/nvme0n1p3] Jul 28 15:32:58.811300 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.811245 2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 15:32:58.816858 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.816747 2554 manager.go:216] Machine: {Timestamp:2026-07-28 15:32:58.814883774 +0000 UTC m=+0.284383943 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3090027 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e2a55362b0fe39957f81ce70b3f40 SystemUUID:ec2e2a55-362b-0fe3-9957-f81ce70b3f40 BootID:d4512994-a247-484a-89a5-9ea46f341edc Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:22:a2:44:e1:27 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:22:a2:44:e1:27 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:f5:f7:96:ef:05 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 15:32:58.816858 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.816851 2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 15:32:58.816970 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.816928 2554 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 15:32:58.817615 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.817600 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 15:32:58.819644 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.819612 2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 15:32:58.819806 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.819640 2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-87.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 15:32:58.820249 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.820238 2554 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 15:32:58.820296 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.820251 2554 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 15:32:58.820296 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.820263 2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 15:32:58.820899 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.820888 2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 15:32:58.821967 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.821957 2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 15:32:58.823714 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.823702 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 28 15:32:58.823842 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.823833 2554 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 15:32:58.823872 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.823863 2554 kubelet.go:486] "Attempting to sync node with API server" Jul 28 15:32:58.823924 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.823880 2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 15:32:58.823924 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.823899 2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 15:32:58.823924 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.823910 2554 kubelet.go:398] "Adding apiserver pod source" Jul 28 15:32:58.823924 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.823919 2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 15:32:58.824296 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.824283 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 15:32:58.824357 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.824304 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 15:32:58.826547 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.826533 2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 15:32:58.828698 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.828685 2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 15:32:58.828755 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.828716 2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 15:32:58.830592 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.830581 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 15:32:58.830626 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.830602 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 15:32:58.830626 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.830608 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 15:32:58.830626 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.830614 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 15:32:58.830626 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.830622 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 15:32:58.830626 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.830627 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 15:32:58.830760 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.830635 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 15:32:58.830760 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.830640 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 15:32:58.830760 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.830648 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 15:32:58.830760 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.830654 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 15:32:58.830760 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.830667 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 15:32:58.830760 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.830673 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 15:32:58.831333 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.831324 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 15:32:58.831333 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.831333 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 15:32:58.834250 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.834222 2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-87.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 15:32:58.834312 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:32:58.834271 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-87.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 15:32:58.834312 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:32:58.834282 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 15:32:58.834887 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.834874 2554 server.go:1268] "Started kubelet" Jul 28 15:32:58.834989 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.834965 2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 15:32:58.835070 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.835022 2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 15:32:58.835140 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.835091 2554 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 15:32:58.835906 ip-10-0-141-87 systemd[1]: Started Kubernetes Kubelet. Jul 28 15:32:58.837725 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.837701 2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 15:32:58.837864 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.837509 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d7knw" Jul 28 15:32:58.840208 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.840192 2554 server.go:310] "Adding debug handlers to kubelet server" Jul 28 15:32:58.841284 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:32:58.841264 2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 15:32:58.843266 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:32:58.842561 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-87.ec2.internal.18c67df194bad878 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-87.ec2.internal,UID:ip-10-0-141-87.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-87.ec2.internal,},FirstTimestamp:2026-07-28 15:32:58.834843768 +0000 UTC m=+0.304343938,LastTimestamp:2026-07-28 15:32:58.834843768 +0000 UTC m=+0.304343938,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-87.ec2.internal,}" Jul 28 15:32:58.843554 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.843539 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d7knw" Jul 28 15:32:58.848088 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.848070 2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 15:32:58.848201 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.848085 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 15:32:58.848257 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:32:58.848201 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-87.ec2.internal\" not found" Jul 28 15:32:58.848735 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.848711 2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 15:32:58.848735 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.848711 2554 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 15:32:58.848894 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.848748 2554 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 15:32:58.848894 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.848824 2554 reconstruct.go:97] "Volume reconstruction finished" Jul 28 15:32:58.848894 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.848836 2554 reconciler.go:29] "Reconciler: start to sync state" Jul 28 15:32:58.849184 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.849144 2554 factory.go:55] Registering systemd factory Jul 28 15:32:58.849184 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.849159 2554 factory.go:223] Registration of the systemd container factory successfully Jul 28 15:32:58.849454 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.849412 2554 factory.go:153] Registering CRI-O factory Jul 28 15:32:58.849454 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.849425 2554 factory.go:223] Registration of the crio container factory successfully Jul 28 15:32:58.849567 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.849475 2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 15:32:58.849567 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.849499 2554 factory.go:103] Registering Raw factory Jul 28 15:32:58.849567 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.849514 2554 manager.go:1196] Started watching for new ooms in manager Jul 28 15:32:58.850310 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.850285 2554 manager.go:349] Starting recovery of all containers Jul 28 15:32:58.851903 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.851882 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 15:32:58.856431 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:32:58.856413 2554 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-87.ec2.internal\" not found" node="ip-10-0-141-87.ec2.internal" Jul 28 15:32:58.857044 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.857018 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 15:32:58.861457 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.861015 2554 manager.go:354] Recovery completed Jul 28 15:32:58.865336 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.865323 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 15:32:58.867069 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.867055 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-87.ec2.internal" event="NodeHasSufficientMemory" Jul 28 15:32:58.867130 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.867084 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 15:32:58.867130 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.867098 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-87.ec2.internal" event="NodeHasSufficientPID" Jul 28 15:32:58.867689 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.867673 2554 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 15:32:58.867689 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.867683 2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 15:32:58.867689 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.867688 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 15:32:58.867833 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.867699 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 28 15:32:58.868357 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.868342 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-87.ec2.internal" event="NodeHasSufficientMemory" Jul 28 15:32:58.868405 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.868368 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 15:32:58.868405 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.868382 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-87.ec2.internal" event="NodeHasSufficientPID" Jul 28 15:32:58.870010 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.869994 2554 policy_none.go:49] "None policy: Start" Jul 28 15:32:58.870010 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.870010 2554 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 15:32:58.870093 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.870020 2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 15:32:58.871125 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.871113 2554 policy_none.go:47] "Start" Jul 28 15:32:58.922706 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.922687 2554 manager.go:337] "Starting Device Plugin manager" Jul 28 15:32:58.922779 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:32:58.922734 2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 15:32:58.922779 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.922749 2554 server.go:87] "Starting device plugin registration server" Jul 28 15:32:58.923018 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.923006 2554 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 15:32:58.923053 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.923022 2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 15:32:58.923157 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.923134 2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 15:32:58.923376 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.923255 2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 15:32:58.923376 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:58.923264 2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 15:32:58.923730 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:32:58.923711 2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 15:32:58.923790 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:32:58.923767 2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-87.ec2.internal\" not found" Jul 28 15:32:59.023486 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.023399 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 15:32:59.024928 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.024395 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-87.ec2.internal" event="NodeHasSufficientMemory" Jul 28 15:32:59.024928 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.024425 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 15:32:59.024928 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.024436 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-87.ec2.internal" event="NodeHasSufficientPID" Jul 28 15:32:59.024928 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.024466 2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-87.ec2.internal" Jul 28 15:32:59.033770 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.033752 2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-87.ec2.internal" Jul 28 15:32:59.033860 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:32:59.033775 2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-87.ec2.internal\": node \"ip-10-0-141-87.ec2.internal\" not found" Jul 28 15:32:59.050983 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:32:59.050960 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-87.ec2.internal\" not found" Jul 28 15:32:59.071459 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.071438 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 15:32:59.071513 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.071479 2554 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 15:32:59.071513 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.071498 2554 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 15:32:59.071583 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:32:59.071534 2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 15:32:59.074400 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.074380 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 15:32:59.152033 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:32:59.151998 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-87.ec2.internal\" not found" Jul 28 15:32:59.172198 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.172151 2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-87.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-87.ec2.internal"] Jul 28 15:32:59.172295 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.172252 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 15:32:59.173477 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.173462 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-87.ec2.internal" event="NodeHasSufficientMemory" Jul 28 15:32:59.173579 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.173491 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 15:32:59.173579 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.173501 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-87.ec2.internal" event="NodeHasSufficientPID" Jul 28 15:32:59.174733 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.174720 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 15:32:59.174859 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.174845 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-87.ec2.internal" Jul 28 15:32:59.174916 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.174881 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 15:32:59.175485 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.175467 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-87.ec2.internal" event="NodeHasSufficientMemory" Jul 28 15:32:59.175575 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.175498 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 15:32:59.175575 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.175508 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-87.ec2.internal" event="NodeHasSufficientPID" Jul 28 15:32:59.175575 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.175467 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-87.ec2.internal" event="NodeHasSufficientMemory" Jul 28 15:32:59.175575 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.175568 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 15:32:59.175719 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.175581 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-87.ec2.internal" event="NodeHasSufficientPID" Jul 28 15:32:59.176842 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.176826 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-87.ec2.internal" Jul 28 15:32:59.176935 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.176852 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 15:32:59.177558 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.177544 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-87.ec2.internal" event="NodeHasSufficientMemory" Jul 28 15:32:59.177558 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.177570 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 15:32:59.177705 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.177582 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-87.ec2.internal" event="NodeHasSufficientPID" Jul 28 15:32:59.198754 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:32:59.198729 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-87.ec2.internal\" not found" node="ip-10-0-141-87.ec2.internal" Jul 28 15:32:59.202943 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:32:59.202927 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-87.ec2.internal\" not found" node="ip-10-0-141-87.ec2.internal" Jul 28 15:32:59.250963 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.250935 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f411dbdf09fe5c0df280b4f3599fc69b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-87.ec2.internal\" (UID: \"f411dbdf09fe5c0df280b4f3599fc69b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-87.ec2.internal" Jul 28 15:32:59.251073 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.250965 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f411dbdf09fe5c0df280b4f3599fc69b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-87.ec2.internal\" (UID: \"f411dbdf09fe5c0df280b4f3599fc69b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-87.ec2.internal" Jul 28 15:32:59.251073 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.250984 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dea5fffc9bb3f82e40a6934aaee07e23-config\") pod \"kube-apiserver-proxy-ip-10-0-141-87.ec2.internal\" (UID: \"dea5fffc9bb3f82e40a6934aaee07e23\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-87.ec2.internal" Jul 28 15:32:59.252203 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:32:59.252186 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-87.ec2.internal\" not found" Jul 28 15:32:59.351761 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.351686 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f411dbdf09fe5c0df280b4f3599fc69b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-87.ec2.internal\" (UID: \"f411dbdf09fe5c0df280b4f3599fc69b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-87.ec2.internal" Jul 28 15:32:59.351761 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.351730 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f411dbdf09fe5c0df280b4f3599fc69b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-87.ec2.internal\" (UID: \"f411dbdf09fe5c0df280b4f3599fc69b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-87.ec2.internal" Jul 28 15:32:59.351761 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.351757 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dea5fffc9bb3f82e40a6934aaee07e23-config\") pod \"kube-apiserver-proxy-ip-10-0-141-87.ec2.internal\" (UID: \"dea5fffc9bb3f82e40a6934aaee07e23\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-87.ec2.internal" Jul 28 15:32:59.351919 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.351798 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dea5fffc9bb3f82e40a6934aaee07e23-config\") pod \"kube-apiserver-proxy-ip-10-0-141-87.ec2.internal\" (UID: \"dea5fffc9bb3f82e40a6934aaee07e23\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-87.ec2.internal" Jul 28 15:32:59.351919 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.351808 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f411dbdf09fe5c0df280b4f3599fc69b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-87.ec2.internal\" (UID: \"f411dbdf09fe5c0df280b4f3599fc69b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-87.ec2.internal" Jul 28 15:32:59.351919 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.351808 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f411dbdf09fe5c0df280b4f3599fc69b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-87.ec2.internal\" (UID: \"f411dbdf09fe5c0df280b4f3599fc69b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-87.ec2.internal" Jul 28 15:32:59.352731 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:32:59.352707 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-87.ec2.internal\" not found" Jul 28 15:32:59.453176 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:32:59.453133 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-87.ec2.internal\" not found" Jul 28 15:32:59.502345 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.502319 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-87.ec2.internal" Jul 28 15:32:59.507570 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.507548 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-87.ec2.internal" Jul 28 15:32:59.553594 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:32:59.553564 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-87.ec2.internal\" not found" Jul 28 15:32:59.654059 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:32:59.653992 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-87.ec2.internal\" not found" Jul 28 15:32:59.754535 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:32:59.754502 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-87.ec2.internal\" not found" Jul 28 15:32:59.788691 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.788663 2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 15:32:59.789069 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.788845 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 15:32:59.789069 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.788875 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 15:32:59.848238 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.848198 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 15:27:59 +0000 UTC" deadline="2028-05-02 04:37:44.840329418 +0000 UTC" Jul 28 15:32:59.848238 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.848231 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15445h4m44.992102882s" Jul 28 15:32:59.854665 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:32:59.854646 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-87.ec2.internal\" not found" Jul 28 15:32:59.949477 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:32:59.949405 2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 15:33:00.048942 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.048909 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-87.ec2.internal" Jul 28 15:33:00.060854 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.060834 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 15:33:00.062463 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.062445 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-87.ec2.internal" Jul 28 15:33:00.075356 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.075335 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 15:33:00.094707 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:33:00.094678 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf411dbdf09fe5c0df280b4f3599fc69b.slice/crio-6685fa043a68a91d2108c291782ff6e88a0b793f0a03123d609e93d58cb96f27 WatchSource:0}: Error finding container 6685fa043a68a91d2108c291782ff6e88a0b793f0a03123d609e93d58cb96f27: Status 404 returned error can't find the container with id 6685fa043a68a91d2108c291782ff6e88a0b793f0a03123d609e93d58cb96f27 Jul 28 15:33:00.095012 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:33:00.094983 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddea5fffc9bb3f82e40a6934aaee07e23.slice/crio-3ee75de7d46f1458f816d9a143dd0bd3d2fadfb8d0c80046943c96abaec7ed2c WatchSource:0}: Error finding container 3ee75de7d46f1458f816d9a143dd0bd3d2fadfb8d0c80046943c96abaec7ed2c: Status 404 returned error can't find the container with id 3ee75de7d46f1458f816d9a143dd0bd3d2fadfb8d0c80046943c96abaec7ed2c Jul 28 15:33:00.099589 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.099574 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 15:33:00.214895 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.214812 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 15:33:00.825633 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.825598 2554 apiserver.go:52] "Watching apiserver" Jul 28 15:33:00.836716 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.836688 2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 15:33:00.837849 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.837822 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-mrjkp","openshift-multus/network-metrics-daemon-zrk89","openshift-network-diagnostics/network-check-target-c5vsn","openshift-network-operator/iptables-alerter-khr7d","openshift-ovn-kubernetes/ovnkube-node-zq7mv","kube-system/global-pull-secret-syncer-jmlvt","kube-system/konnectivity-agent-66xhr","kube-system/kube-apiserver-proxy-ip-10-0-141-87.ec2.internal","openshift-cluster-node-tuning-operator/tuned-bz9dp","openshift-dns/node-resolver-jr9vs","openshift-image-registry/node-ca-49c8p","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-87.ec2.internal","openshift-multus/multus-additional-cni-plugins-xlgxx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcl9z"] Jul 28 15:33:00.839484 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.839456 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-66xhr" Jul 28 15:33:00.840856 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.840833 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xlgxx" Jul 28 15:33:00.842110 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.842091 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:33:00.842205 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:00.842159 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c5vsn" podUID="55e0d957-598e-40f1-8c9e-8070fd19917a" Jul 28 15:33:00.842298 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.842252 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 15:33:00.843654 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.843310 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7rbpc\"" Jul 28 15:33:00.843654 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.843362 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-khr7d" Jul 28 15:33:00.843765 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.843666 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 15:33:00.843833 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.843812 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 15:33:00.844110 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.843931 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 15:33:00.844234 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.844207 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 15:33:00.844234 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.844213 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 15:33:00.844595 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.844578 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vcb52\"" Jul 28 15:33:00.844691 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.844601 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 15:33:00.845735 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.845459 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.846997 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.846483 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 15:33:00.846997 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.846877 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 15:33:00.847427 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.847319 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 15:33:00.847695 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.847675 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:00.847789 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:00.847747 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmlvt" podUID="41a895b0-ed4d-49c9-802e-767b38b9a01e" Jul 28 15:33:00.847936 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.847913 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 15:33:00.848202 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.848184 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 15:33:00.848646 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.848429 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2dz8v\"" Jul 28 15:33:00.849212 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.848756 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 15:33:00.849212 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.849096 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 15:33:00.849212 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.849191 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 15:33:00.849410 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.849398 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 15:33:00.849471 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.849434 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 15:33:00.849749 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.849728 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.849993 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.849973 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p2xp7\"" Jul 28 15:33:00.850871 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.850853 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mrjkp" Jul 28 15:33:00.851870 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.851780 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 15:33:00.851995 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.851975 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 15:33:00.852253 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.852145 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jr77w\"" Jul 28 15:33:00.852582 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.852473 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:33:00.852582 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:00.852545 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrk89" podUID="f5be64c0-1028-484f-8ee1-fe1de8d758f2" Jul 28 15:33:00.853157 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.852984 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 15:33:00.853438 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.853422 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7zj8r\"" Jul 28 15:33:00.854337 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.854312 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jr9vs" Jul 28 15:33:00.855300 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.855283 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-49c8p" Jul 28 15:33:00.856553 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.856516 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcl9z" Jul 28 15:33:00.857634 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.857613 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 15:33:00.857762 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.857745 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 15:33:00.857898 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.857878 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-67rnw\"" Jul 28 15:33:00.858002 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.857988 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 15:33:00.858097 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.858081 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2ttjn\"" Jul 28 15:33:00.858180 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.858148 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 15:33:00.858306 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.857617 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 15:33:00.859046 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.858754 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 15:33:00.859046 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.858815 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 15:33:00.859046 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.858846 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2dj48\"" Jul 28 15:33:00.859046 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.858951 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 15:33:00.863071 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.861519 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5370e1cf-6ffa-48d1-ad1a-ad070a80d79d-system-cni-dir\") pod \"multus-additional-cni-plugins-xlgxx\" (UID: \"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d\") " pod="openshift-multus/multus-additional-cni-plugins-xlgxx" Jul 28 15:33:00.863071 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.861559 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5370e1cf-6ffa-48d1-ad1a-ad070a80d79d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xlgxx\" (UID: \"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d\") " pod="openshift-multus/multus-additional-cni-plugins-xlgxx" Jul 28 15:33:00.863071 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.861592 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/41a895b0-ed4d-49c9-802e-767b38b9a01e-dbus\") pod \"global-pull-secret-syncer-jmlvt\" (UID: \"41a895b0-ed4d-49c9-802e-767b38b9a01e\") " pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:00.863071 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.861619 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssl7m\" (UniqueName: \"kubernetes.io/projected/55e0d957-598e-40f1-8c9e-8070fd19917a-kube-api-access-ssl7m\") pod \"network-check-target-c5vsn\" (UID: \"55e0d957-598e-40f1-8c9e-8070fd19917a\") " pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:33:00.863071 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.861696 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-node-log\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.863071 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.861726 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-host-cni-netd\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.863071 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.861756 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8924cfef-adc9-4c4d-a27b-7d048709ea2b-env-overrides\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.863071 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.861787 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5370e1cf-6ffa-48d1-ad1a-ad070a80d79d-os-release\") pod \"multus-additional-cni-plugins-xlgxx\" (UID: \"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d\") " pod="openshift-multus/multus-additional-cni-plugins-xlgxx" Jul 28 15:33:00.863071 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.861822 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpv9f\" (UniqueName: \"kubernetes.io/projected/5370e1cf-6ffa-48d1-ad1a-ad070a80d79d-kube-api-access-fpv9f\") pod \"multus-additional-cni-plugins-xlgxx\" (UID: \"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d\") " pod="openshift-multus/multus-additional-cni-plugins-xlgxx" Jul 28 15:33:00.863071 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.861848 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a86139c4-7e54-4a71-a016-2af0db258599-iptables-alerter-script\") pod \"iptables-alerter-khr7d\" (UID: \"a86139c4-7e54-4a71-a016-2af0db258599\") " pod="openshift-network-operator/iptables-alerter-khr7d" Jul 28 15:33:00.863071 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.861879 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a86139c4-7e54-4a71-a016-2af0db258599-host-slash\") pod \"iptables-alerter-khr7d\" (UID: \"a86139c4-7e54-4a71-a016-2af0db258599\") " pod="openshift-network-operator/iptables-alerter-khr7d" Jul 28 15:33:00.863071 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.861922 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-host-run-netns\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.863071 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.861964 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-run-openvswitch\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.863071 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.862055 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-run-ovn\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.863071 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.862088 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-etc-modprobe-d\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.863071 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.862118 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/27e3bbf1-eb81-4916-8e33-9b587c452873-konnectivity-ca\") pod \"konnectivity-agent-66xhr\" (UID: \"27e3bbf1-eb81-4916-8e33-9b587c452873\") " pod="kube-system/konnectivity-agent-66xhr" Jul 28 15:33:00.863973 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.862146 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5370e1cf-6ffa-48d1-ad1a-ad070a80d79d-cnibin\") pod \"multus-additional-cni-plugins-xlgxx\" (UID: \"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d\") " pod="openshift-multus/multus-additional-cni-plugins-xlgxx" Jul 28 15:33:00.863973 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.862209 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-host-slash\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.863973 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.862238 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8924cfef-adc9-4c4d-a27b-7d048709ea2b-ovn-node-metrics-cert\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.863973 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.862268 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-etc-sysconfig\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.863973 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.862312 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-etc-sysctl-d\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.863973 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.862365 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/41a895b0-ed4d-49c9-802e-767b38b9a01e-kubelet-config\") pod \"global-pull-secret-syncer-jmlvt\" (UID: \"41a895b0-ed4d-49c9-802e-767b38b9a01e\") " pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:00.863973 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.862394 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-systemd-units\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.863973 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.862427 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-var-lib-openvswitch\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.863973 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.862456 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-etc-openvswitch\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.863973 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.862486 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8924cfef-adc9-4c4d-a27b-7d048709ea2b-ovnkube-config\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.863973 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.863002 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-etc-kubernetes\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.863973 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.863048 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-etc-sysctl-conf\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.863973 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.863080 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-run\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.863973 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.863136 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-host-kubelet\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.863973 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.863249 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5370e1cf-6ffa-48d1-ad1a-ad070a80d79d-cni-binary-copy\") pod \"multus-additional-cni-plugins-xlgxx\" (UID: \"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d\") " pod="openshift-multus/multus-additional-cni-plugins-xlgxx" Jul 28 15:33:00.863973 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.863292 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ms7l\" (UniqueName: \"kubernetes.io/projected/a86139c4-7e54-4a71-a016-2af0db258599-kube-api-access-8ms7l\") pod \"iptables-alerter-khr7d\" (UID: \"a86139c4-7e54-4a71-a016-2af0db258599\") " pod="openshift-network-operator/iptables-alerter-khr7d" Jul 28 15:33:00.864759 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.863320 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-log-socket\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.864759 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.863352 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-host-cni-bin\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.864759 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.863385 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8924cfef-adc9-4c4d-a27b-7d048709ea2b-ovnkube-script-lib\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.864759 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.863418 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-sys\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.864759 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.863449 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-run-systemd\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.864759 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.863513 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.864759 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.863542 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-host\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.864759 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.863572 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/789ce58a-1b44-4d62-857c-f2b1c0deabf4-tmp\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.864759 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.863604 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5370e1cf-6ffa-48d1-ad1a-ad070a80d79d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xlgxx\" (UID: \"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d\") " pod="openshift-multus/multus-additional-cni-plugins-xlgxx" Jul 28 15:33:00.864759 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.863637 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5370e1cf-6ffa-48d1-ad1a-ad070a80d79d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xlgxx\" (UID: \"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d\") " pod="openshift-multus/multus-additional-cni-plugins-xlgxx" Jul 28 15:33:00.864759 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.863666 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41a895b0-ed4d-49c9-802e-767b38b9a01e-original-pull-secret\") pod \"global-pull-secret-syncer-jmlvt\" (UID: \"41a895b0-ed4d-49c9-802e-767b38b9a01e\") " pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:00.864759 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.863697 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-lib-modules\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.864759 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.863768 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-var-lib-kubelet\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.864759 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.863807 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/27e3bbf1-eb81-4916-8e33-9b587c452873-agent-certs\") pod \"konnectivity-agent-66xhr\" (UID: \"27e3bbf1-eb81-4916-8e33-9b587c452873\") " pod="kube-system/konnectivity-agent-66xhr" Jul 28 15:33:00.864759 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.863838 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-host-run-ovn-kubernetes\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.864759 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.863884 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptpkr\" (UniqueName: \"kubernetes.io/projected/8924cfef-adc9-4c4d-a27b-7d048709ea2b-kube-api-access-ptpkr\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.865362 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.863922 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-etc-systemd\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.865362 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.863963 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/789ce58a-1b44-4d62-857c-f2b1c0deabf4-etc-tuned\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.865362 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.863996 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzsg4\" (UniqueName: \"kubernetes.io/projected/789ce58a-1b44-4d62-857c-f2b1c0deabf4-kube-api-access-gzsg4\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.865362 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.864426 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 15:33:00.892068 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.892043 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sftf4" Jul 28 15:33:00.901661 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.901252 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sftf4" Jul 28 15:33:00.950307 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.950211 2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 15:33:00.959425 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.959392 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 15:33:00.964580 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.964553 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-etc-modprobe-d\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.964713 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.964594 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-run\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.964713 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.964620 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-lib-modules\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.964713 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.964645 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-node-log\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.964713 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.964683 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-host-cni-netd\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.964927 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.964714 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b8657b72-92f3-4d40-ab11-8db72529434a-etc-selinux\") pod \"aws-ebs-csi-driver-node-zcl9z\" (UID: \"b8657b72-92f3-4d40-ab11-8db72529434a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcl9z" Jul 28 15:33:00.964927 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.964747 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-host-run-k8s-cni-cncf-io\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:00.964927 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.964781 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-etc-kubernetes\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:00.964927 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.964807 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b28sc\" (UniqueName: \"kubernetes.io/projected/5c47c65a-9647-4f2e-a2c4-141989020177-kube-api-access-b28sc\") pod \"node-resolver-jr9vs\" (UID: \"5c47c65a-9647-4f2e-a2c4-141989020177\") " pod="openshift-dns/node-resolver-jr9vs" Jul 28 15:33:00.964927 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.964832 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-host-slash\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.964927 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.964858 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-etc-sysconfig\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.964927 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.964882 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-etc-sysctl-d\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.964927 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.964907 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-host-var-lib-kubelet\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:00.965359 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.964933 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/41a895b0-ed4d-49c9-802e-767b38b9a01e-kubelet-config\") pod \"global-pull-secret-syncer-jmlvt\" (UID: \"41a895b0-ed4d-49c9-802e-767b38b9a01e\") " pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:00.965359 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.964962 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-var-lib-openvswitch\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.965359 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.965004 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8924cfef-adc9-4c4d-a27b-7d048709ea2b-ovnkube-config\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.965359 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.965041 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-etc-sysctl-conf\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.965359 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.965072 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-host-var-lib-cni-bin\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:00.965359 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.965136 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-host-kubelet\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.965359 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.965166 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5370e1cf-6ffa-48d1-ad1a-ad070a80d79d-cni-binary-copy\") pod \"multus-additional-cni-plugins-xlgxx\" (UID: \"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d\") " pod="openshift-multus/multus-additional-cni-plugins-xlgxx" Jul 28 15:33:00.965359 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.965193 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ms7l\" (UniqueName: \"kubernetes.io/projected/a86139c4-7e54-4a71-a016-2af0db258599-kube-api-access-8ms7l\") pod \"iptables-alerter-khr7d\" (UID: \"a86139c4-7e54-4a71-a016-2af0db258599\") " pod="openshift-network-operator/iptables-alerter-khr7d" Jul 28 15:33:00.965359 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.965241 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8924cfef-adc9-4c4d-a27b-7d048709ea2b-ovnkube-script-lib\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.965359 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.965269 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/789ce58a-1b44-4d62-857c-f2b1c0deabf4-tmp\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.965359 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.965307 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-run\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.965359 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.965313 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1414205-e81a-49a1-8844-b184d7df7e1e-cni-binary-copy\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:00.965359 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.965341 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-multus-socket-dir-parent\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:00.965738 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.965239 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-etc-modprobe-d\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.965738 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.965631 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-lib-modules\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.965738 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.965671 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-node-log\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.965738 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.965707 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-host-cni-netd\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.965856 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.965746 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-run-systemd\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.965856 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.965783 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b8657b72-92f3-4d40-ab11-8db72529434a-device-dir\") pod \"aws-ebs-csi-driver-node-zcl9z\" (UID: \"b8657b72-92f3-4d40-ab11-8db72529434a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcl9z" Jul 28 15:33:00.965856 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.965811 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b8657b72-92f3-4d40-ab11-8db72529434a-socket-dir\") pod \"aws-ebs-csi-driver-node-zcl9z\" (UID: \"b8657b72-92f3-4d40-ab11-8db72529434a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcl9z" Jul 28 15:33:00.965856 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.965838 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b8657b72-92f3-4d40-ab11-8db72529434a-registration-dir\") pod \"aws-ebs-csi-driver-node-zcl9z\" (UID: \"b8657b72-92f3-4d40-ab11-8db72529434a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcl9z" Jul 28 15:33:00.965978 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.965865 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b8657b72-92f3-4d40-ab11-8db72529434a-sys-fs\") pod \"aws-ebs-csi-driver-node-zcl9z\" (UID: \"b8657b72-92f3-4d40-ab11-8db72529434a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcl9z" Jul 28 15:33:00.965978 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.965908 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-multus-cni-dir\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:00.965978 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.965934 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwzrq\" (UniqueName: \"kubernetes.io/projected/f5be64c0-1028-484f-8ee1-fe1de8d758f2-kube-api-access-rwzrq\") pod \"network-metrics-daemon-zrk89\" (UID: \"f5be64c0-1028-484f-8ee1-fe1de8d758f2\") " pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:33:00.965978 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.965962 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/27e3bbf1-eb81-4916-8e33-9b587c452873-agent-certs\") pod \"konnectivity-agent-66xhr\" (UID: \"27e3bbf1-eb81-4916-8e33-9b587c452873\") " pod="kube-system/konnectivity-agent-66xhr" Jul 28 15:33:00.966110 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.965997 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/789ce58a-1b44-4d62-857c-f2b1c0deabf4-etc-tuned\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.966110 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.966023 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzsg4\" (UniqueName: \"kubernetes.io/projected/789ce58a-1b44-4d62-857c-f2b1c0deabf4-kube-api-access-gzsg4\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.966110 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.966050 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5be64c0-1028-484f-8ee1-fe1de8d758f2-metrics-certs\") pod \"network-metrics-daemon-zrk89\" (UID: \"f5be64c0-1028-484f-8ee1-fe1de8d758f2\") " pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:33:00.966110 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.966079 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a1414205-e81a-49a1-8844-b184d7df7e1e-multus-daemon-config\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:00.966232 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.966113 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5jgv\" (UniqueName: \"kubernetes.io/projected/a1414205-e81a-49a1-8844-b184d7df7e1e-kube-api-access-j5jgv\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:00.966232 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.966146 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-etc-kubernetes\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.966232 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.966172 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-var-lib-kubelet\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.966340 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.966307 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-host-slash\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.966393 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.966369 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-etc-sysconfig\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.966462 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.966446 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-etc-sysctl-d\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.966499 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.966491 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/41a895b0-ed4d-49c9-802e-767b38b9a01e-kubelet-config\") pod \"global-pull-secret-syncer-jmlvt\" (UID: \"41a895b0-ed4d-49c9-802e-767b38b9a01e\") " pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:00.966533 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.966517 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-var-lib-openvswitch\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.966566 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.966515 2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 15:33:00.968686 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.966964 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-run-systemd\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.968686 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.966994 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-etc-sysctl-conf\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.968686 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.967054 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8924cfef-adc9-4c4d-a27b-7d048709ea2b-ovnkube-config\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.968686 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.967121 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-etc-kubernetes\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.968686 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.967170 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-host-kubelet\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.968686 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.967235 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5370e1cf-6ffa-48d1-ad1a-ad070a80d79d-system-cni-dir\") pod \"multus-additional-cni-plugins-xlgxx\" (UID: \"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d\") " pod="openshift-multus/multus-additional-cni-plugins-xlgxx" Jul 28 15:33:00.968686 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.967263 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-var-lib-kubelet\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.968686 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.967271 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5370e1cf-6ffa-48d1-ad1a-ad070a80d79d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xlgxx\" (UID: \"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d\") " pod="openshift-multus/multus-additional-cni-plugins-xlgxx" Jul 28 15:33:00.968686 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.967315 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5370e1cf-6ffa-48d1-ad1a-ad070a80d79d-system-cni-dir\") pod \"multus-additional-cni-plugins-xlgxx\" (UID: \"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d\") " pod="openshift-multus/multus-additional-cni-plugins-xlgxx" Jul 28 15:33:00.968686 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.967361 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/41a895b0-ed4d-49c9-802e-767b38b9a01e-dbus\") pod \"global-pull-secret-syncer-jmlvt\" (UID: \"41a895b0-ed4d-49c9-802e-767b38b9a01e\") " pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:00.968686 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.967417 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssl7m\" (UniqueName: \"kubernetes.io/projected/55e0d957-598e-40f1-8c9e-8070fd19917a-kube-api-access-ssl7m\") pod \"network-check-target-c5vsn\" (UID: \"55e0d957-598e-40f1-8c9e-8070fd19917a\") " pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:33:00.968686 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.967427 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8924cfef-adc9-4c4d-a27b-7d048709ea2b-ovnkube-script-lib\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.968686 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.967444 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8924cfef-adc9-4c4d-a27b-7d048709ea2b-env-overrides\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.968686 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.967484 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5370e1cf-6ffa-48d1-ad1a-ad070a80d79d-os-release\") pod \"multus-additional-cni-plugins-xlgxx\" (UID: \"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d\") " pod="openshift-multus/multus-additional-cni-plugins-xlgxx" Jul 28 15:33:00.968686 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.967510 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpv9f\" (UniqueName: \"kubernetes.io/projected/5370e1cf-6ffa-48d1-ad1a-ad070a80d79d-kube-api-access-fpv9f\") pod \"multus-additional-cni-plugins-xlgxx\" (UID: \"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d\") " pod="openshift-multus/multus-additional-cni-plugins-xlgxx" Jul 28 15:33:00.968686 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.967552 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a86139c4-7e54-4a71-a016-2af0db258599-iptables-alerter-script\") pod \"iptables-alerter-khr7d\" (UID: \"a86139c4-7e54-4a71-a016-2af0db258599\") " pod="openshift-network-operator/iptables-alerter-khr7d" Jul 28 15:33:00.968686 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.967578 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a86139c4-7e54-4a71-a016-2af0db258599-host-slash\") pod \"iptables-alerter-khr7d\" (UID: \"a86139c4-7e54-4a71-a016-2af0db258599\") " pod="openshift-network-operator/iptables-alerter-khr7d" Jul 28 15:33:00.969637 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.967605 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-host-run-netns\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.969637 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.967632 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-run-openvswitch\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.969637 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.967659 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-run-ovn\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.969637 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.967723 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-host-run-netns\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.969637 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.967753 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5370e1cf-6ffa-48d1-ad1a-ad070a80d79d-cni-binary-copy\") pod \"multus-additional-cni-plugins-xlgxx\" (UID: \"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d\") " pod="openshift-multus/multus-additional-cni-plugins-xlgxx" Jul 28 15:33:00.969637 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.967768 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-run-openvswitch\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.969637 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.967825 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-run-ovn\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.969637 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.967831 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5370e1cf-6ffa-48d1-ad1a-ad070a80d79d-os-release\") pod \"multus-additional-cni-plugins-xlgxx\" (UID: \"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d\") " pod="openshift-multus/multus-additional-cni-plugins-xlgxx" Jul 28 15:33:00.969637 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.967862 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a86139c4-7e54-4a71-a016-2af0db258599-host-slash\") pod \"iptables-alerter-khr7d\" (UID: \"a86139c4-7e54-4a71-a016-2af0db258599\") " pod="openshift-network-operator/iptables-alerter-khr7d" Jul 28 15:33:00.969637 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.967865 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcf7w\" (UniqueName: \"kubernetes.io/projected/b8657b72-92f3-4d40-ab11-8db72529434a-kube-api-access-bcf7w\") pod \"aws-ebs-csi-driver-node-zcl9z\" (UID: \"b8657b72-92f3-4d40-ab11-8db72529434a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcl9z" Jul 28 15:33:00.969637 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.967934 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/27e3bbf1-eb81-4916-8e33-9b587c452873-konnectivity-ca\") pod \"konnectivity-agent-66xhr\" (UID: \"27e3bbf1-eb81-4916-8e33-9b587c452873\") " pod="kube-system/konnectivity-agent-66xhr" Jul 28 15:33:00.969637 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.967971 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5370e1cf-6ffa-48d1-ad1a-ad070a80d79d-cnibin\") pod \"multus-additional-cni-plugins-xlgxx\" (UID: \"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d\") " pod="openshift-multus/multus-additional-cni-plugins-xlgxx" Jul 28 15:33:00.969637 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.968013 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8924cfef-adc9-4c4d-a27b-7d048709ea2b-ovn-node-metrics-cert\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.969637 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.968041 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-os-release\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:00.969637 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.968069 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-host-run-netns\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:00.969637 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.968072 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/41a895b0-ed4d-49c9-802e-767b38b9a01e-dbus\") pod \"global-pull-secret-syncer-jmlvt\" (UID: \"41a895b0-ed4d-49c9-802e-767b38b9a01e\") " pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:00.969637 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.968109 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-host-var-lib-cni-multus\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:00.970497 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.968145 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-host-run-multus-certs\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:00.970497 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.968204 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-systemd-units\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.970497 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.968245 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-etc-openvswitch\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.970497 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.968281 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-sys\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.970497 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.968305 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5370e1cf-6ffa-48d1-ad1a-ad070a80d79d-cnibin\") pod \"multus-additional-cni-plugins-xlgxx\" (UID: \"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d\") " pod="openshift-multus/multus-additional-cni-plugins-xlgxx" Jul 28 15:33:00.970497 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.968310 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5c47c65a-9647-4f2e-a2c4-141989020177-hosts-file\") pod \"node-resolver-jr9vs\" (UID: \"5c47c65a-9647-4f2e-a2c4-141989020177\") " pod="openshift-dns/node-resolver-jr9vs" Jul 28 15:33:00.970497 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.968350 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-log-socket\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.970497 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.968595 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/27e3bbf1-eb81-4916-8e33-9b587c452873-konnectivity-ca\") pod \"konnectivity-agent-66xhr\" (UID: \"27e3bbf1-eb81-4916-8e33-9b587c452873\") " pod="kube-system/konnectivity-agent-66xhr" Jul 28 15:33:00.970497 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.968602 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a86139c4-7e54-4a71-a016-2af0db258599-iptables-alerter-script\") pod \"iptables-alerter-khr7d\" (UID: \"a86139c4-7e54-4a71-a016-2af0db258599\") " pod="openshift-network-operator/iptables-alerter-khr7d" Jul 28 15:33:00.970497 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.968784 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-host-cni-bin\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.970497 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.968816 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-cnibin\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:00.970497 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.968817 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-log-socket\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.970497 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.968853 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-multus-conf-dir\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:00.970497 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.968870 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-etc-openvswitch\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.970497 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.968912 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c47c65a-9647-4f2e-a2c4-141989020177-tmp-dir\") pod \"node-resolver-jr9vs\" (UID: \"5c47c65a-9647-4f2e-a2c4-141989020177\") " pod="openshift-dns/node-resolver-jr9vs" Jul 28 15:33:00.970497 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.968944 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.970497 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.968951 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8924cfef-adc9-4c4d-a27b-7d048709ea2b-env-overrides\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.971424 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.968974 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-host\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.971424 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.968974 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-systemd-units\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.971424 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.969013 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b5qw\" (UniqueName: \"kubernetes.io/projected/3584627f-0efc-4d20-bac4-72b209a1f45a-kube-api-access-5b5qw\") pod \"node-ca-49c8p\" (UID: \"3584627f-0efc-4d20-bac4-72b209a1f45a\") " pod="openshift-image-registry/node-ca-49c8p" Jul 28 15:33:00.971424 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.969005 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-host-cni-bin\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.971424 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.969056 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.971424 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.969076 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-sys\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.971424 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.969104 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-system-cni-dir\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:00.971424 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.969134 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-host\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.971424 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.969139 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5370e1cf-6ffa-48d1-ad1a-ad070a80d79d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xlgxx\" (UID: \"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d\") " pod="openshift-multus/multus-additional-cni-plugins-xlgxx" Jul 28 15:33:00.971424 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.969173 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5370e1cf-6ffa-48d1-ad1a-ad070a80d79d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xlgxx\" (UID: \"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d\") " pod="openshift-multus/multus-additional-cni-plugins-xlgxx" Jul 28 15:33:00.971424 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.969210 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41a895b0-ed4d-49c9-802e-767b38b9a01e-original-pull-secret\") pod \"global-pull-secret-syncer-jmlvt\" (UID: \"41a895b0-ed4d-49c9-802e-767b38b9a01e\") " pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:00.971424 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.969282 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3584627f-0efc-4d20-bac4-72b209a1f45a-host\") pod \"node-ca-49c8p\" (UID: \"3584627f-0efc-4d20-bac4-72b209a1f45a\") " pod="openshift-image-registry/node-ca-49c8p" Jul 28 15:33:00.971424 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.969309 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3584627f-0efc-4d20-bac4-72b209a1f45a-serviceca\") pod \"node-ca-49c8p\" (UID: \"3584627f-0efc-4d20-bac4-72b209a1f45a\") " pod="openshift-image-registry/node-ca-49c8p" Jul 28 15:33:00.971424 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:00.969330 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 15:33:00.971424 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.969334 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b8657b72-92f3-4d40-ab11-8db72529434a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zcl9z\" (UID: \"b8657b72-92f3-4d40-ab11-8db72529434a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcl9z" Jul 28 15:33:00.971424 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.969396 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5370e1cf-6ffa-48d1-ad1a-ad070a80d79d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xlgxx\" (UID: \"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d\") " pod="openshift-multus/multus-additional-cni-plugins-xlgxx" Jul 28 15:33:00.971424 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:00.969415 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a895b0-ed4d-49c9-802e-767b38b9a01e-original-pull-secret podName:41a895b0-ed4d-49c9-802e-767b38b9a01e nodeName:}" failed. No retries permitted until 2026-07-28 15:33:01.469379772 +0000 UTC m=+2.938879932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41a895b0-ed4d-49c9-802e-767b38b9a01e-original-pull-secret") pod "global-pull-secret-syncer-jmlvt" (UID: "41a895b0-ed4d-49c9-802e-767b38b9a01e") : object "kube-system"/"original-pull-secret" not registered Jul 28 15:33:00.972114 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.969441 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-hostroot\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:00.972114 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.969468 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-host-run-ovn-kubernetes\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.972114 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.969516 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptpkr\" (UniqueName: \"kubernetes.io/projected/8924cfef-adc9-4c4d-a27b-7d048709ea2b-kube-api-access-ptpkr\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.972114 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.969535 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8924cfef-adc9-4c4d-a27b-7d048709ea2b-host-run-ovn-kubernetes\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.972114 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.969580 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-etc-systemd\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.972114 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.969756 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/789ce58a-1b44-4d62-857c-f2b1c0deabf4-etc-systemd\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.972114 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.969997 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5370e1cf-6ffa-48d1-ad1a-ad070a80d79d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xlgxx\" (UID: \"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d\") " pod="openshift-multus/multus-additional-cni-plugins-xlgxx" Jul 28 15:33:00.972114 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.970474 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5370e1cf-6ffa-48d1-ad1a-ad070a80d79d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xlgxx\" (UID: \"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d\") " pod="openshift-multus/multus-additional-cni-plugins-xlgxx" Jul 28 15:33:00.972114 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.971527 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/27e3bbf1-eb81-4916-8e33-9b587c452873-agent-certs\") pod \"konnectivity-agent-66xhr\" (UID: \"27e3bbf1-eb81-4916-8e33-9b587c452873\") " pod="kube-system/konnectivity-agent-66xhr" Jul 28 15:33:00.972114 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.971735 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/789ce58a-1b44-4d62-857c-f2b1c0deabf4-tmp\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.972114 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.971832 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8924cfef-adc9-4c4d-a27b-7d048709ea2b-ovn-node-metrics-cert\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:00.972638 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.972386 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/789ce58a-1b44-4d62-857c-f2b1c0deabf4-etc-tuned\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.974919 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:00.974198 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 15:33:00.974919 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:00.974224 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 15:33:00.974919 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:00.974256 2554 projected.go:196] Error preparing data for projected volume kube-api-access-ssl7m for pod openshift-network-diagnostics/network-check-target-c5vsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 15:33:00.974919 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:00.974403 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/55e0d957-598e-40f1-8c9e-8070fd19917a-kube-api-access-ssl7m podName:55e0d957-598e-40f1-8c9e-8070fd19917a nodeName:}" failed. No retries permitted until 2026-07-28 15:33:01.474381816 +0000 UTC m=+2.943881977 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ssl7m" (UniqueName: "kubernetes.io/projected/55e0d957-598e-40f1-8c9e-8070fd19917a-kube-api-access-ssl7m") pod "network-check-target-c5vsn" (UID: "55e0d957-598e-40f1-8c9e-8070fd19917a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 15:33:00.990318 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.990225 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpv9f\" (UniqueName: \"kubernetes.io/projected/5370e1cf-6ffa-48d1-ad1a-ad070a80d79d-kube-api-access-fpv9f\") pod \"multus-additional-cni-plugins-xlgxx\" (UID: \"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d\") " pod="openshift-multus/multus-additional-cni-plugins-xlgxx" Jul 28 15:33:00.990318 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.990232 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ms7l\" (UniqueName: \"kubernetes.io/projected/a86139c4-7e54-4a71-a016-2af0db258599-kube-api-access-8ms7l\") pod \"iptables-alerter-khr7d\" (UID: \"a86139c4-7e54-4a71-a016-2af0db258599\") " pod="openshift-network-operator/iptables-alerter-khr7d" Jul 28 15:33:00.990793 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.990768 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzsg4\" (UniqueName: \"kubernetes.io/projected/789ce58a-1b44-4d62-857c-f2b1c0deabf4-kube-api-access-gzsg4\") pod \"tuned-bz9dp\" (UID: \"789ce58a-1b44-4d62-857c-f2b1c0deabf4\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:00.992504 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.992482 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 15:33:00.993696 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:00.993676 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptpkr\" (UniqueName: \"kubernetes.io/projected/8924cfef-adc9-4c4d-a27b-7d048709ea2b-kube-api-access-ptpkr\") pod \"ovnkube-node-zq7mv\" (UID: \"8924cfef-adc9-4c4d-a27b-7d048709ea2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:01.070297 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070257 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b8657b72-92f3-4d40-ab11-8db72529434a-socket-dir\") pod \"aws-ebs-csi-driver-node-zcl9z\" (UID: \"b8657b72-92f3-4d40-ab11-8db72529434a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcl9z" Jul 28 15:33:01.070492 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070310 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b8657b72-92f3-4d40-ab11-8db72529434a-registration-dir\") pod \"aws-ebs-csi-driver-node-zcl9z\" (UID: \"b8657b72-92f3-4d40-ab11-8db72529434a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcl9z" Jul 28 15:33:01.070492 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070338 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b8657b72-92f3-4d40-ab11-8db72529434a-sys-fs\") pod \"aws-ebs-csi-driver-node-zcl9z\" (UID: \"b8657b72-92f3-4d40-ab11-8db72529434a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcl9z" Jul 28 15:33:01.070492 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070363 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-multus-cni-dir\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.070492 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070390 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwzrq\" (UniqueName: \"kubernetes.io/projected/f5be64c0-1028-484f-8ee1-fe1de8d758f2-kube-api-access-rwzrq\") pod \"network-metrics-daemon-zrk89\" (UID: \"f5be64c0-1028-484f-8ee1-fe1de8d758f2\") " pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:33:01.070492 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070423 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5be64c0-1028-484f-8ee1-fe1de8d758f2-metrics-certs\") pod \"network-metrics-daemon-zrk89\" (UID: \"f5be64c0-1028-484f-8ee1-fe1de8d758f2\") " pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:33:01.070492 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070440 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a1414205-e81a-49a1-8844-b184d7df7e1e-multus-daemon-config\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.070492 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070455 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5jgv\" (UniqueName: \"kubernetes.io/projected/a1414205-e81a-49a1-8844-b184d7df7e1e-kube-api-access-j5jgv\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.070492 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070489 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcf7w\" (UniqueName: \"kubernetes.io/projected/b8657b72-92f3-4d40-ab11-8db72529434a-kube-api-access-bcf7w\") pod \"aws-ebs-csi-driver-node-zcl9z\" (UID: \"b8657b72-92f3-4d40-ab11-8db72529434a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcl9z" Jul 28 15:33:01.070817 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070506 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-os-release\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.070817 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070521 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-host-run-netns\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.070817 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070541 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-host-var-lib-cni-multus\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.070817 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070568 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-host-run-multus-certs\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.070817 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070586 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5c47c65a-9647-4f2e-a2c4-141989020177-hosts-file\") pod \"node-resolver-jr9vs\" (UID: \"5c47c65a-9647-4f2e-a2c4-141989020177\") " pod="openshift-dns/node-resolver-jr9vs" Jul 28 15:33:01.070817 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070602 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-cnibin\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.070817 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070622 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-multus-conf-dir\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.070817 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070637 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c47c65a-9647-4f2e-a2c4-141989020177-tmp-dir\") pod \"node-resolver-jr9vs\" (UID: \"5c47c65a-9647-4f2e-a2c4-141989020177\") " pod="openshift-dns/node-resolver-jr9vs" Jul 28 15:33:01.070817 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070656 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b5qw\" (UniqueName: \"kubernetes.io/projected/3584627f-0efc-4d20-bac4-72b209a1f45a-kube-api-access-5b5qw\") pod \"node-ca-49c8p\" (UID: \"3584627f-0efc-4d20-bac4-72b209a1f45a\") " pod="openshift-image-registry/node-ca-49c8p" Jul 28 15:33:01.070817 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070674 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-system-cni-dir\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.070817 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070697 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3584627f-0efc-4d20-bac4-72b209a1f45a-host\") pod \"node-ca-49c8p\" (UID: \"3584627f-0efc-4d20-bac4-72b209a1f45a\") " pod="openshift-image-registry/node-ca-49c8p" Jul 28 15:33:01.070817 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070711 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3584627f-0efc-4d20-bac4-72b209a1f45a-serviceca\") pod \"node-ca-49c8p\" (UID: \"3584627f-0efc-4d20-bac4-72b209a1f45a\") " pod="openshift-image-registry/node-ca-49c8p" Jul 28 15:33:01.070817 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070727 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b8657b72-92f3-4d40-ab11-8db72529434a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zcl9z\" (UID: \"b8657b72-92f3-4d40-ab11-8db72529434a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcl9z" Jul 28 15:33:01.070817 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070742 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-hostroot\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.070817 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070764 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b8657b72-92f3-4d40-ab11-8db72529434a-etc-selinux\") pod \"aws-ebs-csi-driver-node-zcl9z\" (UID: \"b8657b72-92f3-4d40-ab11-8db72529434a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcl9z" Jul 28 15:33:01.070817 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070782 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-host-run-k8s-cni-cncf-io\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.070817 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070797 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-etc-kubernetes\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.070817 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070813 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b28sc\" (UniqueName: \"kubernetes.io/projected/5c47c65a-9647-4f2e-a2c4-141989020177-kube-api-access-b28sc\") pod \"node-resolver-jr9vs\" (UID: \"5c47c65a-9647-4f2e-a2c4-141989020177\") " pod="openshift-dns/node-resolver-jr9vs" Jul 28 15:33:01.071537 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070831 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-host-var-lib-kubelet\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.071537 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070850 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-host-var-lib-cni-bin\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.071537 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070871 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1414205-e81a-49a1-8844-b184d7df7e1e-cni-binary-copy\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.071537 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070889 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-multus-socket-dir-parent\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.071537 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070905 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b8657b72-92f3-4d40-ab11-8db72529434a-device-dir\") pod \"aws-ebs-csi-driver-node-zcl9z\" (UID: \"b8657b72-92f3-4d40-ab11-8db72529434a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcl9z" Jul 28 15:33:01.071537 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.070983 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b8657b72-92f3-4d40-ab11-8db72529434a-device-dir\") pod \"aws-ebs-csi-driver-node-zcl9z\" (UID: \"b8657b72-92f3-4d40-ab11-8db72529434a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcl9z" Jul 28 15:33:01.071537 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.071089 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b8657b72-92f3-4d40-ab11-8db72529434a-socket-dir\") pod \"aws-ebs-csi-driver-node-zcl9z\" (UID: \"b8657b72-92f3-4d40-ab11-8db72529434a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcl9z" Jul 28 15:33:01.071537 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.071122 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b8657b72-92f3-4d40-ab11-8db72529434a-registration-dir\") pod \"aws-ebs-csi-driver-node-zcl9z\" (UID: \"b8657b72-92f3-4d40-ab11-8db72529434a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcl9z" Jul 28 15:33:01.071537 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.071152 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b8657b72-92f3-4d40-ab11-8db72529434a-sys-fs\") pod \"aws-ebs-csi-driver-node-zcl9z\" (UID: \"b8657b72-92f3-4d40-ab11-8db72529434a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcl9z" Jul 28 15:33:01.071537 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.071200 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-multus-cni-dir\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.071537 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.071319 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-host-var-lib-cni-multus\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.071537 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.071330 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-host-run-k8s-cni-cncf-io\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.071537 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:01.071349 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 15:33:01.071537 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.071395 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-system-cni-dir\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.071537 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:01.071416 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5be64c0-1028-484f-8ee1-fe1de8d758f2-metrics-certs podName:f5be64c0-1028-484f-8ee1-fe1de8d758f2 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:01.571395333 +0000 UTC m=+3.040895497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5be64c0-1028-484f-8ee1-fe1de8d758f2-metrics-certs") pod "network-metrics-daemon-zrk89" (UID: "f5be64c0-1028-484f-8ee1-fe1de8d758f2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 15:33:01.071537 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.071435 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-multus-conf-dir\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.071537 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.071475 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3584627f-0efc-4d20-bac4-72b209a1f45a-host\") pod \"node-ca-49c8p\" (UID: \"3584627f-0efc-4d20-bac4-72b209a1f45a\") " pod="openshift-image-registry/node-ca-49c8p" Jul 28 15:33:01.072404 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.071512 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-etc-kubernetes\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.072404 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.071564 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b8657b72-92f3-4d40-ab11-8db72529434a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zcl9z\" (UID: \"b8657b72-92f3-4d40-ab11-8db72529434a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcl9z" Jul 28 15:33:01.072404 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.071565 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-host-run-multus-certs\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.072404 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.071600 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-hostroot\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.072404 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.071620 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-host-var-lib-kubelet\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.072404 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.071646 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5c47c65a-9647-4f2e-a2c4-141989020177-hosts-file\") pod \"node-resolver-jr9vs\" (UID: \"5c47c65a-9647-4f2e-a2c4-141989020177\") " pod="openshift-dns/node-resolver-jr9vs" Jul 28 15:33:01.072404 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.071676 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c47c65a-9647-4f2e-a2c4-141989020177-tmp-dir\") pod \"node-resolver-jr9vs\" (UID: \"5c47c65a-9647-4f2e-a2c4-141989020177\") " pod="openshift-dns/node-resolver-jr9vs" Jul 28 15:33:01.072404 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.071702 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-os-release\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.072404 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.071750 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b8657b72-92f3-4d40-ab11-8db72529434a-etc-selinux\") pod \"aws-ebs-csi-driver-node-zcl9z\" (UID: \"b8657b72-92f3-4d40-ab11-8db72529434a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcl9z" Jul 28 15:33:01.072404 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.071920 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-host-var-lib-cni-bin\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.072404 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.071971 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-multus-socket-dir-parent\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.072404 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.071349 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-cnibin\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.072404 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.072055 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3584627f-0efc-4d20-bac4-72b209a1f45a-serviceca\") pod \"node-ca-49c8p\" (UID: \"3584627f-0efc-4d20-bac4-72b209a1f45a\") " pod="openshift-image-registry/node-ca-49c8p" Jul 28 15:33:01.072404 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.072092 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1414205-e81a-49a1-8844-b184d7df7e1e-host-run-netns\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.072404 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.072086 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a1414205-e81a-49a1-8844-b184d7df7e1e-multus-daemon-config\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.073139 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.072711 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1414205-e81a-49a1-8844-b184d7df7e1e-cni-binary-copy\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.077433 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.077303 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-87.ec2.internal" event={"ID":"dea5fffc9bb3f82e40a6934aaee07e23","Type":"ContainerStarted","Data":"3ee75de7d46f1458f816d9a143dd0bd3d2fadfb8d0c80046943c96abaec7ed2c"} Jul 28 15:33:01.079215 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.079189 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-87.ec2.internal" event={"ID":"f411dbdf09fe5c0df280b4f3599fc69b","Type":"ContainerStarted","Data":"6685fa043a68a91d2108c291782ff6e88a0b793f0a03123d609e93d58cb96f27"} Jul 28 15:33:01.086634 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.086551 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b28sc\" (UniqueName: \"kubernetes.io/projected/5c47c65a-9647-4f2e-a2c4-141989020177-kube-api-access-b28sc\") pod \"node-resolver-jr9vs\" (UID: \"5c47c65a-9647-4f2e-a2c4-141989020177\") " pod="openshift-dns/node-resolver-jr9vs" Jul 28 15:33:01.087549 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.087523 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b5qw\" (UniqueName: \"kubernetes.io/projected/3584627f-0efc-4d20-bac4-72b209a1f45a-kube-api-access-5b5qw\") pod \"node-ca-49c8p\" (UID: \"3584627f-0efc-4d20-bac4-72b209a1f45a\") " pod="openshift-image-registry/node-ca-49c8p" Jul 28 15:33:01.088231 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.088209 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5jgv\" (UniqueName: \"kubernetes.io/projected/a1414205-e81a-49a1-8844-b184d7df7e1e-kube-api-access-j5jgv\") pod \"multus-mrjkp\" (UID: \"a1414205-e81a-49a1-8844-b184d7df7e1e\") " pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.088847 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.088823 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcf7w\" (UniqueName: \"kubernetes.io/projected/b8657b72-92f3-4d40-ab11-8db72529434a-kube-api-access-bcf7w\") pod \"aws-ebs-csi-driver-node-zcl9z\" (UID: \"b8657b72-92f3-4d40-ab11-8db72529434a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcl9z" Jul 28 15:33:01.089311 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.089293 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwzrq\" (UniqueName: \"kubernetes.io/projected/f5be64c0-1028-484f-8ee1-fe1de8d758f2-kube-api-access-rwzrq\") pod \"network-metrics-daemon-zrk89\" (UID: \"f5be64c0-1028-484f-8ee1-fe1de8d758f2\") " pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:33:01.152892 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.152851 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-66xhr" Jul 28 15:33:01.164158 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.164104 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xlgxx" Jul 28 15:33:01.175470 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.175273 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-khr7d" Jul 28 15:33:01.182034 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.182014 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:01.190013 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.189988 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" Jul 28 15:33:01.198926 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.198904 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mrjkp" Jul 28 15:33:01.206082 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.205967 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jr9vs" Jul 28 15:33:01.215301 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.215279 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-49c8p" Jul 28 15:33:01.222331 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.222311 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcl9z" Jul 28 15:33:01.474648 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.474607 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41a895b0-ed4d-49c9-802e-767b38b9a01e-original-pull-secret\") pod \"global-pull-secret-syncer-jmlvt\" (UID: \"41a895b0-ed4d-49c9-802e-767b38b9a01e\") " pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:01.474856 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.474687 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssl7m\" (UniqueName: \"kubernetes.io/projected/55e0d957-598e-40f1-8c9e-8070fd19917a-kube-api-access-ssl7m\") pod \"network-check-target-c5vsn\" (UID: \"55e0d957-598e-40f1-8c9e-8070fd19917a\") " pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:33:01.474856 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:01.474806 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 15:33:01.474856 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:01.474824 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 15:33:01.474856 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:01.474850 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 15:33:01.475076 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:01.474862 2554 projected.go:196] Error preparing data for projected volume kube-api-access-ssl7m for pod openshift-network-diagnostics/network-check-target-c5vsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 15:33:01.475076 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:01.474889 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a895b0-ed4d-49c9-802e-767b38b9a01e-original-pull-secret podName:41a895b0-ed4d-49c9-802e-767b38b9a01e nodeName:}" failed. No retries permitted until 2026-07-28 15:33:02.474867067 +0000 UTC m=+3.944367248 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41a895b0-ed4d-49c9-802e-767b38b9a01e-original-pull-secret") pod "global-pull-secret-syncer-jmlvt" (UID: "41a895b0-ed4d-49c9-802e-767b38b9a01e") : object "kube-system"/"original-pull-secret" not registered Jul 28 15:33:01.475076 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:01.474913 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/55e0d957-598e-40f1-8c9e-8070fd19917a-kube-api-access-ssl7m podName:55e0d957-598e-40f1-8c9e-8070fd19917a nodeName:}" failed. No retries permitted until 2026-07-28 15:33:02.474899606 +0000 UTC m=+3.944399764 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ssl7m" (UniqueName: "kubernetes.io/projected/55e0d957-598e-40f1-8c9e-8070fd19917a-kube-api-access-ssl7m") pod "network-check-target-c5vsn" (UID: "55e0d957-598e-40f1-8c9e-8070fd19917a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 15:33:01.575725 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.575681 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5be64c0-1028-484f-8ee1-fe1de8d758f2-metrics-certs\") pod \"network-metrics-daemon-zrk89\" (UID: \"f5be64c0-1028-484f-8ee1-fe1de8d758f2\") " pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:33:01.575909 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:01.575845 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 15:33:01.575969 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:01.575933 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5be64c0-1028-484f-8ee1-fe1de8d758f2-metrics-certs podName:f5be64c0-1028-484f-8ee1-fe1de8d758f2 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:02.575910736 +0000 UTC m=+4.045410912 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5be64c0-1028-484f-8ee1-fe1de8d758f2-metrics-certs") pod "network-metrics-daemon-zrk89" (UID: "f5be64c0-1028-484f-8ee1-fe1de8d758f2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 15:33:01.903626 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.903586 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 15:28:01 +0000 UTC" deadline="2028-05-03 02:13:42.508173806 +0000 UTC" Jul 28 15:33:01.903626 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:01.903620 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15466h40m40.604557333s" Jul 28 15:33:02.071998 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:02.071954 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:02.072215 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:02.072093 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmlvt" podUID="41a895b0-ed4d-49c9-802e-767b38b9a01e" Jul 28 15:33:02.273067 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:33:02.273037 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3584627f_0efc_4d20_bac4_72b209a1f45a.slice/crio-54e1e6cfe694febd92ac43b119542a51fe75c4702829ca7b40120e472fcbc705 WatchSource:0}: Error finding container 54e1e6cfe694febd92ac43b119542a51fe75c4702829ca7b40120e472fcbc705: Status 404 returned error can't find the container with id 54e1e6cfe694febd92ac43b119542a51fe75c4702829ca7b40120e472fcbc705 Jul 28 15:33:02.274758 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:33:02.274597 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8657b72_92f3_4d40_ab11_8db72529434a.slice/crio-d365fee81da2c4472dfe38059a17d728aca0550f9d09a882cb7aeb428b65ff8c WatchSource:0}: Error finding container d365fee81da2c4472dfe38059a17d728aca0550f9d09a882cb7aeb428b65ff8c: Status 404 returned error can't find the container with id d365fee81da2c4472dfe38059a17d728aca0550f9d09a882cb7aeb428b65ff8c Jul 28 15:33:02.278023 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:33:02.277971 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda86139c4_7e54_4a71_a016_2af0db258599.slice/crio-de43de8ebd5bbdd869e128be20c5cd4e20c3cf36509dcecdeadf962019eac498 WatchSource:0}: Error finding container de43de8ebd5bbdd869e128be20c5cd4e20c3cf36509dcecdeadf962019eac498: Status 404 returned error can't find the container with id de43de8ebd5bbdd869e128be20c5cd4e20c3cf36509dcecdeadf962019eac498 Jul 28 15:33:02.278223 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:33:02.278197 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod789ce58a_1b44_4d62_857c_f2b1c0deabf4.slice/crio-5d9925f084db63f713943125b0c044bc1a258af667a4e49a1c6a68174a698878 WatchSource:0}: Error finding container 5d9925f084db63f713943125b0c044bc1a258af667a4e49a1c6a68174a698878: Status 404 returned error can't find the container with id 5d9925f084db63f713943125b0c044bc1a258af667a4e49a1c6a68174a698878 Jul 28 15:33:02.279395 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:33:02.279372 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1414205_e81a_49a1_8844_b184d7df7e1e.slice/crio-50f4564987e891305e5020b9a1dd8f16f0e504394205a5c00e22dc0004e9c505 WatchSource:0}: Error finding container 50f4564987e891305e5020b9a1dd8f16f0e504394205a5c00e22dc0004e9c505: Status 404 returned error can't find the container with id 50f4564987e891305e5020b9a1dd8f16f0e504394205a5c00e22dc0004e9c505 Jul 28 15:33:02.281928 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:33:02.281513 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c47c65a_9647_4f2e_a2c4_141989020177.slice/crio-8ae0392c7289ee75bd9d6d7cff71c21f021b19c170556da92657eee9d087bd5e WatchSource:0}: Error finding container 8ae0392c7289ee75bd9d6d7cff71c21f021b19c170556da92657eee9d087bd5e: Status 404 returned error can't find the container with id 8ae0392c7289ee75bd9d6d7cff71c21f021b19c170556da92657eee9d087bd5e Jul 28 15:33:02.282371 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:33:02.282344 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27e3bbf1_eb81_4916_8e33_9b587c452873.slice/crio-c336d8d18cd25d0bd2e662e94d0c0ecf3762f31c5a435bd071f87192c637ffcb WatchSource:0}: Error finding container c336d8d18cd25d0bd2e662e94d0c0ecf3762f31c5a435bd071f87192c637ffcb: Status 404 returned error can't find the container with id c336d8d18cd25d0bd2e662e94d0c0ecf3762f31c5a435bd071f87192c637ffcb Jul 28 15:33:02.484488 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:02.484457 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssl7m\" (UniqueName: \"kubernetes.io/projected/55e0d957-598e-40f1-8c9e-8070fd19917a-kube-api-access-ssl7m\") pod \"network-check-target-c5vsn\" (UID: \"55e0d957-598e-40f1-8c9e-8070fd19917a\") " pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:33:02.484600 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:02.484505 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41a895b0-ed4d-49c9-802e-767b38b9a01e-original-pull-secret\") pod \"global-pull-secret-syncer-jmlvt\" (UID: \"41a895b0-ed4d-49c9-802e-767b38b9a01e\") " pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:02.484653 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:02.484624 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 15:33:02.484686 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:02.484655 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 15:33:02.484686 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:02.484682 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a895b0-ed4d-49c9-802e-767b38b9a01e-original-pull-secret podName:41a895b0-ed4d-49c9-802e-767b38b9a01e nodeName:}" failed. No retries permitted until 2026-07-28 15:33:04.484666229 +0000 UTC m=+5.954166392 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41a895b0-ed4d-49c9-802e-767b38b9a01e-original-pull-secret") pod "global-pull-secret-syncer-jmlvt" (UID: "41a895b0-ed4d-49c9-802e-767b38b9a01e") : object "kube-system"/"original-pull-secret" not registered Jul 28 15:33:02.484751 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:02.484682 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 15:33:02.484751 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:02.484702 2554 projected.go:196] Error preparing data for projected volume kube-api-access-ssl7m for pod openshift-network-diagnostics/network-check-target-c5vsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 15:33:02.484823 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:02.484758 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/55e0d957-598e-40f1-8c9e-8070fd19917a-kube-api-access-ssl7m podName:55e0d957-598e-40f1-8c9e-8070fd19917a nodeName:}" failed. No retries permitted until 2026-07-28 15:33:04.484740148 +0000 UTC m=+5.954240305 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ssl7m" (UniqueName: "kubernetes.io/projected/55e0d957-598e-40f1-8c9e-8070fd19917a-kube-api-access-ssl7m") pod "network-check-target-c5vsn" (UID: "55e0d957-598e-40f1-8c9e-8070fd19917a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 15:33:02.586111 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:02.586073 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5be64c0-1028-484f-8ee1-fe1de8d758f2-metrics-certs\") pod \"network-metrics-daemon-zrk89\" (UID: \"f5be64c0-1028-484f-8ee1-fe1de8d758f2\") " pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:33:02.586267 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:02.586223 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 15:33:02.586328 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:02.586283 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5be64c0-1028-484f-8ee1-fe1de8d758f2-metrics-certs podName:f5be64c0-1028-484f-8ee1-fe1de8d758f2 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:04.586268095 +0000 UTC m=+6.055768253 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5be64c0-1028-484f-8ee1-fe1de8d758f2-metrics-certs") pod "network-metrics-daemon-zrk89" (UID: "f5be64c0-1028-484f-8ee1-fe1de8d758f2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 15:33:02.904540 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:02.904420 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 15:28:01 +0000 UTC" deadline="2028-04-21 10:15:43.490572738 +0000 UTC" Jul 28 15:33:02.904540 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:02.904488 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15186h42m40.586089195s" Jul 28 15:33:03.074522 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:03.074388 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:33:03.074704 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:03.074522 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c5vsn" podUID="55e0d957-598e-40f1-8c9e-8070fd19917a" Jul 28 15:33:03.075001 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:03.074932 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:33:03.075101 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:03.075044 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrk89" podUID="f5be64c0-1028-484f-8ee1-fe1de8d758f2" Jul 28 15:33:03.109879 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:03.109676 2554 generic.go:356] "Generic (PLEG): container finished" podID="f411dbdf09fe5c0df280b4f3599fc69b" containerID="f0c80e31ecba98a55a633a0c27f62d467eb95e0558341f1a2a13aadeaf1e0654" exitCode=0 Jul 28 15:33:03.109879 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:03.109810 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-87.ec2.internal" event={"ID":"f411dbdf09fe5c0df280b4f3599fc69b","Type":"ContainerDied","Data":"f0c80e31ecba98a55a633a0c27f62d467eb95e0558341f1a2a13aadeaf1e0654"} Jul 28 15:33:03.113046 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:03.113010 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" event={"ID":"8924cfef-adc9-4c4d-a27b-7d048709ea2b","Type":"ContainerStarted","Data":"d5c3f8a0e291d5e494730889b77f68040c09165ff75eb82a0c9ab942be2793bc"} Jul 28 15:33:03.116027 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:03.115972 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xlgxx" event={"ID":"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d","Type":"ContainerStarted","Data":"9346a86dea47df8c6998ce4a638ccf3e667fea3b49a3db595f576e24c9bddd56"} Jul 28 15:33:03.119155 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:03.119083 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-66xhr" event={"ID":"27e3bbf1-eb81-4916-8e33-9b587c452873","Type":"ContainerStarted","Data":"c336d8d18cd25d0bd2e662e94d0c0ecf3762f31c5a435bd071f87192c637ffcb"} Jul 28 15:33:03.136311 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:03.136281 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mrjkp" event={"ID":"a1414205-e81a-49a1-8844-b184d7df7e1e","Type":"ContainerStarted","Data":"50f4564987e891305e5020b9a1dd8f16f0e504394205a5c00e22dc0004e9c505"} Jul 28 15:33:03.144760 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:03.144731 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcl9z" event={"ID":"b8657b72-92f3-4d40-ab11-8db72529434a","Type":"ContainerStarted","Data":"d365fee81da2c4472dfe38059a17d728aca0550f9d09a882cb7aeb428b65ff8c"} Jul 28 15:33:03.151163 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:03.151068 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-49c8p" event={"ID":"3584627f-0efc-4d20-bac4-72b209a1f45a","Type":"ContainerStarted","Data":"54e1e6cfe694febd92ac43b119542a51fe75c4702829ca7b40120e472fcbc705"} Jul 28 15:33:03.156384 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:03.155791 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-87.ec2.internal" event={"ID":"dea5fffc9bb3f82e40a6934aaee07e23","Type":"ContainerStarted","Data":"4d0adc56b238d218d103e7d3c40816976453e8741ba489651af8b50e472f9993"} Jul 28 15:33:03.177847 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:03.177766 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jr9vs" event={"ID":"5c47c65a-9647-4f2e-a2c4-141989020177","Type":"ContainerStarted","Data":"8ae0392c7289ee75bd9d6d7cff71c21f021b19c170556da92657eee9d087bd5e"} Jul 28 15:33:03.193877 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:03.193774 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" event={"ID":"789ce58a-1b44-4d62-857c-f2b1c0deabf4","Type":"ContainerStarted","Data":"5d9925f084db63f713943125b0c044bc1a258af667a4e49a1c6a68174a698878"} Jul 28 15:33:03.208881 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:03.208846 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-khr7d" event={"ID":"a86139c4-7e54-4a71-a016-2af0db258599","Type":"ContainerStarted","Data":"de43de8ebd5bbdd869e128be20c5cd4e20c3cf36509dcecdeadf962019eac498"} Jul 28 15:33:04.072350 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:04.072315 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:04.072843 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:04.072453 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmlvt" podUID="41a895b0-ed4d-49c9-802e-767b38b9a01e" Jul 28 15:33:04.232623 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:04.232400 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-87.ec2.internal" event={"ID":"f411dbdf09fe5c0df280b4f3599fc69b","Type":"ContainerStarted","Data":"c52d0594b9a41cba62bb07b2bc1fddf72c2df1d43bc9e4957c6ca767526e84ed"} Jul 28 15:33:04.261723 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:04.261656 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-87.ec2.internal" podStartSLOduration=4.261631091 podStartE2EDuration="4.261631091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:33:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:33:03.174776174 +0000 UTC m=+4.644276359" watchObservedRunningTime="2026-07-28 15:33:04.261631091 +0000 UTC m=+5.731131281" Jul 28 15:33:04.505032 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:04.504940 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssl7m\" (UniqueName: \"kubernetes.io/projected/55e0d957-598e-40f1-8c9e-8070fd19917a-kube-api-access-ssl7m\") pod \"network-check-target-c5vsn\" (UID: \"55e0d957-598e-40f1-8c9e-8070fd19917a\") " pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:33:04.505032 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:04.505018 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41a895b0-ed4d-49c9-802e-767b38b9a01e-original-pull-secret\") pod \"global-pull-secret-syncer-jmlvt\" (UID: \"41a895b0-ed4d-49c9-802e-767b38b9a01e\") " pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:04.505299 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:04.505161 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 15:33:04.505299 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:04.505251 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a895b0-ed4d-49c9-802e-767b38b9a01e-original-pull-secret podName:41a895b0-ed4d-49c9-802e-767b38b9a01e nodeName:}" failed. No retries permitted until 2026-07-28 15:33:08.505229804 +0000 UTC m=+9.974729969 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41a895b0-ed4d-49c9-802e-767b38b9a01e-original-pull-secret") pod "global-pull-secret-syncer-jmlvt" (UID: "41a895b0-ed4d-49c9-802e-767b38b9a01e") : object "kube-system"/"original-pull-secret" not registered Jul 28 15:33:04.505893 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:04.505680 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 15:33:04.505893 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:04.505704 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 15:33:04.505893 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:04.505718 2554 projected.go:196] Error preparing data for projected volume kube-api-access-ssl7m for pod openshift-network-diagnostics/network-check-target-c5vsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 15:33:04.505893 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:04.505768 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/55e0d957-598e-40f1-8c9e-8070fd19917a-kube-api-access-ssl7m podName:55e0d957-598e-40f1-8c9e-8070fd19917a nodeName:}" failed. No retries permitted until 2026-07-28 15:33:08.505752086 +0000 UTC m=+9.975252247 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ssl7m" (UniqueName: "kubernetes.io/projected/55e0d957-598e-40f1-8c9e-8070fd19917a-kube-api-access-ssl7m") pod "network-check-target-c5vsn" (UID: "55e0d957-598e-40f1-8c9e-8070fd19917a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 15:33:04.607010 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:04.606288 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5be64c0-1028-484f-8ee1-fe1de8d758f2-metrics-certs\") pod \"network-metrics-daemon-zrk89\" (UID: \"f5be64c0-1028-484f-8ee1-fe1de8d758f2\") " pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:33:04.607010 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:04.606555 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 15:33:04.607010 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:04.606631 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5be64c0-1028-484f-8ee1-fe1de8d758f2-metrics-certs podName:f5be64c0-1028-484f-8ee1-fe1de8d758f2 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:08.606611802 +0000 UTC m=+10.076111962 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5be64c0-1028-484f-8ee1-fe1de8d758f2-metrics-certs") pod "network-metrics-daemon-zrk89" (UID: "f5be64c0-1028-484f-8ee1-fe1de8d758f2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 15:33:05.072305 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:05.072273 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:33:05.072305 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:05.072292 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:33:05.072880 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:05.072451 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrk89" podUID="f5be64c0-1028-484f-8ee1-fe1de8d758f2" Jul 28 15:33:05.072880 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:05.072561 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c5vsn" podUID="55e0d957-598e-40f1-8c9e-8070fd19917a" Jul 28 15:33:06.072015 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:06.071974 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:06.072197 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:06.072121 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmlvt" podUID="41a895b0-ed4d-49c9-802e-767b38b9a01e" Jul 28 15:33:07.072226 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:07.072054 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:33:07.072226 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:07.072209 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c5vsn" podUID="55e0d957-598e-40f1-8c9e-8070fd19917a" Jul 28 15:33:07.072732 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:07.072389 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:33:07.072732 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:07.072514 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrk89" podUID="f5be64c0-1028-484f-8ee1-fe1de8d758f2" Jul 28 15:33:08.072172 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:08.072135 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:08.072369 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:08.072287 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmlvt" podUID="41a895b0-ed4d-49c9-802e-767b38b9a01e" Jul 28 15:33:08.541619 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:08.540827 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssl7m\" (UniqueName: \"kubernetes.io/projected/55e0d957-598e-40f1-8c9e-8070fd19917a-kube-api-access-ssl7m\") pod \"network-check-target-c5vsn\" (UID: \"55e0d957-598e-40f1-8c9e-8070fd19917a\") " pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:33:08.541619 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:08.540883 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41a895b0-ed4d-49c9-802e-767b38b9a01e-original-pull-secret\") pod \"global-pull-secret-syncer-jmlvt\" (UID: \"41a895b0-ed4d-49c9-802e-767b38b9a01e\") " pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:08.541619 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:08.540983 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 15:33:08.541619 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:08.541036 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a895b0-ed4d-49c9-802e-767b38b9a01e-original-pull-secret podName:41a895b0-ed4d-49c9-802e-767b38b9a01e nodeName:}" failed. No retries permitted until 2026-07-28 15:33:16.541022019 +0000 UTC m=+18.010522175 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41a895b0-ed4d-49c9-802e-767b38b9a01e-original-pull-secret") pod "global-pull-secret-syncer-jmlvt" (UID: "41a895b0-ed4d-49c9-802e-767b38b9a01e") : object "kube-system"/"original-pull-secret" not registered Jul 28 15:33:08.541619 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:08.541453 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 15:33:08.541619 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:08.541475 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 15:33:08.541619 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:08.541488 2554 projected.go:196] Error preparing data for projected volume kube-api-access-ssl7m for pod openshift-network-diagnostics/network-check-target-c5vsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 15:33:08.541619 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:08.541533 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/55e0d957-598e-40f1-8c9e-8070fd19917a-kube-api-access-ssl7m podName:55e0d957-598e-40f1-8c9e-8070fd19917a nodeName:}" failed. No retries permitted until 2026-07-28 15:33:16.54151828 +0000 UTC m=+18.011018442 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ssl7m" (UniqueName: "kubernetes.io/projected/55e0d957-598e-40f1-8c9e-8070fd19917a-kube-api-access-ssl7m") pod "network-check-target-c5vsn" (UID: "55e0d957-598e-40f1-8c9e-8070fd19917a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 15:33:08.642695 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:08.642181 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5be64c0-1028-484f-8ee1-fe1de8d758f2-metrics-certs\") pod \"network-metrics-daemon-zrk89\" (UID: \"f5be64c0-1028-484f-8ee1-fe1de8d758f2\") " pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:33:08.642695 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:08.642311 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 15:33:08.642695 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:08.642364 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5be64c0-1028-484f-8ee1-fe1de8d758f2-metrics-certs podName:f5be64c0-1028-484f-8ee1-fe1de8d758f2 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:16.642345845 +0000 UTC m=+18.111846001 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5be64c0-1028-484f-8ee1-fe1de8d758f2-metrics-certs") pod "network-metrics-daemon-zrk89" (UID: "f5be64c0-1028-484f-8ee1-fe1de8d758f2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 15:33:09.074196 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:09.073000 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:33:09.074196 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:09.073074 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c5vsn" podUID="55e0d957-598e-40f1-8c9e-8070fd19917a" Jul 28 15:33:09.074196 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:09.073318 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:33:09.074196 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:09.073403 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrk89" podUID="f5be64c0-1028-484f-8ee1-fe1de8d758f2" Jul 28 15:33:10.072600 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:10.072570 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:10.072791 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:10.072715 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmlvt" podUID="41a895b0-ed4d-49c9-802e-767b38b9a01e" Jul 28 15:33:11.073995 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:11.073959 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:33:11.074462 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:11.073999 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:33:11.074462 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:11.074105 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrk89" podUID="f5be64c0-1028-484f-8ee1-fe1de8d758f2" Jul 28 15:33:11.074571 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:11.074484 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c5vsn" podUID="55e0d957-598e-40f1-8c9e-8070fd19917a" Jul 28 15:33:12.072108 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:12.072074 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:12.072288 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:12.072212 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmlvt" podUID="41a895b0-ed4d-49c9-802e-767b38b9a01e" Jul 28 15:33:13.072248 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:13.072219 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:33:13.072738 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:13.072344 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c5vsn" podUID="55e0d957-598e-40f1-8c9e-8070fd19917a" Jul 28 15:33:13.072738 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:13.072397 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:33:13.072738 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:13.072518 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrk89" podUID="f5be64c0-1028-484f-8ee1-fe1de8d758f2" Jul 28 15:33:14.072454 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:14.072384 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:14.072846 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:14.072506 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmlvt" podUID="41a895b0-ed4d-49c9-802e-767b38b9a01e" Jul 28 15:33:15.072407 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:15.072372 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:33:15.072407 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:15.072416 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:33:15.072858 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:15.072506 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c5vsn" podUID="55e0d957-598e-40f1-8c9e-8070fd19917a" Jul 28 15:33:15.072858 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:15.072627 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrk89" podUID="f5be64c0-1028-484f-8ee1-fe1de8d758f2" Jul 28 15:33:16.072070 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:16.072033 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:16.072321 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:16.072138 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmlvt" podUID="41a895b0-ed4d-49c9-802e-767b38b9a01e" Jul 28 15:33:16.602857 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:16.602818 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssl7m\" (UniqueName: \"kubernetes.io/projected/55e0d957-598e-40f1-8c9e-8070fd19917a-kube-api-access-ssl7m\") pod \"network-check-target-c5vsn\" (UID: \"55e0d957-598e-40f1-8c9e-8070fd19917a\") " pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:33:16.603388 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:16.602869 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41a895b0-ed4d-49c9-802e-767b38b9a01e-original-pull-secret\") pod \"global-pull-secret-syncer-jmlvt\" (UID: \"41a895b0-ed4d-49c9-802e-767b38b9a01e\") " pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:16.603388 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:16.602966 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 15:33:16.603388 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:16.603008 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 15:33:16.603388 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:16.603035 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 15:33:16.603388 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:16.603049 2554 projected.go:196] Error preparing data for projected volume kube-api-access-ssl7m for pod openshift-network-diagnostics/network-check-target-c5vsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 15:33:16.603388 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:16.603018 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a895b0-ed4d-49c9-802e-767b38b9a01e-original-pull-secret podName:41a895b0-ed4d-49c9-802e-767b38b9a01e nodeName:}" failed. No retries permitted until 2026-07-28 15:33:32.603004046 +0000 UTC m=+34.072504202 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41a895b0-ed4d-49c9-802e-767b38b9a01e-original-pull-secret") pod "global-pull-secret-syncer-jmlvt" (UID: "41a895b0-ed4d-49c9-802e-767b38b9a01e") : object "kube-system"/"original-pull-secret" not registered Jul 28 15:33:16.603388 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:16.603117 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/55e0d957-598e-40f1-8c9e-8070fd19917a-kube-api-access-ssl7m podName:55e0d957-598e-40f1-8c9e-8070fd19917a nodeName:}" failed. No retries permitted until 2026-07-28 15:33:32.603100378 +0000 UTC m=+34.072600543 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ssl7m" (UniqueName: "kubernetes.io/projected/55e0d957-598e-40f1-8c9e-8070fd19917a-kube-api-access-ssl7m") pod "network-check-target-c5vsn" (UID: "55e0d957-598e-40f1-8c9e-8070fd19917a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 15:33:16.703982 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:16.703943 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5be64c0-1028-484f-8ee1-fe1de8d758f2-metrics-certs\") pod \"network-metrics-daemon-zrk89\" (UID: \"f5be64c0-1028-484f-8ee1-fe1de8d758f2\") " pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:33:16.704149 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:16.704109 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 15:33:16.704232 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:16.704200 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5be64c0-1028-484f-8ee1-fe1de8d758f2-metrics-certs podName:f5be64c0-1028-484f-8ee1-fe1de8d758f2 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:32.70417789 +0000 UTC m=+34.173678060 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5be64c0-1028-484f-8ee1-fe1de8d758f2-metrics-certs") pod "network-metrics-daemon-zrk89" (UID: "f5be64c0-1028-484f-8ee1-fe1de8d758f2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 15:33:17.072865 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:17.072775 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:33:17.073076 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:17.072897 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c5vsn" podUID="55e0d957-598e-40f1-8c9e-8070fd19917a" Jul 28 15:33:17.073361 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:17.073335 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:33:17.073492 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:17.073451 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrk89" podUID="f5be64c0-1028-484f-8ee1-fe1de8d758f2" Jul 28 15:33:18.071809 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:18.071769 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:18.072238 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:18.071888 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmlvt" podUID="41a895b0-ed4d-49c9-802e-767b38b9a01e" Jul 28 15:33:19.072736 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:19.072701 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:33:19.073185 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:19.072812 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c5vsn" podUID="55e0d957-598e-40f1-8c9e-8070fd19917a" Jul 28 15:33:19.073185 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:19.072855 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:33:19.073185 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:19.072941 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrk89" podUID="f5be64c0-1028-484f-8ee1-fe1de8d758f2" Jul 28 15:33:20.072033 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:20.071990 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:20.072210 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:20.072128 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmlvt" podUID="41a895b0-ed4d-49c9-802e-767b38b9a01e" Jul 28 15:33:21.072805 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:21.072772 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:33:21.073351 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:21.072771 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:33:21.073351 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:21.072913 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrk89" podUID="f5be64c0-1028-484f-8ee1-fe1de8d758f2" Jul 28 15:33:21.073351 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:21.072968 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c5vsn" podUID="55e0d957-598e-40f1-8c9e-8070fd19917a" Jul 28 15:33:22.072293 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:22.071932 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:22.072439 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:22.072413 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmlvt" podUID="41a895b0-ed4d-49c9-802e-767b38b9a01e" Jul 28 15:33:22.277988 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:22.277911 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" event={"ID":"8924cfef-adc9-4c4d-a27b-7d048709ea2b","Type":"ContainerStarted","Data":"43d8977fc936c965d891a699dd67b64b0e835aa80a682a077d9f2d375d4467e8"} Jul 28 15:33:22.278776 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:22.278010 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" event={"ID":"8924cfef-adc9-4c4d-a27b-7d048709ea2b","Type":"ContainerStarted","Data":"082be691fcb87da31dde055ef3c25b52e6f550478d3d7c5a1fedd9f6db9ae187"} Jul 28 15:33:22.278776 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:22.278065 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" event={"ID":"8924cfef-adc9-4c4d-a27b-7d048709ea2b","Type":"ContainerStarted","Data":"860bee5e0d63f488d4fd7aa41b2345e1eeccd14d897a67b258a172f1ccf9c18e"} Jul 28 15:33:22.278776 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:22.278114 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" event={"ID":"8924cfef-adc9-4c4d-a27b-7d048709ea2b","Type":"ContainerStarted","Data":"da8d7680ea4ea601b994adfbe4e9e808b81ba655dd8bc8d0fb9d0e87f788745c"} Jul 28 15:33:22.278776 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:22.278218 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" event={"ID":"8924cfef-adc9-4c4d-a27b-7d048709ea2b","Type":"ContainerStarted","Data":"3a4ad062c30c6adfc4e10e0514328a8f88e2a0bea148b942cf119b0722ba165a"} Jul 28 15:33:22.278776 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:22.278263 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" event={"ID":"8924cfef-adc9-4c4d-a27b-7d048709ea2b","Type":"ContainerStarted","Data":"19b76af95c38bf70f9d393bab101abce6457a280f22f22c7bf409c76c4ed4348"} Jul 28 15:33:22.279463 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:22.279435 2554 generic.go:356] "Generic (PLEG): container finished" podID="5370e1cf-6ffa-48d1-ad1a-ad070a80d79d" containerID="7098da59c7a63c3b4239ef36c8735de7c45dbc8a50ae7cf0e0caf3c565df00d3" exitCode=0 Jul 28 15:33:22.279596 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:22.279503 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xlgxx" event={"ID":"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d","Type":"ContainerDied","Data":"7098da59c7a63c3b4239ef36c8735de7c45dbc8a50ae7cf0e0caf3c565df00d3"} Jul 28 15:33:22.281949 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:22.281921 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-66xhr" event={"ID":"27e3bbf1-eb81-4916-8e33-9b587c452873","Type":"ContainerStarted","Data":"6207758d304fef326a5b936ceb1035e0a4d0dda80e0ca083fcddada193223627"} Jul 28 15:33:22.284088 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:22.284055 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mrjkp" event={"ID":"a1414205-e81a-49a1-8844-b184d7df7e1e","Type":"ContainerStarted","Data":"85c88bd16fb3a22a3d7f3e0b0faa8d4d65b03e5cc713b2bb4fc4c4cd87e84c19"} Jul 28 15:33:22.286012 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:22.285988 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcl9z" event={"ID":"b8657b72-92f3-4d40-ab11-8db72529434a","Type":"ContainerStarted","Data":"4824f399793c896b2fb37bd173677472521320f6e58ae4c8e6325b7e0c1cc8ce"} Jul 28 15:33:22.287571 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:22.287536 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-49c8p" event={"ID":"3584627f-0efc-4d20-bac4-72b209a1f45a","Type":"ContainerStarted","Data":"a1696f171e2ab8b50b0853b9c2b7fe84fb5516ac74fdd169939a6da4633e9094"} Jul 28 15:33:22.289154 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:22.289127 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jr9vs" event={"ID":"5c47c65a-9647-4f2e-a2c4-141989020177","Type":"ContainerStarted","Data":"9ac4e22b31e014489753ab69ffe9a5ba360c9a41595b14ccf87e25677b74e7db"} Jul 28 15:33:22.290739 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:22.290718 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" event={"ID":"789ce58a-1b44-4d62-857c-f2b1c0deabf4","Type":"ContainerStarted","Data":"eeb0a92f871f16f645dbb294a82f8c0efd6a1bc5b73d7828710891fc6a04d92f"} Jul 28 15:33:22.306881 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:22.306826 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-87.ec2.internal" podStartSLOduration=22.306813007 podStartE2EDuration="22.306813007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:33:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:33:04.263096089 +0000 UTC m=+5.732596271" watchObservedRunningTime="2026-07-28 15:33:22.306813007 +0000 UTC m=+23.776313185" Jul 28 15:33:22.327040 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:22.326997 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mrjkp" podStartSLOduration=4.160988855 podStartE2EDuration="23.326983807s" totalImagesPullingTime="19.165994952s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:33:22.326631478 +0000 UTC m=+23.796131655" watchObservedRunningTime="2026-07-28 15:33:22.326983807 +0000 UTC m=+23.796483984" Jul 28 15:33:22.345484 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:22.345447 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-66xhr" podStartSLOduration=4.250008642 podStartE2EDuration="23.345432541s" totalImagesPullingTime="19.095423899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:33:22.345021952 +0000 UTC m=+23.814522142" watchObservedRunningTime="2026-07-28 15:33:22.345432541 +0000 UTC m=+23.814932721" Jul 28 15:33:22.381507 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:22.381458 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bz9dp" podStartSLOduration=4.2809475710000005 podStartE2EDuration="23.381442802s" totalImagesPullingTime="19.100495231s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:33:22.362936901 +0000 UTC m=+23.832437079" watchObservedRunningTime="2026-07-28 15:33:22.381442802 +0000 UTC m=+23.850943040" Jul 28 15:33:22.381685 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:22.381546 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jr9vs" podStartSLOduration=4.277969516 podStartE2EDuration="23.381542351s" totalImagesPullingTime="19.103572835s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:33:22.381113605 +0000 UTC m=+23.850613782" watchObservedRunningTime="2026-07-28 15:33:22.381542351 +0000 UTC m=+23.851042528" Jul 28 15:33:22.677269 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:22.677243 2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 15:33:22.935576 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:22.935336 2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T15:33:22.677264583Z","UUID":"b1d9ee6e-51f6-44fc-8adb-d5371cbaa367","Handler":null,"Name":"","Endpoint":""} Jul 28 15:33:22.937108 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:22.937067 2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 15:33:22.937108 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:22.937105 2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 15:33:23.072769 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:23.072736 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:33:23.072949 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:23.072778 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:33:23.072949 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:23.072878 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c5vsn" podUID="55e0d957-598e-40f1-8c9e-8070fd19917a" Jul 28 15:33:23.073203 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:23.073181 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrk89" podUID="f5be64c0-1028-484f-8ee1-fe1de8d758f2" Jul 28 15:33:23.197680 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:23.197598 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-66xhr" Jul 28 15:33:23.295231 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:23.295200 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcl9z" event={"ID":"b8657b72-92f3-4d40-ab11-8db72529434a","Type":"ContainerStarted","Data":"173aa077310426bffbda080a283ca611a86fa7e16b6a65fde54d40cf31d695bb"} Jul 28 15:33:23.296990 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:23.296929 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-khr7d" event={"ID":"a86139c4-7e54-4a71-a016-2af0db258599","Type":"ContainerStarted","Data":"9a1005e8a9e28c21de139a5e053313a4917e0bbf33495b3643f1e500878aabe2"} Jul 28 15:33:23.317716 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:23.317673 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-49c8p" podStartSLOduration=5.211367427 podStartE2EDuration="24.317659956s" totalImagesPullingTime="19.106292529s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:33:22.401352644 +0000 UTC m=+23.870852833" watchObservedRunningTime="2026-07-28 15:33:23.317659956 +0000 UTC m=+24.787160133" Jul 28 15:33:23.318051 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:23.318022 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-khr7d" podStartSLOduration=5.216503204 podStartE2EDuration="24.318015489s" totalImagesPullingTime="19.101512285s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:33:23.317070025 +0000 UTC m=+24.786570203" watchObservedRunningTime="2026-07-28 15:33:23.318015489 +0000 UTC m=+24.787515717" Jul 28 15:33:24.072084 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:24.072048 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:24.072260 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:24.072193 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmlvt" podUID="41a895b0-ed4d-49c9-802e-767b38b9a01e" Jul 28 15:33:24.303813 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:24.303719 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" event={"ID":"8924cfef-adc9-4c4d-a27b-7d048709ea2b","Type":"ContainerStarted","Data":"faf7c957de3da63120b28bddc294ed2fba6a4119256632fdb2910f8217fbc1b2"} Jul 28 15:33:24.305869 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:24.305836 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcl9z" event={"ID":"b8657b72-92f3-4d40-ab11-8db72529434a","Type":"ContainerStarted","Data":"7b72076d2f6ad572595a437ef83923d96c9e5b25236c897c921e437ded25c9a1"} Jul 28 15:33:24.327136 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:24.327082 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcl9z" podStartSLOduration=3.8071327200000002 podStartE2EDuration="25.327063457s" totalImagesPullingTime="21.519930737s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:32:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:33:24.325678438 +0000 UTC m=+25.795178617" watchObservedRunningTime="2026-07-28 15:33:24.327063457 +0000 UTC m=+25.796563639" Jul 28 15:33:25.071772 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:25.071741 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:33:25.071952 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:25.071736 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:33:25.071952 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:25.071847 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c5vsn" podUID="55e0d957-598e-40f1-8c9e-8070fd19917a" Jul 28 15:33:25.071952 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:25.071933 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrk89" podUID="f5be64c0-1028-484f-8ee1-fe1de8d758f2" Jul 28 15:33:26.071892 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:26.071713 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:26.072379 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:26.071965 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmlvt" podUID="41a895b0-ed4d-49c9-802e-767b38b9a01e" Jul 28 15:33:27.072649 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:27.072576 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:33:27.073281 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:27.072686 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c5vsn" podUID="55e0d957-598e-40f1-8c9e-8070fd19917a" Jul 28 15:33:27.073281 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:27.072749 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:33:27.073281 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:27.072872 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrk89" podUID="f5be64c0-1028-484f-8ee1-fe1de8d758f2" Jul 28 15:33:27.126384 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:27.126207 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-66xhr" Jul 28 15:33:27.126780 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:27.126760 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-66xhr" Jul 28 15:33:27.315524 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:27.315489 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" event={"ID":"8924cfef-adc9-4c4d-a27b-7d048709ea2b","Type":"ContainerStarted","Data":"3d2a7a47ad3b5dfc9d32ccdcca6d941fee45d3cf2beb268f5b8f9062600486a3"} Jul 28 15:33:27.315793 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:27.315776 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:27.317384 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:27.317360 2554 generic.go:356] "Generic (PLEG): container finished" podID="5370e1cf-6ffa-48d1-ad1a-ad070a80d79d" containerID="0bc4c9d0de684538f27a83824263a348e8382518f9d3311e1fc451bfde1843f1" exitCode=0 Jul 28 15:33:27.317516 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:27.317392 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xlgxx" event={"ID":"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d","Type":"ContainerDied","Data":"0bc4c9d0de684538f27a83824263a348e8382518f9d3311e1fc451bfde1843f1"} Jul 28 15:33:27.318531 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:27.318108 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-66xhr" Jul 28 15:33:27.333267 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:27.333197 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:27.346776 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:27.346737 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" podStartSLOduration=9.185552679 podStartE2EDuration="28.346723782s" totalImagesPullingTime="19.161171103s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:33:27.345954126 +0000 UTC m=+28.815454304" watchObservedRunningTime="2026-07-28 15:33:27.346723782 +0000 UTC m=+28.816223959" Jul 28 15:33:28.072508 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:28.072473 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:28.072700 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:28.072617 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmlvt" podUID="41a895b0-ed4d-49c9-802e-767b38b9a01e" Jul 28 15:33:28.319788 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:28.319757 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:28.320022 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:28.319846 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:28.335852 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:28.335783 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:33:28.603117 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:28.603058 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jmlvt"] Jul 28 15:33:28.603289 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:28.603185 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:28.603353 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:28.603299 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmlvt" podUID="41a895b0-ed4d-49c9-802e-767b38b9a01e" Jul 28 15:33:28.610149 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:28.610122 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-c5vsn"] Jul 28 15:33:28.610283 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:28.610255 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:33:28.610355 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:28.610337 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c5vsn" podUID="55e0d957-598e-40f1-8c9e-8070fd19917a" Jul 28 15:33:28.610994 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:28.610937 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zrk89"] Jul 28 15:33:28.611099 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:28.611059 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:33:28.611159 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:28.611126 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrk89" podUID="f5be64c0-1028-484f-8ee1-fe1de8d758f2" Jul 28 15:33:29.323839 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:29.323807 2554 generic.go:356] "Generic (PLEG): container finished" podID="5370e1cf-6ffa-48d1-ad1a-ad070a80d79d" containerID="41c3bd83ae6d734ae4c46de03d338d336df35af6ef84e2a232851590c9f945c4" exitCode=0 Jul 28 15:33:29.324323 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:29.323858 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xlgxx" event={"ID":"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d","Type":"ContainerDied","Data":"41c3bd83ae6d734ae4c46de03d338d336df35af6ef84e2a232851590c9f945c4"} Jul 28 15:33:30.071961 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:30.071927 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:33:30.072138 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:30.071927 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:30.072138 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:30.072029 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c5vsn" podUID="55e0d957-598e-40f1-8c9e-8070fd19917a" Jul 28 15:33:30.072249 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:30.072119 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmlvt" podUID="41a895b0-ed4d-49c9-802e-767b38b9a01e" Jul 28 15:33:31.072291 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:31.072110 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:33:31.072756 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:31.072391 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrk89" podUID="f5be64c0-1028-484f-8ee1-fe1de8d758f2" Jul 28 15:33:31.333680 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:31.333600 2554 generic.go:356] "Generic (PLEG): container finished" podID="5370e1cf-6ffa-48d1-ad1a-ad070a80d79d" containerID="b751a78518f77a34c337c257afb4899b71cc8f56eac929f2f339a29a4da066d8" exitCode=0 Jul 28 15:33:31.333680 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:31.333654 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xlgxx" event={"ID":"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d","Type":"ContainerDied","Data":"b751a78518f77a34c337c257afb4899b71cc8f56eac929f2f339a29a4da066d8"} Jul 28 15:33:32.073082 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:32.072639 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:32.073082 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:32.072662 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:33:32.073082 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:32.072768 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmlvt" podUID="41a895b0-ed4d-49c9-802e-767b38b9a01e" Jul 28 15:33:32.073082 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:32.072858 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c5vsn" podUID="55e0d957-598e-40f1-8c9e-8070fd19917a" Jul 28 15:33:32.622963 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:32.622926 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssl7m\" (UniqueName: \"kubernetes.io/projected/55e0d957-598e-40f1-8c9e-8070fd19917a-kube-api-access-ssl7m\") pod \"network-check-target-c5vsn\" (UID: \"55e0d957-598e-40f1-8c9e-8070fd19917a\") " pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:33:32.623157 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:32.622977 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41a895b0-ed4d-49c9-802e-767b38b9a01e-original-pull-secret\") pod \"global-pull-secret-syncer-jmlvt\" (UID: \"41a895b0-ed4d-49c9-802e-767b38b9a01e\") " pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:32.623157 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:32.623093 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 15:33:32.623157 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:32.623114 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 15:33:32.623157 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:32.623143 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 15:33:32.623157 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:32.623152 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a895b0-ed4d-49c9-802e-767b38b9a01e-original-pull-secret podName:41a895b0-ed4d-49c9-802e-767b38b9a01e nodeName:}" failed. No retries permitted until 2026-07-28 15:34:04.623133499 +0000 UTC m=+66.092633656 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41a895b0-ed4d-49c9-802e-767b38b9a01e-original-pull-secret") pod "global-pull-secret-syncer-jmlvt" (UID: "41a895b0-ed4d-49c9-802e-767b38b9a01e") : object "kube-system"/"original-pull-secret" not registered Jul 28 15:33:32.623157 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:32.623156 2554 projected.go:196] Error preparing data for projected volume kube-api-access-ssl7m for pod openshift-network-diagnostics/network-check-target-c5vsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 15:33:32.623459 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:32.623227 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/55e0d957-598e-40f1-8c9e-8070fd19917a-kube-api-access-ssl7m podName:55e0d957-598e-40f1-8c9e-8070fd19917a nodeName:}" failed. No retries permitted until 2026-07-28 15:34:04.623209456 +0000 UTC m=+66.092709612 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ssl7m" (UniqueName: "kubernetes.io/projected/55e0d957-598e-40f1-8c9e-8070fd19917a-kube-api-access-ssl7m") pod "network-check-target-c5vsn" (UID: "55e0d957-598e-40f1-8c9e-8070fd19917a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 15:33:32.724006 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:32.723972 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5be64c0-1028-484f-8ee1-fe1de8d758f2-metrics-certs\") pod \"network-metrics-daemon-zrk89\" (UID: \"f5be64c0-1028-484f-8ee1-fe1de8d758f2\") " pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:33:32.724221 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:32.724151 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 15:33:32.724282 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:32.724233 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5be64c0-1028-484f-8ee1-fe1de8d758f2-metrics-certs podName:f5be64c0-1028-484f-8ee1-fe1de8d758f2 nodeName:}" failed. No retries permitted until 2026-07-28 15:34:04.7242186 +0000 UTC m=+66.193718755 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5be64c0-1028-484f-8ee1-fe1de8d758f2-metrics-certs") pod "network-metrics-daemon-zrk89" (UID: "f5be64c0-1028-484f-8ee1-fe1de8d758f2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 15:33:33.071947 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:33.071914 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:33:33.072119 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:33.072059 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrk89" podUID="f5be64c0-1028-484f-8ee1-fe1de8d758f2" Jul 28 15:33:34.072578 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.072539 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:33:34.073052 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:34.072655 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c5vsn" podUID="55e0d957-598e-40f1-8c9e-8070fd19917a" Jul 28 15:33:34.073052 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.072715 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:34.073052 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:34.072831 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmlvt" podUID="41a895b0-ed4d-49c9-802e-767b38b9a01e" Jul 28 15:33:34.407950 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.407927 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-87.ec2.internal" event="NodeReady" Jul 28 15:33:34.408142 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.408065 2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 15:33:34.461037 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.461000 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wspq5"] Jul 28 15:33:34.464578 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.464550 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bgwn5"] Jul 28 15:33:34.464710 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.464696 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wspq5" Jul 28 15:33:34.466414 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.466391 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bgwn5" Jul 28 15:33:34.467656 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.467628 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bkn7m\"" Jul 28 15:33:34.467656 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.467628 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 15:33:34.468417 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.468397 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 15:33:34.468989 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.468966 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 15:33:34.469091 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.468995 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 15:33:34.469091 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.469030 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lf5lf\"" Jul 28 15:33:34.469091 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.468997 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 15:33:34.475753 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.475735 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wspq5"] Jul 28 15:33:34.492935 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.492909 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bgwn5"] Jul 28 15:33:34.637157 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.637121 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p5qn\" (UniqueName: \"kubernetes.io/projected/b19ceeb0-ef66-415a-b0b3-13b64286b776-kube-api-access-6p5qn\") pod \"ingress-canary-bgwn5\" (UID: \"b19ceeb0-ef66-415a-b0b3-13b64286b776\") " pod="openshift-ingress-canary/ingress-canary-bgwn5" Jul 28 15:33:34.637400 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.637263 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkr27\" (UniqueName: \"kubernetes.io/projected/d0f0bc3e-2d43-4c70-a2b7-ffaea1280559-kube-api-access-fkr27\") pod \"dns-default-wspq5\" (UID: \"d0f0bc3e-2d43-4c70-a2b7-ffaea1280559\") " pod="openshift-dns/dns-default-wspq5" Jul 28 15:33:34.637400 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.637299 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d0f0bc3e-2d43-4c70-a2b7-ffaea1280559-config-volume\") pod \"dns-default-wspq5\" (UID: \"d0f0bc3e-2d43-4c70-a2b7-ffaea1280559\") " pod="openshift-dns/dns-default-wspq5" Jul 28 15:33:34.637400 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.637333 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b19ceeb0-ef66-415a-b0b3-13b64286b776-cert\") pod \"ingress-canary-bgwn5\" (UID: \"b19ceeb0-ef66-415a-b0b3-13b64286b776\") " pod="openshift-ingress-canary/ingress-canary-bgwn5" Jul 28 15:33:34.637553 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.637409 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0f0bc3e-2d43-4c70-a2b7-ffaea1280559-tmp-dir\") pod \"dns-default-wspq5\" (UID: \"d0f0bc3e-2d43-4c70-a2b7-ffaea1280559\") " pod="openshift-dns/dns-default-wspq5" Jul 28 15:33:34.637553 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.637461 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0f0bc3e-2d43-4c70-a2b7-ffaea1280559-metrics-tls\") pod \"dns-default-wspq5\" (UID: \"d0f0bc3e-2d43-4c70-a2b7-ffaea1280559\") " pod="openshift-dns/dns-default-wspq5" Jul 28 15:33:34.737944 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.737859 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0f0bc3e-2d43-4c70-a2b7-ffaea1280559-tmp-dir\") pod \"dns-default-wspq5\" (UID: \"d0f0bc3e-2d43-4c70-a2b7-ffaea1280559\") " pod="openshift-dns/dns-default-wspq5" Jul 28 15:33:34.737944 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.737905 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0f0bc3e-2d43-4c70-a2b7-ffaea1280559-metrics-tls\") pod \"dns-default-wspq5\" (UID: \"d0f0bc3e-2d43-4c70-a2b7-ffaea1280559\") " pod="openshift-dns/dns-default-wspq5" Jul 28 15:33:34.737944 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.737933 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p5qn\" (UniqueName: \"kubernetes.io/projected/b19ceeb0-ef66-415a-b0b3-13b64286b776-kube-api-access-6p5qn\") pod \"ingress-canary-bgwn5\" (UID: \"b19ceeb0-ef66-415a-b0b3-13b64286b776\") " pod="openshift-ingress-canary/ingress-canary-bgwn5" Jul 28 15:33:34.738212 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.737982 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkr27\" (UniqueName: \"kubernetes.io/projected/d0f0bc3e-2d43-4c70-a2b7-ffaea1280559-kube-api-access-fkr27\") pod \"dns-default-wspq5\" (UID: \"d0f0bc3e-2d43-4c70-a2b7-ffaea1280559\") " pod="openshift-dns/dns-default-wspq5" Jul 28 15:33:34.738212 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.738060 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d0f0bc3e-2d43-4c70-a2b7-ffaea1280559-config-volume\") pod \"dns-default-wspq5\" (UID: \"d0f0bc3e-2d43-4c70-a2b7-ffaea1280559\") " pod="openshift-dns/dns-default-wspq5" Jul 28 15:33:34.738212 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:34.738088 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 15:33:34.738212 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.738111 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b19ceeb0-ef66-415a-b0b3-13b64286b776-cert\") pod \"ingress-canary-bgwn5\" (UID: \"b19ceeb0-ef66-415a-b0b3-13b64286b776\") " pod="openshift-ingress-canary/ingress-canary-bgwn5" Jul 28 15:33:34.738212 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:34.738161 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0f0bc3e-2d43-4c70-a2b7-ffaea1280559-metrics-tls podName:d0f0bc3e-2d43-4c70-a2b7-ffaea1280559 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:35.238139157 +0000 UTC m=+36.707639318 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0f0bc3e-2d43-4c70-a2b7-ffaea1280559-metrics-tls") pod "dns-default-wspq5" (UID: "d0f0bc3e-2d43-4c70-a2b7-ffaea1280559") : secret "dns-default-metrics-tls" not found Jul 28 15:33:34.738627 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.738609 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d0f0bc3e-2d43-4c70-a2b7-ffaea1280559-config-volume\") pod \"dns-default-wspq5\" (UID: \"d0f0bc3e-2d43-4c70-a2b7-ffaea1280559\") " pod="openshift-dns/dns-default-wspq5" Jul 28 15:33:34.738696 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.738657 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0f0bc3e-2d43-4c70-a2b7-ffaea1280559-tmp-dir\") pod \"dns-default-wspq5\" (UID: \"d0f0bc3e-2d43-4c70-a2b7-ffaea1280559\") " pod="openshift-dns/dns-default-wspq5" Jul 28 15:33:34.743033 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.743005 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b19ceeb0-ef66-415a-b0b3-13b64286b776-cert\") pod \"ingress-canary-bgwn5\" (UID: \"b19ceeb0-ef66-415a-b0b3-13b64286b776\") " pod="openshift-ingress-canary/ingress-canary-bgwn5" Jul 28 15:33:34.747674 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.747628 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkr27\" (UniqueName: \"kubernetes.io/projected/d0f0bc3e-2d43-4c70-a2b7-ffaea1280559-kube-api-access-fkr27\") pod \"dns-default-wspq5\" (UID: \"d0f0bc3e-2d43-4c70-a2b7-ffaea1280559\") " pod="openshift-dns/dns-default-wspq5" Jul 28 15:33:34.749715 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.749694 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p5qn\" (UniqueName: \"kubernetes.io/projected/b19ceeb0-ef66-415a-b0b3-13b64286b776-kube-api-access-6p5qn\") pod \"ingress-canary-bgwn5\" (UID: \"b19ceeb0-ef66-415a-b0b3-13b64286b776\") " pod="openshift-ingress-canary/ingress-canary-bgwn5" Jul 28 15:33:34.782670 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:34.782639 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bgwn5" Jul 28 15:33:35.071973 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:35.071939 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:33:35.076085 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:35.076065 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-25sjx\"" Jul 28 15:33:35.077146 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:35.077128 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 15:33:35.242624 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:35.241876 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0f0bc3e-2d43-4c70-a2b7-ffaea1280559-metrics-tls\") pod \"dns-default-wspq5\" (UID: \"d0f0bc3e-2d43-4c70-a2b7-ffaea1280559\") " pod="openshift-dns/dns-default-wspq5" Jul 28 15:33:35.242624 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:35.242094 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 15:33:35.242624 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:35.242430 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0f0bc3e-2d43-4c70-a2b7-ffaea1280559-metrics-tls podName:d0f0bc3e-2d43-4c70-a2b7-ffaea1280559 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:36.242398615 +0000 UTC m=+37.711898785 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0f0bc3e-2d43-4c70-a2b7-ffaea1280559-metrics-tls") pod "dns-default-wspq5" (UID: "d0f0bc3e-2d43-4c70-a2b7-ffaea1280559") : secret "dns-default-metrics-tls" not found Jul 28 15:33:35.322354 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:35.322268 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bgwn5"] Jul 28 15:33:35.327037 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:33:35.326939 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb19ceeb0_ef66_415a_b0b3_13b64286b776.slice/crio-b41149e938b7a96f3b0dcae0b57c8f2bf7c5a71c9c4f65154c50670a4c319153 WatchSource:0}: Error finding container b41149e938b7a96f3b0dcae0b57c8f2bf7c5a71c9c4f65154c50670a4c319153: Status 404 returned error can't find the container with id b41149e938b7a96f3b0dcae0b57c8f2bf7c5a71c9c4f65154c50670a4c319153 Jul 28 15:33:35.345220 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:35.345196 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bgwn5" event={"ID":"b19ceeb0-ef66-415a-b0b3-13b64286b776","Type":"ContainerStarted","Data":"b41149e938b7a96f3b0dcae0b57c8f2bf7c5a71c9c4f65154c50670a4c319153"} Jul 28 15:33:35.348064 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:35.348039 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xlgxx" event={"ID":"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d","Type":"ContainerStarted","Data":"626937fcc03fcdfc6469671f02aacae20bef7aed46f17b301593e03bf3744940"} Jul 28 15:33:36.072392 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:36.072349 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:33:36.072616 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:36.072588 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:33:36.075350 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:36.075329 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 15:33:36.075574 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:36.075555 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x2697\"" Jul 28 15:33:36.075985 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:36.075962 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 15:33:36.076083 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:36.075962 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 15:33:36.251732 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:36.251697 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0f0bc3e-2d43-4c70-a2b7-ffaea1280559-metrics-tls\") pod \"dns-default-wspq5\" (UID: \"d0f0bc3e-2d43-4c70-a2b7-ffaea1280559\") " pod="openshift-dns/dns-default-wspq5" Jul 28 15:33:36.252181 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:36.251841 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 15:33:36.252181 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:36.251923 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0f0bc3e-2d43-4c70-a2b7-ffaea1280559-metrics-tls podName:d0f0bc3e-2d43-4c70-a2b7-ffaea1280559 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:38.251901881 +0000 UTC m=+39.721402041 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0f0bc3e-2d43-4c70-a2b7-ffaea1280559-metrics-tls") pod "dns-default-wspq5" (UID: "d0f0bc3e-2d43-4c70-a2b7-ffaea1280559") : secret "dns-default-metrics-tls" not found Jul 28 15:33:36.354119 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:36.354038 2554 generic.go:356] "Generic (PLEG): container finished" podID="5370e1cf-6ffa-48d1-ad1a-ad070a80d79d" containerID="626937fcc03fcdfc6469671f02aacae20bef7aed46f17b301593e03bf3744940" exitCode=0 Jul 28 15:33:36.354119 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:36.354071 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xlgxx" event={"ID":"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d","Type":"ContainerDied","Data":"626937fcc03fcdfc6469671f02aacae20bef7aed46f17b301593e03bf3744940"} Jul 28 15:33:36.753381 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:36.753303 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-mnjzv"] Jul 28 15:33:36.755748 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:36.755717 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mnjzv" Jul 28 15:33:36.759270 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:36.759246 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 15:33:36.760213 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:36.760050 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 28 15:33:36.760213 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:36.760067 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 28 15:33:36.760213 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:36.760077 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vkl8k\"" Jul 28 15:33:36.760213 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:36.760069 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 15:33:36.771057 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:36.771035 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-mnjzv"] Jul 28 15:33:36.855502 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:36.855468 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f154434-fcc0-4a8e-a19e-f87c6df93f13-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mnjzv\" (UID: \"6f154434-fcc0-4a8e-a19e-f87c6df93f13\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mnjzv" Jul 28 15:33:36.855692 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:36.855518 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6f154434-fcc0-4a8e-a19e-f87c6df93f13-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-mnjzv\" (UID: \"6f154434-fcc0-4a8e-a19e-f87c6df93f13\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mnjzv" Jul 28 15:33:36.855692 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:36.855568 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7zjq\" (UniqueName: \"kubernetes.io/projected/6f154434-fcc0-4a8e-a19e-f87c6df93f13-kube-api-access-w7zjq\") pod \"cluster-monitoring-operator-548b489cb8-mnjzv\" (UID: \"6f154434-fcc0-4a8e-a19e-f87c6df93f13\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mnjzv" Jul 28 15:33:36.956399 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:36.956360 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f154434-fcc0-4a8e-a19e-f87c6df93f13-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mnjzv\" (UID: \"6f154434-fcc0-4a8e-a19e-f87c6df93f13\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mnjzv" Jul 28 15:33:36.956588 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:36.956420 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6f154434-fcc0-4a8e-a19e-f87c6df93f13-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-mnjzv\" (UID: \"6f154434-fcc0-4a8e-a19e-f87c6df93f13\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mnjzv" Jul 28 15:33:36.956588 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:36.956478 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7zjq\" (UniqueName: \"kubernetes.io/projected/6f154434-fcc0-4a8e-a19e-f87c6df93f13-kube-api-access-w7zjq\") pod \"cluster-monitoring-operator-548b489cb8-mnjzv\" (UID: \"6f154434-fcc0-4a8e-a19e-f87c6df93f13\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mnjzv" Jul 28 15:33:36.956588 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:36.956543 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 15:33:36.956734 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:36.956609 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f154434-fcc0-4a8e-a19e-f87c6df93f13-cluster-monitoring-operator-tls podName:6f154434-fcc0-4a8e-a19e-f87c6df93f13 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:37.456589894 +0000 UTC m=+38.926090050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f154434-fcc0-4a8e-a19e-f87c6df93f13-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-mnjzv" (UID: "6f154434-fcc0-4a8e-a19e-f87c6df93f13") : secret "cluster-monitoring-operator-tls" not found Jul 28 15:33:36.957324 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:36.957302 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6f154434-fcc0-4a8e-a19e-f87c6df93f13-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-mnjzv\" (UID: \"6f154434-fcc0-4a8e-a19e-f87c6df93f13\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mnjzv" Jul 28 15:33:36.966693 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:36.966662 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7zjq\" (UniqueName: \"kubernetes.io/projected/6f154434-fcc0-4a8e-a19e-f87c6df93f13-kube-api-access-w7zjq\") pod \"cluster-monitoring-operator-548b489cb8-mnjzv\" (UID: \"6f154434-fcc0-4a8e-a19e-f87c6df93f13\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mnjzv" Jul 28 15:33:37.359900 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:37.359854 2554 generic.go:356] "Generic (PLEG): container finished" podID="5370e1cf-6ffa-48d1-ad1a-ad070a80d79d" containerID="3aa9fba6f4d635601c24b537868e50ad5a6f3b272c25072091a8fe640f7acb1a" exitCode=0 Jul 28 15:33:37.360290 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:37.359908 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xlgxx" event={"ID":"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d","Type":"ContainerDied","Data":"3aa9fba6f4d635601c24b537868e50ad5a6f3b272c25072091a8fe640f7acb1a"} Jul 28 15:33:37.461032 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:37.460642 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f154434-fcc0-4a8e-a19e-f87c6df93f13-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mnjzv\" (UID: \"6f154434-fcc0-4a8e-a19e-f87c6df93f13\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mnjzv" Jul 28 15:33:37.461032 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:37.460919 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 15:33:37.461032 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:37.460983 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f154434-fcc0-4a8e-a19e-f87c6df93f13-cluster-monitoring-operator-tls podName:6f154434-fcc0-4a8e-a19e-f87c6df93f13 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:38.460961578 +0000 UTC m=+39.930461734 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f154434-fcc0-4a8e-a19e-f87c6df93f13-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-mnjzv" (UID: "6f154434-fcc0-4a8e-a19e-f87c6df93f13") : secret "cluster-monitoring-operator-tls" not found Jul 28 15:33:38.266221 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:38.266183 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0f0bc3e-2d43-4c70-a2b7-ffaea1280559-metrics-tls\") pod \"dns-default-wspq5\" (UID: \"d0f0bc3e-2d43-4c70-a2b7-ffaea1280559\") " pod="openshift-dns/dns-default-wspq5" Jul 28 15:33:38.266364 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:38.266322 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 15:33:38.266425 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:38.266393 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0f0bc3e-2d43-4c70-a2b7-ffaea1280559-metrics-tls podName:d0f0bc3e-2d43-4c70-a2b7-ffaea1280559 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:42.266378788 +0000 UTC m=+43.735878945 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0f0bc3e-2d43-4c70-a2b7-ffaea1280559-metrics-tls") pod "dns-default-wspq5" (UID: "d0f0bc3e-2d43-4c70-a2b7-ffaea1280559") : secret "dns-default-metrics-tls" not found Jul 28 15:33:38.363977 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:38.363946 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bgwn5" event={"ID":"b19ceeb0-ef66-415a-b0b3-13b64286b776","Type":"ContainerStarted","Data":"aec1a36c16e1bef2d3141a78f04757942a37f931dd73ac88a3e39b8b538ecc77"} Jul 28 15:33:38.366990 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:38.366963 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xlgxx" event={"ID":"5370e1cf-6ffa-48d1-ad1a-ad070a80d79d","Type":"ContainerStarted","Data":"989fa6ce2cb3af222bb06836e85c861e26e90997d7585388a0942cd88fbc77f6"} Jul 28 15:33:38.384020 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:38.383971 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bgwn5" podStartSLOduration=2.309611281 podStartE2EDuration="4.383957698s" totalImagesPullingTime="2.074346417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:33:38.383069969 +0000 UTC m=+39.852570144" watchObservedRunningTime="2026-07-28 15:33:38.383957698 +0000 UTC m=+39.853457853" Jul 28 15:33:38.406657 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:38.406613 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xlgxx" podStartSLOduration=9.336575216 podStartE2EDuration="39.406599282s" totalImagesPullingTime="30.070024066s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:32:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:33:38.40525659 +0000 UTC m=+39.874756768" watchObservedRunningTime="2026-07-28 15:33:38.406599282 +0000 UTC m=+39.876099459" Jul 28 15:33:38.467202 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:38.466853 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f154434-fcc0-4a8e-a19e-f87c6df93f13-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mnjzv\" (UID: \"6f154434-fcc0-4a8e-a19e-f87c6df93f13\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mnjzv" Jul 28 15:33:38.467202 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:38.467001 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 15:33:38.467202 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:38.467096 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f154434-fcc0-4a8e-a19e-f87c6df93f13-cluster-monitoring-operator-tls podName:6f154434-fcc0-4a8e-a19e-f87c6df93f13 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:40.46707239 +0000 UTC m=+41.936572549 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f154434-fcc0-4a8e-a19e-f87c6df93f13-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-mnjzv" (UID: "6f154434-fcc0-4a8e-a19e-f87c6df93f13") : secret "cluster-monitoring-operator-tls" not found Jul 28 15:33:39.767939 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:39.767901 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lwlsp"] Jul 28 15:33:39.795045 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:39.795012 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lwlsp" Jul 28 15:33:39.795589 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:39.795551 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lwlsp"] Jul 28 15:33:39.799434 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:39.799413 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 28 15:33:39.799554 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:39.799413 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 28 15:33:39.799730 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:39.799715 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 28 15:33:39.800293 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:39.800274 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-k2xwc\"" Jul 28 15:33:39.979904 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:39.979869 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9llqh\" (UniqueName: \"kubernetes.io/projected/fdeb8917-db2c-4d6f-980d-673955311179-kube-api-access-9llqh\") pod \"cluster-samples-operator-6748489656-lwlsp\" (UID: \"fdeb8917-db2c-4d6f-980d-673955311179\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lwlsp" Jul 28 15:33:39.980040 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:39.980020 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fdeb8917-db2c-4d6f-980d-673955311179-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lwlsp\" (UID: \"fdeb8917-db2c-4d6f-980d-673955311179\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lwlsp" Jul 28 15:33:40.080817 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:40.080733 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fdeb8917-db2c-4d6f-980d-673955311179-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lwlsp\" (UID: \"fdeb8917-db2c-4d6f-980d-673955311179\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lwlsp" Jul 28 15:33:40.080817 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:40.080783 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9llqh\" (UniqueName: \"kubernetes.io/projected/fdeb8917-db2c-4d6f-980d-673955311179-kube-api-access-9llqh\") pod \"cluster-samples-operator-6748489656-lwlsp\" (UID: \"fdeb8917-db2c-4d6f-980d-673955311179\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lwlsp" Jul 28 15:33:40.080974 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:40.080915 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 15:33:40.081012 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:40.080981 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdeb8917-db2c-4d6f-980d-673955311179-samples-operator-tls podName:fdeb8917-db2c-4d6f-980d-673955311179 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:40.580965113 +0000 UTC m=+42.050465269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fdeb8917-db2c-4d6f-980d-673955311179-samples-operator-tls") pod "cluster-samples-operator-6748489656-lwlsp" (UID: "fdeb8917-db2c-4d6f-980d-673955311179") : secret "samples-operator-tls" not found Jul 28 15:33:40.098819 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:40.098788 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9llqh\" (UniqueName: \"kubernetes.io/projected/fdeb8917-db2c-4d6f-980d-673955311179-kube-api-access-9llqh\") pod \"cluster-samples-operator-6748489656-lwlsp\" (UID: \"fdeb8917-db2c-4d6f-980d-673955311179\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lwlsp" Jul 28 15:33:40.485033 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:40.484943 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f154434-fcc0-4a8e-a19e-f87c6df93f13-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mnjzv\" (UID: \"6f154434-fcc0-4a8e-a19e-f87c6df93f13\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mnjzv" Jul 28 15:33:40.485207 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:40.485091 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 15:33:40.485207 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:40.485160 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f154434-fcc0-4a8e-a19e-f87c6df93f13-cluster-monitoring-operator-tls podName:6f154434-fcc0-4a8e-a19e-f87c6df93f13 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:44.48514192 +0000 UTC m=+45.954642076 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f154434-fcc0-4a8e-a19e-f87c6df93f13-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-mnjzv" (UID: "6f154434-fcc0-4a8e-a19e-f87c6df93f13") : secret "cluster-monitoring-operator-tls" not found Jul 28 15:33:40.585418 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:40.585387 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fdeb8917-db2c-4d6f-980d-673955311179-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lwlsp\" (UID: \"fdeb8917-db2c-4d6f-980d-673955311179\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lwlsp" Jul 28 15:33:40.585565 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:40.585543 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 15:33:40.585636 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:40.585626 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdeb8917-db2c-4d6f-980d-673955311179-samples-operator-tls podName:fdeb8917-db2c-4d6f-980d-673955311179 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:41.585607469 +0000 UTC m=+43.055107626 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fdeb8917-db2c-4d6f-980d-673955311179-samples-operator-tls") pod "cluster-samples-operator-6748489656-lwlsp" (UID: "fdeb8917-db2c-4d6f-980d-673955311179") : secret "samples-operator-tls" not found Jul 28 15:33:41.592357 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:41.592318 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fdeb8917-db2c-4d6f-980d-673955311179-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lwlsp\" (UID: \"fdeb8917-db2c-4d6f-980d-673955311179\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lwlsp" Jul 28 15:33:41.592747 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:41.592462 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 15:33:41.592747 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:41.592527 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdeb8917-db2c-4d6f-980d-673955311179-samples-operator-tls podName:fdeb8917-db2c-4d6f-980d-673955311179 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:43.592510708 +0000 UTC m=+45.062010864 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fdeb8917-db2c-4d6f-980d-673955311179-samples-operator-tls") pod "cluster-samples-operator-6748489656-lwlsp" (UID: "fdeb8917-db2c-4d6f-980d-673955311179") : secret "samples-operator-tls" not found Jul 28 15:33:42.297626 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:42.297590 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0f0bc3e-2d43-4c70-a2b7-ffaea1280559-metrics-tls\") pod \"dns-default-wspq5\" (UID: \"d0f0bc3e-2d43-4c70-a2b7-ffaea1280559\") " pod="openshift-dns/dns-default-wspq5" Jul 28 15:33:42.297794 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:42.297739 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 15:33:42.297836 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:42.297801 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0f0bc3e-2d43-4c70-a2b7-ffaea1280559-metrics-tls podName:d0f0bc3e-2d43-4c70-a2b7-ffaea1280559 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:50.297787853 +0000 UTC m=+51.767288009 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0f0bc3e-2d43-4c70-a2b7-ffaea1280559-metrics-tls") pod "dns-default-wspq5" (UID: "d0f0bc3e-2d43-4c70-a2b7-ffaea1280559") : secret "dns-default-metrics-tls" not found Jul 28 15:33:43.609572 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:43.609527 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fdeb8917-db2c-4d6f-980d-673955311179-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lwlsp\" (UID: \"fdeb8917-db2c-4d6f-980d-673955311179\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lwlsp" Jul 28 15:33:43.609956 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:43.609687 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 15:33:43.609956 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:43.609748 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdeb8917-db2c-4d6f-980d-673955311179-samples-operator-tls podName:fdeb8917-db2c-4d6f-980d-673955311179 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:47.609731345 +0000 UTC m=+49.079231503 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fdeb8917-db2c-4d6f-980d-673955311179-samples-operator-tls") pod "cluster-samples-operator-6748489656-lwlsp" (UID: "fdeb8917-db2c-4d6f-980d-673955311179") : secret "samples-operator-tls" not found Jul 28 15:33:43.787273 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:43.787242 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zl8kx"] Jul 28 15:33:43.818129 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:43.818085 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zl8kx"] Jul 28 15:33:43.818282 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:43.818217 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zl8kx" Jul 28 15:33:43.820609 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:43.820589 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 15:33:43.820736 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:43.820706 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 15:33:43.820857 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:43.820835 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wgs6z\"" Jul 28 15:33:43.820982 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:43.820901 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 15:33:43.821323 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:43.821307 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 15:33:44.012226 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:44.012187 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8b205f56-5230-402a-8d99-e8f21735c842-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zl8kx\" (UID: \"8b205f56-5230-402a-8d99-e8f21735c842\") " pod="openshift-insights/insights-runtime-extractor-zl8kx" Jul 28 15:33:44.012375 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:44.012255 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8b205f56-5230-402a-8d99-e8f21735c842-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zl8kx\" (UID: \"8b205f56-5230-402a-8d99-e8f21735c842\") " pod="openshift-insights/insights-runtime-extractor-zl8kx" Jul 28 15:33:44.012375 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:44.012323 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtf5h\" (UniqueName: \"kubernetes.io/projected/8b205f56-5230-402a-8d99-e8f21735c842-kube-api-access-vtf5h\") pod \"insights-runtime-extractor-zl8kx\" (UID: \"8b205f56-5230-402a-8d99-e8f21735c842\") " pod="openshift-insights/insights-runtime-extractor-zl8kx" Jul 28 15:33:44.012375 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:44.012364 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8b205f56-5230-402a-8d99-e8f21735c842-crio-socket\") pod \"insights-runtime-extractor-zl8kx\" (UID: \"8b205f56-5230-402a-8d99-e8f21735c842\") " pod="openshift-insights/insights-runtime-extractor-zl8kx" Jul 28 15:33:44.012470 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:44.012384 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8b205f56-5230-402a-8d99-e8f21735c842-data-volume\") pod \"insights-runtime-extractor-zl8kx\" (UID: \"8b205f56-5230-402a-8d99-e8f21735c842\") " pod="openshift-insights/insights-runtime-extractor-zl8kx" Jul 28 15:33:44.112905 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:44.112872 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtf5h\" (UniqueName: \"kubernetes.io/projected/8b205f56-5230-402a-8d99-e8f21735c842-kube-api-access-vtf5h\") pod \"insights-runtime-extractor-zl8kx\" (UID: \"8b205f56-5230-402a-8d99-e8f21735c842\") " pod="openshift-insights/insights-runtime-extractor-zl8kx" Jul 28 15:33:44.113040 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:44.112911 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8b205f56-5230-402a-8d99-e8f21735c842-crio-socket\") pod \"insights-runtime-extractor-zl8kx\" (UID: \"8b205f56-5230-402a-8d99-e8f21735c842\") " pod="openshift-insights/insights-runtime-extractor-zl8kx" Jul 28 15:33:44.113040 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:44.112929 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8b205f56-5230-402a-8d99-e8f21735c842-data-volume\") pod \"insights-runtime-extractor-zl8kx\" (UID: \"8b205f56-5230-402a-8d99-e8f21735c842\") " pod="openshift-insights/insights-runtime-extractor-zl8kx" Jul 28 15:33:44.113040 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:44.112992 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8b205f56-5230-402a-8d99-e8f21735c842-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zl8kx\" (UID: \"8b205f56-5230-402a-8d99-e8f21735c842\") " pod="openshift-insights/insights-runtime-extractor-zl8kx" Jul 28 15:33:44.113228 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:44.113047 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8b205f56-5230-402a-8d99-e8f21735c842-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zl8kx\" (UID: \"8b205f56-5230-402a-8d99-e8f21735c842\") " pod="openshift-insights/insights-runtime-extractor-zl8kx" Jul 28 15:33:44.113228 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:44.113092 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8b205f56-5230-402a-8d99-e8f21735c842-crio-socket\") pod \"insights-runtime-extractor-zl8kx\" (UID: \"8b205f56-5230-402a-8d99-e8f21735c842\") " pod="openshift-insights/insights-runtime-extractor-zl8kx" Jul 28 15:33:44.113228 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:44.113112 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 15:33:44.113362 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:44.113242 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 15:33:44.113362 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:44.113265 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8b205f56-5230-402a-8d99-e8f21735c842-kube-rbac-proxy-cm podName:8b205f56-5230-402a-8d99-e8f21735c842 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:44.613243032 +0000 UTC m=+46.082743191 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8b205f56-5230-402a-8d99-e8f21735c842-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zl8kx" (UID: "8b205f56-5230-402a-8d99-e8f21735c842") : configmap "kube-rbac-proxy" not found Jul 28 15:33:44.113362 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:44.113317 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b205f56-5230-402a-8d99-e8f21735c842-insights-runtime-extractor-tls podName:8b205f56-5230-402a-8d99-e8f21735c842 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:44.613297727 +0000 UTC m=+46.082797904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8b205f56-5230-402a-8d99-e8f21735c842-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zl8kx" (UID: "8b205f56-5230-402a-8d99-e8f21735c842") : secret "insights-runtime-extractor-tls" not found Jul 28 15:33:44.113493 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:44.113470 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8b205f56-5230-402a-8d99-e8f21735c842-data-volume\") pod \"insights-runtime-extractor-zl8kx\" (UID: \"8b205f56-5230-402a-8d99-e8f21735c842\") " pod="openshift-insights/insights-runtime-extractor-zl8kx" Jul 28 15:33:44.124214 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:44.124190 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtf5h\" (UniqueName: \"kubernetes.io/projected/8b205f56-5230-402a-8d99-e8f21735c842-kube-api-access-vtf5h\") pod \"insights-runtime-extractor-zl8kx\" (UID: \"8b205f56-5230-402a-8d99-e8f21735c842\") " pod="openshift-insights/insights-runtime-extractor-zl8kx" Jul 28 15:33:44.517198 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:44.517153 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f154434-fcc0-4a8e-a19e-f87c6df93f13-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mnjzv\" (UID: \"6f154434-fcc0-4a8e-a19e-f87c6df93f13\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mnjzv" Jul 28 15:33:44.517380 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:44.517296 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 15:33:44.517380 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:44.517369 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f154434-fcc0-4a8e-a19e-f87c6df93f13-cluster-monitoring-operator-tls podName:6f154434-fcc0-4a8e-a19e-f87c6df93f13 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:52.517353816 +0000 UTC m=+53.986853972 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f154434-fcc0-4a8e-a19e-f87c6df93f13-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-mnjzv" (UID: "6f154434-fcc0-4a8e-a19e-f87c6df93f13") : secret "cluster-monitoring-operator-tls" not found Jul 28 15:33:44.617531 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:44.617496 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8b205f56-5230-402a-8d99-e8f21735c842-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zl8kx\" (UID: \"8b205f56-5230-402a-8d99-e8f21735c842\") " pod="openshift-insights/insights-runtime-extractor-zl8kx" Jul 28 15:33:44.617962 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:44.617590 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8b205f56-5230-402a-8d99-e8f21735c842-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zl8kx\" (UID: \"8b205f56-5230-402a-8d99-e8f21735c842\") " pod="openshift-insights/insights-runtime-extractor-zl8kx" Jul 28 15:33:44.617962 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:44.617622 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 15:33:44.617962 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:44.617687 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 15:33:44.617962 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:44.617723 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8b205f56-5230-402a-8d99-e8f21735c842-kube-rbac-proxy-cm podName:8b205f56-5230-402a-8d99-e8f21735c842 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:45.61770517 +0000 UTC m=+47.087205343 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8b205f56-5230-402a-8d99-e8f21735c842-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zl8kx" (UID: "8b205f56-5230-402a-8d99-e8f21735c842") : configmap "kube-rbac-proxy" not found Jul 28 15:33:44.617962 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:44.617743 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b205f56-5230-402a-8d99-e8f21735c842-insights-runtime-extractor-tls podName:8b205f56-5230-402a-8d99-e8f21735c842 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:45.617732435 +0000 UTC m=+47.087232591 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8b205f56-5230-402a-8d99-e8f21735c842-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zl8kx" (UID: "8b205f56-5230-402a-8d99-e8f21735c842") : secret "insights-runtime-extractor-tls" not found Jul 28 15:33:44.771424 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:44.771340 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8d4wr"] Jul 28 15:33:44.805346 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:44.805313 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8d4wr"] Jul 28 15:33:44.805513 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:44.805425 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8d4wr" Jul 28 15:33:44.815413 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:44.815392 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 28 15:33:44.818555 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:44.818535 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 28 15:33:44.818652 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:44.818537 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 28 15:33:44.819235 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:44.819199 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-b87fd\"" Jul 28 15:33:44.819324 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:44.819290 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 28 15:33:44.919915 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:44.919880 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bd673619-a13c-46ec-9b3b-11a7701e7153-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-8d4wr\" (UID: \"bd673619-a13c-46ec-9b3b-11a7701e7153\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8d4wr" Jul 28 15:33:44.919915 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:44.919927 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bd673619-a13c-46ec-9b3b-11a7701e7153-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-8d4wr\" (UID: \"bd673619-a13c-46ec-9b3b-11a7701e7153\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8d4wr" Jul 28 15:33:44.920125 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:44.919964 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgtcv\" (UniqueName: \"kubernetes.io/projected/bd673619-a13c-46ec-9b3b-11a7701e7153-kube-api-access-qgtcv\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-8d4wr\" (UID: \"bd673619-a13c-46ec-9b3b-11a7701e7153\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8d4wr" Jul 28 15:33:45.020631 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:45.020602 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bd673619-a13c-46ec-9b3b-11a7701e7153-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-8d4wr\" (UID: \"bd673619-a13c-46ec-9b3b-11a7701e7153\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8d4wr" Jul 28 15:33:45.020728 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:45.020643 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bd673619-a13c-46ec-9b3b-11a7701e7153-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-8d4wr\" (UID: \"bd673619-a13c-46ec-9b3b-11a7701e7153\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8d4wr" Jul 28 15:33:45.020728 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:45.020686 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgtcv\" (UniqueName: \"kubernetes.io/projected/bd673619-a13c-46ec-9b3b-11a7701e7153-kube-api-access-qgtcv\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-8d4wr\" (UID: \"bd673619-a13c-46ec-9b3b-11a7701e7153\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8d4wr" Jul 28 15:33:45.021296 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:45.021240 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bd673619-a13c-46ec-9b3b-11a7701e7153-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-8d4wr\" (UID: \"bd673619-a13c-46ec-9b3b-11a7701e7153\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8d4wr" Jul 28 15:33:45.022957 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:45.022908 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bd673619-a13c-46ec-9b3b-11a7701e7153-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-8d4wr\" (UID: \"bd673619-a13c-46ec-9b3b-11a7701e7153\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8d4wr" Jul 28 15:33:45.034724 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:45.034695 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgtcv\" (UniqueName: \"kubernetes.io/projected/bd673619-a13c-46ec-9b3b-11a7701e7153-kube-api-access-qgtcv\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-8d4wr\" (UID: \"bd673619-a13c-46ec-9b3b-11a7701e7153\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8d4wr" Jul 28 15:33:45.114776 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:45.114739 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8d4wr" Jul 28 15:33:45.279415 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:45.279326 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8d4wr"] Jul 28 15:33:45.282904 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:33:45.282874 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd673619_a13c_46ec_9b3b_11a7701e7153.slice/crio-468b32395d3eda4a5a09ec8aef6862a4de346f1f99de87329ae6663c8cd53af7 WatchSource:0}: Error finding container 468b32395d3eda4a5a09ec8aef6862a4de346f1f99de87329ae6663c8cd53af7: Status 404 returned error can't find the container with id 468b32395d3eda4a5a09ec8aef6862a4de346f1f99de87329ae6663c8cd53af7 Jul 28 15:33:45.385144 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:45.385112 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8d4wr" event={"ID":"bd673619-a13c-46ec-9b3b-11a7701e7153","Type":"ContainerStarted","Data":"468b32395d3eda4a5a09ec8aef6862a4de346f1f99de87329ae6663c8cd53af7"} Jul 28 15:33:45.624989 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:45.624908 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8b205f56-5230-402a-8d99-e8f21735c842-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zl8kx\" (UID: \"8b205f56-5230-402a-8d99-e8f21735c842\") " pod="openshift-insights/insights-runtime-extractor-zl8kx" Jul 28 15:33:45.625409 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:45.625007 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8b205f56-5230-402a-8d99-e8f21735c842-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zl8kx\" (UID: \"8b205f56-5230-402a-8d99-e8f21735c842\") " pod="openshift-insights/insights-runtime-extractor-zl8kx" Jul 28 15:33:45.625409 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:45.625052 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 15:33:45.625409 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:45.625111 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 15:33:45.625409 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:45.625140 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8b205f56-5230-402a-8d99-e8f21735c842-kube-rbac-proxy-cm podName:8b205f56-5230-402a-8d99-e8f21735c842 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:47.625116753 +0000 UTC m=+49.094616912 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8b205f56-5230-402a-8d99-e8f21735c842-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zl8kx" (UID: "8b205f56-5230-402a-8d99-e8f21735c842") : configmap "kube-rbac-proxy" not found Jul 28 15:33:45.625409 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:45.625161 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b205f56-5230-402a-8d99-e8f21735c842-insights-runtime-extractor-tls podName:8b205f56-5230-402a-8d99-e8f21735c842 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:47.625151754 +0000 UTC m=+49.094651910 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8b205f56-5230-402a-8d99-e8f21735c842-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zl8kx" (UID: "8b205f56-5230-402a-8d99-e8f21735c842") : secret "insights-runtime-extractor-tls" not found Jul 28 15:33:45.764104 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:45.764077 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jr9vs_5c47c65a-9647-4f2e-a2c4-141989020177/dns-node-resolver/0.log" Jul 28 15:33:46.364001 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:46.363970 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-49c8p_3584627f-0efc-4d20-bac4-72b209a1f45a/node-ca/0.log" Jul 28 15:33:46.791082 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:46.791048 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-r5sgq"] Jul 28 15:33:46.811948 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:46.811913 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-r5sgq"] Jul 28 15:33:46.812125 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:46.812062 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-r5sgq" Jul 28 15:33:46.814741 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:46.814717 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 28 15:33:46.814855 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:46.814760 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 28 15:33:46.814930 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:46.814717 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 28 15:33:46.815272 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:46.815254 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 28 15:33:46.815272 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:46.815263 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-f9774\"" Jul 28 15:33:46.934437 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:46.934398 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1dbc5496-4a3a-43cf-9084-aaef1fab6b83-config\") pod \"service-ca-operator-5d6c75f84f-r5sgq\" (UID: \"1dbc5496-4a3a-43cf-9084-aaef1fab6b83\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-r5sgq" Jul 28 15:33:46.934614 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:46.934517 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1dbc5496-4a3a-43cf-9084-aaef1fab6b83-serving-cert\") pod \"service-ca-operator-5d6c75f84f-r5sgq\" (UID: \"1dbc5496-4a3a-43cf-9084-aaef1fab6b83\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-r5sgq" Jul 28 15:33:46.934614 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:46.934571 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvqhl\" (UniqueName: \"kubernetes.io/projected/1dbc5496-4a3a-43cf-9084-aaef1fab6b83-kube-api-access-kvqhl\") pod \"service-ca-operator-5d6c75f84f-r5sgq\" (UID: \"1dbc5496-4a3a-43cf-9084-aaef1fab6b83\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-r5sgq" Jul 28 15:33:47.035069 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:47.035035 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1dbc5496-4a3a-43cf-9084-aaef1fab6b83-config\") pod \"service-ca-operator-5d6c75f84f-r5sgq\" (UID: \"1dbc5496-4a3a-43cf-9084-aaef1fab6b83\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-r5sgq" Jul 28 15:33:47.035264 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:47.035109 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1dbc5496-4a3a-43cf-9084-aaef1fab6b83-serving-cert\") pod \"service-ca-operator-5d6c75f84f-r5sgq\" (UID: \"1dbc5496-4a3a-43cf-9084-aaef1fab6b83\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-r5sgq" Jul 28 15:33:47.035264 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:47.035138 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvqhl\" (UniqueName: \"kubernetes.io/projected/1dbc5496-4a3a-43cf-9084-aaef1fab6b83-kube-api-access-kvqhl\") pod \"service-ca-operator-5d6c75f84f-r5sgq\" (UID: \"1dbc5496-4a3a-43cf-9084-aaef1fab6b83\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-r5sgq" Jul 28 15:33:47.035621 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:47.035595 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1dbc5496-4a3a-43cf-9084-aaef1fab6b83-config\") pod \"service-ca-operator-5d6c75f84f-r5sgq\" (UID: \"1dbc5496-4a3a-43cf-9084-aaef1fab6b83\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-r5sgq" Jul 28 15:33:47.037970 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:47.037947 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1dbc5496-4a3a-43cf-9084-aaef1fab6b83-serving-cert\") pod \"service-ca-operator-5d6c75f84f-r5sgq\" (UID: \"1dbc5496-4a3a-43cf-9084-aaef1fab6b83\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-r5sgq" Jul 28 15:33:47.045758 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:47.045466 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvqhl\" (UniqueName: \"kubernetes.io/projected/1dbc5496-4a3a-43cf-9084-aaef1fab6b83-kube-api-access-kvqhl\") pod \"service-ca-operator-5d6c75f84f-r5sgq\" (UID: \"1dbc5496-4a3a-43cf-9084-aaef1fab6b83\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-r5sgq" Jul 28 15:33:47.123032 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:47.122999 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-r5sgq" Jul 28 15:33:47.164746 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:47.164720 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bgwn5_b19ceeb0-ef66-415a-b0b3-13b64286b776/serve-healthcheck-canary/0.log" Jul 28 15:33:47.265702 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:47.265671 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-r5sgq"] Jul 28 15:33:47.384265 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:33:47.384194 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dbc5496_4a3a_43cf_9084_aaef1fab6b83.slice/crio-b69224b510befb9d664409556eb793577254d5654bb42a7c87960a00af6860d2 WatchSource:0}: Error finding container b69224b510befb9d664409556eb793577254d5654bb42a7c87960a00af6860d2: Status 404 returned error can't find the container with id b69224b510befb9d664409556eb793577254d5654bb42a7c87960a00af6860d2 Jul 28 15:33:47.390543 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:47.390514 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-r5sgq" event={"ID":"1dbc5496-4a3a-43cf-9084-aaef1fab6b83","Type":"ContainerStarted","Data":"b69224b510befb9d664409556eb793577254d5654bb42a7c87960a00af6860d2"} Jul 28 15:33:47.639507 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:47.639415 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fdeb8917-db2c-4d6f-980d-673955311179-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lwlsp\" (UID: \"fdeb8917-db2c-4d6f-980d-673955311179\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lwlsp" Jul 28 15:33:47.639507 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:47.639460 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8b205f56-5230-402a-8d99-e8f21735c842-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zl8kx\" (UID: \"8b205f56-5230-402a-8d99-e8f21735c842\") " pod="openshift-insights/insights-runtime-extractor-zl8kx" Jul 28 15:33:47.639709 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:47.639515 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8b205f56-5230-402a-8d99-e8f21735c842-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zl8kx\" (UID: \"8b205f56-5230-402a-8d99-e8f21735c842\") " pod="openshift-insights/insights-runtime-extractor-zl8kx" Jul 28 15:33:47.639709 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:47.639560 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 15:33:47.639709 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:47.639592 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 15:33:47.639709 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:47.639632 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdeb8917-db2c-4d6f-980d-673955311179-samples-operator-tls podName:fdeb8917-db2c-4d6f-980d-673955311179 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:55.63961531 +0000 UTC m=+57.109115480 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fdeb8917-db2c-4d6f-980d-673955311179-samples-operator-tls") pod "cluster-samples-operator-6748489656-lwlsp" (UID: "fdeb8917-db2c-4d6f-980d-673955311179") : secret "samples-operator-tls" not found Jul 28 15:33:47.639709 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:47.639655 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8b205f56-5230-402a-8d99-e8f21735c842-kube-rbac-proxy-cm podName:8b205f56-5230-402a-8d99-e8f21735c842 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:51.63963978 +0000 UTC m=+53.109139953 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8b205f56-5230-402a-8d99-e8f21735c842-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zl8kx" (UID: "8b205f56-5230-402a-8d99-e8f21735c842") : configmap "kube-rbac-proxy" not found Jul 28 15:33:47.639709 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:47.639658 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 15:33:47.639709 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:47.639703 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b205f56-5230-402a-8d99-e8f21735c842-insights-runtime-extractor-tls podName:8b205f56-5230-402a-8d99-e8f21735c842 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:51.63969122 +0000 UTC m=+53.109191379 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8b205f56-5230-402a-8d99-e8f21735c842-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zl8kx" (UID: "8b205f56-5230-402a-8d99-e8f21735c842") : secret "insights-runtime-extractor-tls" not found Jul 28 15:33:48.396012 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:48.395973 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8d4wr" event={"ID":"bd673619-a13c-46ec-9b3b-11a7701e7153","Type":"ContainerStarted","Data":"472bdfe738b672871a9f17eee2df11ea596d917654a919a142d9c4a351145663"} Jul 28 15:33:48.414560 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:48.414503 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8d4wr" podStartSLOduration=2.284946091 podStartE2EDuration="4.414480946s" totalImagesPullingTime="2.129534855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:33:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:33:48.413075858 +0000 UTC m=+49.882576036" watchObservedRunningTime="2026-07-28 15:33:48.414480946 +0000 UTC m=+49.883981123" Jul 28 15:33:49.340000 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:49.339958 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-q58m6"] Jul 28 15:33:49.364350 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:49.364319 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-q58m6"] Jul 28 15:33:49.364507 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:49.364431 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-q58m6" Jul 28 15:33:49.366983 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:49.366963 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 28 15:33:49.367109 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:49.366995 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-drbpg\"" Jul 28 15:33:49.367569 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:49.367550 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 28 15:33:49.457382 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:49.457347 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95kjx\" (UniqueName: \"kubernetes.io/projected/514abdf8-4584-45d3-a3db-01d88aff6269-kube-api-access-95kjx\") pod \"migrator-6865c9967-q58m6\" (UID: \"514abdf8-4584-45d3-a3db-01d88aff6269\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-q58m6" Jul 28 15:33:49.558454 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:49.558433 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95kjx\" (UniqueName: \"kubernetes.io/projected/514abdf8-4584-45d3-a3db-01d88aff6269-kube-api-access-95kjx\") pod \"migrator-6865c9967-q58m6\" (UID: \"514abdf8-4584-45d3-a3db-01d88aff6269\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-q58m6" Jul 28 15:33:49.568140 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:49.568122 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95kjx\" (UniqueName: \"kubernetes.io/projected/514abdf8-4584-45d3-a3db-01d88aff6269-kube-api-access-95kjx\") pod \"migrator-6865c9967-q58m6\" (UID: \"514abdf8-4584-45d3-a3db-01d88aff6269\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-q58m6" Jul 28 15:33:49.673525 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:49.673498 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-q58m6" Jul 28 15:33:49.809371 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:49.809333 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-q58m6"] Jul 28 15:33:49.812876 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:33:49.812848 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod514abdf8_4584_45d3_a3db_01d88aff6269.slice/crio-b4e64e853c96137414871f9fa66d4d772c313820dd36e0855dc8193d781c215c WatchSource:0}: Error finding container b4e64e853c96137414871f9fa66d4d772c313820dd36e0855dc8193d781c215c: Status 404 returned error can't find the container with id b4e64e853c96137414871f9fa66d4d772c313820dd36e0855dc8193d781c215c Jul 28 15:33:50.365493 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:50.365454 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0f0bc3e-2d43-4c70-a2b7-ffaea1280559-metrics-tls\") pod \"dns-default-wspq5\" (UID: \"d0f0bc3e-2d43-4c70-a2b7-ffaea1280559\") " pod="openshift-dns/dns-default-wspq5" Jul 28 15:33:50.365662 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:50.365631 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 15:33:50.365717 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:50.365702 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0f0bc3e-2d43-4c70-a2b7-ffaea1280559-metrics-tls podName:d0f0bc3e-2d43-4c70-a2b7-ffaea1280559 nodeName:}" failed. No retries permitted until 2026-07-28 15:34:06.365680826 +0000 UTC m=+67.835180984 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0f0bc3e-2d43-4c70-a2b7-ffaea1280559-metrics-tls") pod "dns-default-wspq5" (UID: "d0f0bc3e-2d43-4c70-a2b7-ffaea1280559") : secret "dns-default-metrics-tls" not found Jul 28 15:33:50.402881 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:50.402845 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-r5sgq" event={"ID":"1dbc5496-4a3a-43cf-9084-aaef1fab6b83","Type":"ContainerStarted","Data":"8d002c9ba5a1c2d6ab02111af1a614de2baf55b12b998817dfac7f3477e282db"} Jul 28 15:33:50.404225 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:50.404199 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-q58m6" event={"ID":"514abdf8-4584-45d3-a3db-01d88aff6269","Type":"ContainerStarted","Data":"b4e64e853c96137414871f9fa66d4d772c313820dd36e0855dc8193d781c215c"} Jul 28 15:33:50.423147 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:50.423089 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-r5sgq" podStartSLOduration=2.279688529 podStartE2EDuration="4.423068445s" totalImagesPullingTime="2.143379916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:33:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:33:50.420735354 +0000 UTC m=+51.890235533" watchObservedRunningTime="2026-07-28 15:33:50.423068445 +0000 UTC m=+51.892568626" Jul 28 15:33:51.408088 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:51.408056 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-q58m6" event={"ID":"514abdf8-4584-45d3-a3db-01d88aff6269","Type":"ContainerStarted","Data":"9c4be7b260314657554b73e1eb6188669e8a7a0dbd83a327040a4168b75bf10b"} Jul 28 15:33:51.408406 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:51.408129 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-q58m6" event={"ID":"514abdf8-4584-45d3-a3db-01d88aff6269","Type":"ContainerStarted","Data":"0de2e532d13ace614371614d28dd7f84a083c13d7323843365c8407b77668f5e"} Jul 28 15:33:51.675602 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:51.675565 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8b205f56-5230-402a-8d99-e8f21735c842-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zl8kx\" (UID: \"8b205f56-5230-402a-8d99-e8f21735c842\") " pod="openshift-insights/insights-runtime-extractor-zl8kx" Jul 28 15:33:51.675753 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:51.675675 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8b205f56-5230-402a-8d99-e8f21735c842-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zl8kx\" (UID: \"8b205f56-5230-402a-8d99-e8f21735c842\") " pod="openshift-insights/insights-runtime-extractor-zl8kx" Jul 28 15:33:51.675753 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:51.675708 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 15:33:51.675824 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:51.675779 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8b205f56-5230-402a-8d99-e8f21735c842-kube-rbac-proxy-cm podName:8b205f56-5230-402a-8d99-e8f21735c842 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:59.675762414 +0000 UTC m=+61.145262572 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8b205f56-5230-402a-8d99-e8f21735c842-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zl8kx" (UID: "8b205f56-5230-402a-8d99-e8f21735c842") : configmap "kube-rbac-proxy" not found Jul 28 15:33:51.675824 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:51.675790 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 15:33:51.675893 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:51.675829 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b205f56-5230-402a-8d99-e8f21735c842-insights-runtime-extractor-tls podName:8b205f56-5230-402a-8d99-e8f21735c842 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:59.675817398 +0000 UTC m=+61.145317553 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8b205f56-5230-402a-8d99-e8f21735c842-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zl8kx" (UID: "8b205f56-5230-402a-8d99-e8f21735c842") : secret "insights-runtime-extractor-tls" not found Jul 28 15:33:52.433961 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:52.433913 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-q58m6" podStartSLOduration=2.054200344 podStartE2EDuration="3.433896803s" totalImagesPullingTime="1.379696459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:33:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:33:52.433358842 +0000 UTC m=+53.902859019" watchObservedRunningTime="2026-07-28 15:33:52.433896803 +0000 UTC m=+53.903397031" Jul 28 15:33:52.582485 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:52.582446 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f154434-fcc0-4a8e-a19e-f87c6df93f13-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mnjzv\" (UID: \"6f154434-fcc0-4a8e-a19e-f87c6df93f13\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mnjzv" Jul 28 15:33:52.582643 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:52.582597 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 15:33:52.582687 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:52.582663 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f154434-fcc0-4a8e-a19e-f87c6df93f13-cluster-monitoring-operator-tls podName:6f154434-fcc0-4a8e-a19e-f87c6df93f13 nodeName:}" failed. No retries permitted until 2026-07-28 15:34:08.582647767 +0000 UTC m=+70.052147927 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f154434-fcc0-4a8e-a19e-f87c6df93f13-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-mnjzv" (UID: "6f154434-fcc0-4a8e-a19e-f87c6df93f13") : secret "cluster-monitoring-operator-tls" not found Jul 28 15:33:55.708058 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:55.708002 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fdeb8917-db2c-4d6f-980d-673955311179-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lwlsp\" (UID: \"fdeb8917-db2c-4d6f-980d-673955311179\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lwlsp" Jul 28 15:33:55.708559 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:55.708196 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 15:33:55.708559 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:55.708268 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdeb8917-db2c-4d6f-980d-673955311179-samples-operator-tls podName:fdeb8917-db2c-4d6f-980d-673955311179 nodeName:}" failed. No retries permitted until 2026-07-28 15:34:11.708251164 +0000 UTC m=+73.177751323 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fdeb8917-db2c-4d6f-980d-673955311179-samples-operator-tls") pod "cluster-samples-operator-6748489656-lwlsp" (UID: "fdeb8917-db2c-4d6f-980d-673955311179") : secret "samples-operator-tls" not found Jul 28 15:33:59.741085 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:59.741043 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8b205f56-5230-402a-8d99-e8f21735c842-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zl8kx\" (UID: \"8b205f56-5230-402a-8d99-e8f21735c842\") " pod="openshift-insights/insights-runtime-extractor-zl8kx" Jul 28 15:33:59.741487 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:59.741105 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8b205f56-5230-402a-8d99-e8f21735c842-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zl8kx\" (UID: \"8b205f56-5230-402a-8d99-e8f21735c842\") " pod="openshift-insights/insights-runtime-extractor-zl8kx" Jul 28 15:33:59.741487 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:59.741222 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 15:33:59.741487 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:33:59.741296 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b205f56-5230-402a-8d99-e8f21735c842-insights-runtime-extractor-tls podName:8b205f56-5230-402a-8d99-e8f21735c842 nodeName:}" failed. No retries permitted until 2026-07-28 15:34:15.741277795 +0000 UTC m=+77.210777954 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8b205f56-5230-402a-8d99-e8f21735c842-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zl8kx" (UID: "8b205f56-5230-402a-8d99-e8f21735c842") : secret "insights-runtime-extractor-tls" not found Jul 28 15:33:59.741594 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:33:59.741570 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8b205f56-5230-402a-8d99-e8f21735c842-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zl8kx\" (UID: \"8b205f56-5230-402a-8d99-e8f21735c842\") " pod="openshift-insights/insights-runtime-extractor-zl8kx" Jul 28 15:34:00.336969 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:00.336939 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zq7mv" Jul 28 15:34:04.682183 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:04.682122 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssl7m\" (UniqueName: \"kubernetes.io/projected/55e0d957-598e-40f1-8c9e-8070fd19917a-kube-api-access-ssl7m\") pod \"network-check-target-c5vsn\" (UID: \"55e0d957-598e-40f1-8c9e-8070fd19917a\") " pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:34:04.682877 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:04.682826 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41a895b0-ed4d-49c9-802e-767b38b9a01e-original-pull-secret\") pod \"global-pull-secret-syncer-jmlvt\" (UID: \"41a895b0-ed4d-49c9-802e-767b38b9a01e\") " pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:34:04.684843 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:04.684819 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 15:34:04.684961 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:04.684913 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 15:34:04.694831 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:04.694814 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 15:34:04.695384 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:04.695366 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41a895b0-ed4d-49c9-802e-767b38b9a01e-original-pull-secret\") pod \"global-pull-secret-syncer-jmlvt\" (UID: \"41a895b0-ed4d-49c9-802e-767b38b9a01e\") " pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:34:04.705553 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:04.705535 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssl7m\" (UniqueName: \"kubernetes.io/projected/55e0d957-598e-40f1-8c9e-8070fd19917a-kube-api-access-ssl7m\") pod \"network-check-target-c5vsn\" (UID: \"55e0d957-598e-40f1-8c9e-8070fd19917a\") " pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:34:04.783226 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:04.783199 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5be64c0-1028-484f-8ee1-fe1de8d758f2-metrics-certs\") pod \"network-metrics-daemon-zrk89\" (UID: \"f5be64c0-1028-484f-8ee1-fe1de8d758f2\") " pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:34:04.785814 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:04.785796 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 15:34:04.795961 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:04.795943 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5be64c0-1028-484f-8ee1-fe1de8d758f2-metrics-certs\") pod \"network-metrics-daemon-zrk89\" (UID: \"f5be64c0-1028-484f-8ee1-fe1de8d758f2\") " pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:34:04.886136 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:04.886107 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x2697\"" Jul 28 15:34:04.890080 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:04.890063 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmlvt" Jul 28 15:34:04.894271 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:04.894253 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:34:05.022969 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:05.022934 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jmlvt"] Jul 28 15:34:05.026435 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:34:05.026405 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41a895b0_ed4d_49c9_802e_767b38b9a01e.slice/crio-bf6c257cced208ca201ad48eae4f583bf9e35334154892bdaf44c1c8604106f6 WatchSource:0}: Error finding container bf6c257cced208ca201ad48eae4f583bf9e35334154892bdaf44c1c8604106f6: Status 404 returned error can't find the container with id bf6c257cced208ca201ad48eae4f583bf9e35334154892bdaf44c1c8604106f6 Jul 28 15:34:05.038343 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:05.038319 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-c5vsn"] Jul 28 15:34:05.042106 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:34:05.042082 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55e0d957_598e_40f1_8c9e_8070fd19917a.slice/crio-e028be85c5e5078d6d9f1006fd38d354da5b6c88517dd4ea3b5973e36928252d WatchSource:0}: Error finding container e028be85c5e5078d6d9f1006fd38d354da5b6c88517dd4ea3b5973e36928252d: Status 404 returned error can't find the container with id e028be85c5e5078d6d9f1006fd38d354da5b6c88517dd4ea3b5973e36928252d Jul 28 15:34:05.084580 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:05.084552 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-25sjx\"" Jul 28 15:34:05.093315 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:05.093284 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrk89" Jul 28 15:34:05.214326 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:05.214254 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zrk89"] Jul 28 15:34:05.217193 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:34:05.217144 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5be64c0_1028_484f_8ee1_fe1de8d758f2.slice/crio-855b5979480610b5b43d673dea8e2f8bb26e34e38e27ce2ac34164de661df314 WatchSource:0}: Error finding container 855b5979480610b5b43d673dea8e2f8bb26e34e38e27ce2ac34164de661df314: Status 404 returned error can't find the container with id 855b5979480610b5b43d673dea8e2f8bb26e34e38e27ce2ac34164de661df314 Jul 28 15:34:05.443973 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:05.443939 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-c5vsn" event={"ID":"55e0d957-598e-40f1-8c9e-8070fd19917a","Type":"ContainerStarted","Data":"e028be85c5e5078d6d9f1006fd38d354da5b6c88517dd4ea3b5973e36928252d"} Jul 28 15:34:05.445200 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:05.445131 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zrk89" event={"ID":"f5be64c0-1028-484f-8ee1-fe1de8d758f2","Type":"ContainerStarted","Data":"855b5979480610b5b43d673dea8e2f8bb26e34e38e27ce2ac34164de661df314"} Jul 28 15:34:05.446496 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:05.446464 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jmlvt" event={"ID":"41a895b0-ed4d-49c9-802e-767b38b9a01e","Type":"ContainerStarted","Data":"bf6c257cced208ca201ad48eae4f583bf9e35334154892bdaf44c1c8604106f6"} Jul 28 15:34:06.397452 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:06.397414 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0f0bc3e-2d43-4c70-a2b7-ffaea1280559-metrics-tls\") pod \"dns-default-wspq5\" (UID: \"d0f0bc3e-2d43-4c70-a2b7-ffaea1280559\") " pod="openshift-dns/dns-default-wspq5" Jul 28 15:34:06.401300 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:06.401264 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0f0bc3e-2d43-4c70-a2b7-ffaea1280559-metrics-tls\") pod \"dns-default-wspq5\" (UID: \"d0f0bc3e-2d43-4c70-a2b7-ffaea1280559\") " pod="openshift-dns/dns-default-wspq5" Jul 28 15:34:06.578297 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:06.578266 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bkn7m\"" Jul 28 15:34:06.586975 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:06.586947 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wspq5" Jul 28 15:34:06.753649 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:06.753617 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wspq5"] Jul 28 15:34:06.802303 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:34:06.802270 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0f0bc3e_2d43_4c70_a2b7_ffaea1280559.slice/crio-d48f9e7894dfdd7e09c1bd37b433fa835040b67d4c7f443f04c5d83c1caf1f1c WatchSource:0}: Error finding container d48f9e7894dfdd7e09c1bd37b433fa835040b67d4c7f443f04c5d83c1caf1f1c: Status 404 returned error can't find the container with id d48f9e7894dfdd7e09c1bd37b433fa835040b67d4c7f443f04c5d83c1caf1f1c Jul 28 15:34:07.455068 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:07.455030 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wspq5" event={"ID":"d0f0bc3e-2d43-4c70-a2b7-ffaea1280559","Type":"ContainerStarted","Data":"d48f9e7894dfdd7e09c1bd37b433fa835040b67d4c7f443f04c5d83c1caf1f1c"} Jul 28 15:34:07.457532 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:07.457501 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zrk89" event={"ID":"f5be64c0-1028-484f-8ee1-fe1de8d758f2","Type":"ContainerStarted","Data":"57687e0a8cb81cdaa2d6340424e4e6a4102a49e24ec02698796adbb707ea901f"} Jul 28 15:34:07.457665 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:07.457554 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zrk89" event={"ID":"f5be64c0-1028-484f-8ee1-fe1de8d758f2","Type":"ContainerStarted","Data":"d3404262978e3682b39d4a6a032adae87c7887743d7cd2bdab9cb2ea816811c3"} Jul 28 15:34:07.475480 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:07.474504 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zrk89" podStartSLOduration=66.866782759 podStartE2EDuration="1m8.474488241s" totalImagesPullingTime="1.607705482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:34:07.473406698 +0000 UTC m=+68.942906877" watchObservedRunningTime="2026-07-28 15:34:07.474488241 +0000 UTC m=+68.943988418" Jul 28 15:34:08.615792 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:08.615753 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f154434-fcc0-4a8e-a19e-f87c6df93f13-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mnjzv\" (UID: \"6f154434-fcc0-4a8e-a19e-f87c6df93f13\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mnjzv" Jul 28 15:34:08.621866 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:08.621837 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f154434-fcc0-4a8e-a19e-f87c6df93f13-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mnjzv\" (UID: \"6f154434-fcc0-4a8e-a19e-f87c6df93f13\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mnjzv" Jul 28 15:34:08.869483 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:08.869395 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vkl8k\"" Jul 28 15:34:08.877658 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:08.877627 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mnjzv" Jul 28 15:34:10.382536 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:10.382509 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-mnjzv"] Jul 28 15:34:10.386931 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:34:10.386904 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f154434_fcc0_4a8e_a19e_f87c6df93f13.slice/crio-cb794a07a1ad91991a345035cf8203ec0ff7083dd3ce9afcbc4cc66ee2a61eb7 WatchSource:0}: Error finding container cb794a07a1ad91991a345035cf8203ec0ff7083dd3ce9afcbc4cc66ee2a61eb7: Status 404 returned error can't find the container with id cb794a07a1ad91991a345035cf8203ec0ff7083dd3ce9afcbc4cc66ee2a61eb7 Jul 28 15:34:10.470421 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:10.470387 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jmlvt" event={"ID":"41a895b0-ed4d-49c9-802e-767b38b9a01e","Type":"ContainerStarted","Data":"5a54ebe6261e921615f714c61cb01ebd8a877eca56f27324b709ea1ffa70e5f7"} Jul 28 15:34:10.472143 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:10.472123 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-c5vsn" event={"ID":"55e0d957-598e-40f1-8c9e-8070fd19917a","Type":"ContainerStarted","Data":"49f5d815ca308d1a118fb9a4f2715b016f8234c09f1b3636bbbb984de445640e"} Jul 28 15:34:10.472614 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:10.472600 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:34:10.474294 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:10.474258 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wspq5" event={"ID":"d0f0bc3e-2d43-4c70-a2b7-ffaea1280559","Type":"ContainerStarted","Data":"2b5a621980f15b0a6f0f7ba171b140863711e08b7b6ea27bd98f0d1dcd48ab99"} Jul 28 15:34:10.475449 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:10.475424 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mnjzv" event={"ID":"6f154434-fcc0-4a8e-a19e-f87c6df93f13","Type":"ContainerStarted","Data":"cb794a07a1ad91991a345035cf8203ec0ff7083dd3ce9afcbc4cc66ee2a61eb7"} Jul 28 15:34:10.489564 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:10.489215 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jmlvt" podStartSLOduration=66.256567198 podStartE2EDuration="1m11.489198892s" totalImagesPullingTime="5.232631694s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:34:10.489104279 +0000 UTC m=+71.958604458" watchObservedRunningTime="2026-07-28 15:34:10.489198892 +0000 UTC m=+71.958699069" Jul 28 15:34:10.506458 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:10.506341 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-c5vsn" podStartSLOduration=66.310839676 podStartE2EDuration="1m11.506319868s" totalImagesPullingTime="5.195480192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:34:10.504612332 +0000 UTC m=+71.974112512" watchObservedRunningTime="2026-07-28 15:34:10.506319868 +0000 UTC m=+71.975820046" Jul 28 15:34:11.481378 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:11.481338 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wspq5" event={"ID":"d0f0bc3e-2d43-4c70-a2b7-ffaea1280559","Type":"ContainerStarted","Data":"8c1584342d3841e4ed4624c6cc20450dd0617ecb967a09cd310a1e306957d9b1"} Jul 28 15:34:11.502177 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:11.502103 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wspq5" podStartSLOduration=34.054651869 podStartE2EDuration="37.502088573s" totalImagesPullingTime="3.447436704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:34:11.501539387 +0000 UTC m=+72.971039566" watchObservedRunningTime="2026-07-28 15:34:11.502088573 +0000 UTC m=+72.971588754" Jul 28 15:34:11.743860 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:11.743776 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fdeb8917-db2c-4d6f-980d-673955311179-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lwlsp\" (UID: \"fdeb8917-db2c-4d6f-980d-673955311179\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lwlsp" Jul 28 15:34:11.746628 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:11.746596 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fdeb8917-db2c-4d6f-980d-673955311179-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lwlsp\" (UID: \"fdeb8917-db2c-4d6f-980d-673955311179\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lwlsp" Jul 28 15:34:11.907552 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:11.907520 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-k2xwc\"" Jul 28 15:34:11.915738 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:11.915712 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lwlsp" Jul 28 15:34:12.126108 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:12.126074 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lwlsp"] Jul 28 15:34:12.486160 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:12.486125 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mnjzv" event={"ID":"6f154434-fcc0-4a8e-a19e-f87c6df93f13","Type":"ContainerStarted","Data":"bc530c5d7328b119ec72f6817e69096d03506fb5dd9cac0799b5278a9f390291"} Jul 28 15:34:12.487284 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:12.487260 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lwlsp" event={"ID":"fdeb8917-db2c-4d6f-980d-673955311179","Type":"ContainerStarted","Data":"0cc1ff1315ebec4cc2c88367cd802f1524dc56cdd6c9d96f9f17bc26d39a79b2"} Jul 28 15:34:12.487475 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:12.487460 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wspq5" Jul 28 15:34:12.511723 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:12.511671 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mnjzv" podStartSLOduration=34.873626497 podStartE2EDuration="36.511650245s" totalImagesPullingTime="1.638023748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:33:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:34:12.510094909 +0000 UTC m=+73.979595086" watchObservedRunningTime="2026-07-28 15:34:12.511650245 +0000 UTC m=+73.981150426" Jul 28 15:34:14.483734 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.483693 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79f5485774-d6rqg"] Jul 28 15:34:14.487947 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.486564 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79f5485774-d6rqg" Jul 28 15:34:14.489407 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.489387 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xpqsw\"" Jul 28 15:34:14.489769 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.489754 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 28 15:34:14.496315 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.496292 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lwlsp" event={"ID":"fdeb8917-db2c-4d6f-980d-673955311179","Type":"ContainerStarted","Data":"784e01e332af9a268e983d40ff2838a753e656f467f749d969f877476ba8d986"} Jul 28 15:34:14.496401 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.496335 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lwlsp" event={"ID":"fdeb8917-db2c-4d6f-980d-673955311179","Type":"ContainerStarted","Data":"8fa7e99e83c36ec46be93000b1a8b831f3df262c9a71abfbd794d188ae5e2309"} Jul 28 15:34:14.506475 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.506456 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 28 15:34:14.518784 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.518760 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79f5485774-d6rqg"] Jul 28 15:34:14.526561 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.526542 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 28 15:34:14.527797 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.527781 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 28 15:34:14.563431 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.563403 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7d9e05ce-face-420a-8197-fe838267a0f7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-79f5485774-d6rqg\" (UID: \"7d9e05ce-face-420a-8197-fe838267a0f7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79f5485774-d6rqg" Jul 28 15:34:14.563545 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.563448 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x7x7\" (UniqueName: \"kubernetes.io/projected/7d9e05ce-face-420a-8197-fe838267a0f7-kube-api-access-8x7x7\") pod \"managed-serviceaccount-addon-agent-79f5485774-d6rqg\" (UID: \"7d9e05ce-face-420a-8197-fe838267a0f7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79f5485774-d6rqg" Jul 28 15:34:14.664353 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.664317 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7d9e05ce-face-420a-8197-fe838267a0f7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-79f5485774-d6rqg\" (UID: \"7d9e05ce-face-420a-8197-fe838267a0f7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79f5485774-d6rqg" Jul 28 15:34:14.664353 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.664354 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x7x7\" (UniqueName: \"kubernetes.io/projected/7d9e05ce-face-420a-8197-fe838267a0f7-kube-api-access-8x7x7\") pod \"managed-serviceaccount-addon-agent-79f5485774-d6rqg\" (UID: \"7d9e05ce-face-420a-8197-fe838267a0f7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79f5485774-d6rqg" Jul 28 15:34:14.666946 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.666913 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7d9e05ce-face-420a-8197-fe838267a0f7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-79f5485774-d6rqg\" (UID: \"7d9e05ce-face-420a-8197-fe838267a0f7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79f5485774-d6rqg" Jul 28 15:34:14.688651 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.688627 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x7x7\" (UniqueName: \"kubernetes.io/projected/7d9e05ce-face-420a-8197-fe838267a0f7-kube-api-access-8x7x7\") pod \"managed-serviceaccount-addon-agent-79f5485774-d6rqg\" (UID: \"7d9e05ce-face-420a-8197-fe838267a0f7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79f5485774-d6rqg" Jul 28 15:34:14.743436 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.743324 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lwlsp" podStartSLOduration=34.220291488 podStartE2EDuration="35.743307556s" totalImagesPullingTime="1.523016068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:33:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:34:14.603929425 +0000 UTC m=+76.073429603" watchObservedRunningTime="2026-07-28 15:34:14.743307556 +0000 UTC m=+76.212807733" Jul 28 15:34:14.743659 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.743647 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54f75948cb-56nh8"] Jul 28 15:34:14.745691 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.745677 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54f75948cb-56nh8" Jul 28 15:34:14.747956 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.747936 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 28 15:34:14.748109 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.748093 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xl2f2\"" Jul 28 15:34:14.748334 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.748321 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 28 15:34:14.749116 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.749093 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 28 15:34:14.755895 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.755877 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 28 15:34:14.769717 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.769694 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54f75948cb-56nh8"] Jul 28 15:34:14.809316 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.809287 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79f5485774-d6rqg" Jul 28 15:34:14.866002 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.865977 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2852183-1514-4902-8fc4-8534e5be285b-registry-certificates\") pod \"image-registry-54f75948cb-56nh8\" (UID: \"e2852183-1514-4902-8fc4-8534e5be285b\") " pod="openshift-image-registry/image-registry-54f75948cb-56nh8" Jul 28 15:34:14.866126 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.866036 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2852183-1514-4902-8fc4-8534e5be285b-registry-tls\") pod \"image-registry-54f75948cb-56nh8\" (UID: \"e2852183-1514-4902-8fc4-8534e5be285b\") " pod="openshift-image-registry/image-registry-54f75948cb-56nh8" Jul 28 15:34:14.866126 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.866063 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2852183-1514-4902-8fc4-8534e5be285b-image-registry-private-configuration\") pod \"image-registry-54f75948cb-56nh8\" (UID: \"e2852183-1514-4902-8fc4-8534e5be285b\") " pod="openshift-image-registry/image-registry-54f75948cb-56nh8" Jul 28 15:34:14.866233 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.866214 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2852183-1514-4902-8fc4-8534e5be285b-installation-pull-secrets\") pod \"image-registry-54f75948cb-56nh8\" (UID: \"e2852183-1514-4902-8fc4-8534e5be285b\") " pod="openshift-image-registry/image-registry-54f75948cb-56nh8" Jul 28 15:34:14.866272 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.866250 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2852183-1514-4902-8fc4-8534e5be285b-ca-trust-extracted\") pod \"image-registry-54f75948cb-56nh8\" (UID: \"e2852183-1514-4902-8fc4-8534e5be285b\") " pod="openshift-image-registry/image-registry-54f75948cb-56nh8" Jul 28 15:34:14.866319 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.866290 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2852183-1514-4902-8fc4-8534e5be285b-trusted-ca\") pod \"image-registry-54f75948cb-56nh8\" (UID: \"e2852183-1514-4902-8fc4-8534e5be285b\") " pod="openshift-image-registry/image-registry-54f75948cb-56nh8" Jul 28 15:34:14.866361 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.866324 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2852183-1514-4902-8fc4-8534e5be285b-bound-sa-token\") pod \"image-registry-54f75948cb-56nh8\" (UID: \"e2852183-1514-4902-8fc4-8534e5be285b\") " pod="openshift-image-registry/image-registry-54f75948cb-56nh8" Jul 28 15:34:14.866438 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.866417 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq8qx\" (UniqueName: \"kubernetes.io/projected/e2852183-1514-4902-8fc4-8534e5be285b-kube-api-access-mq8qx\") pod \"image-registry-54f75948cb-56nh8\" (UID: \"e2852183-1514-4902-8fc4-8534e5be285b\") " pod="openshift-image-registry/image-registry-54f75948cb-56nh8" Jul 28 15:34:14.934968 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.934927 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79f5485774-d6rqg"] Jul 28 15:34:14.938006 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:34:14.937983 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d9e05ce_face_420a_8197_fe838267a0f7.slice/crio-69d36c9d37d0ca927afcbc83f794611028cd7396790a76a85f01e600acac407d WatchSource:0}: Error finding container 69d36c9d37d0ca927afcbc83f794611028cd7396790a76a85f01e600acac407d: Status 404 returned error can't find the container with id 69d36c9d37d0ca927afcbc83f794611028cd7396790a76a85f01e600acac407d Jul 28 15:34:14.967225 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.967198 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2852183-1514-4902-8fc4-8534e5be285b-registry-tls\") pod \"image-registry-54f75948cb-56nh8\" (UID: \"e2852183-1514-4902-8fc4-8534e5be285b\") " pod="openshift-image-registry/image-registry-54f75948cb-56nh8" Jul 28 15:34:14.967340 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.967231 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2852183-1514-4902-8fc4-8534e5be285b-image-registry-private-configuration\") pod \"image-registry-54f75948cb-56nh8\" (UID: \"e2852183-1514-4902-8fc4-8534e5be285b\") " pod="openshift-image-registry/image-registry-54f75948cb-56nh8" Jul 28 15:34:14.967340 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.967250 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2852183-1514-4902-8fc4-8534e5be285b-installation-pull-secrets\") pod \"image-registry-54f75948cb-56nh8\" (UID: \"e2852183-1514-4902-8fc4-8534e5be285b\") " pod="openshift-image-registry/image-registry-54f75948cb-56nh8" Jul 28 15:34:14.967340 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.967270 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2852183-1514-4902-8fc4-8534e5be285b-ca-trust-extracted\") pod \"image-registry-54f75948cb-56nh8\" (UID: \"e2852183-1514-4902-8fc4-8534e5be285b\") " pod="openshift-image-registry/image-registry-54f75948cb-56nh8" Jul 28 15:34:14.967340 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.967300 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2852183-1514-4902-8fc4-8534e5be285b-trusted-ca\") pod \"image-registry-54f75948cb-56nh8\" (UID: \"e2852183-1514-4902-8fc4-8534e5be285b\") " pod="openshift-image-registry/image-registry-54f75948cb-56nh8" Jul 28 15:34:14.967340 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.967334 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2852183-1514-4902-8fc4-8534e5be285b-bound-sa-token\") pod \"image-registry-54f75948cb-56nh8\" (UID: \"e2852183-1514-4902-8fc4-8534e5be285b\") " pod="openshift-image-registry/image-registry-54f75948cb-56nh8" Jul 28 15:34:14.967550 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.967373 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq8qx\" (UniqueName: \"kubernetes.io/projected/e2852183-1514-4902-8fc4-8534e5be285b-kube-api-access-mq8qx\") pod \"image-registry-54f75948cb-56nh8\" (UID: \"e2852183-1514-4902-8fc4-8534e5be285b\") " pod="openshift-image-registry/image-registry-54f75948cb-56nh8" Jul 28 15:34:14.967550 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.967402 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2852183-1514-4902-8fc4-8534e5be285b-registry-certificates\") pod \"image-registry-54f75948cb-56nh8\" (UID: \"e2852183-1514-4902-8fc4-8534e5be285b\") " pod="openshift-image-registry/image-registry-54f75948cb-56nh8" Jul 28 15:34:14.967752 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.967721 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2852183-1514-4902-8fc4-8534e5be285b-ca-trust-extracted\") pod \"image-registry-54f75948cb-56nh8\" (UID: \"e2852183-1514-4902-8fc4-8534e5be285b\") " pod="openshift-image-registry/image-registry-54f75948cb-56nh8" Jul 28 15:34:14.968273 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.968249 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2852183-1514-4902-8fc4-8534e5be285b-registry-certificates\") pod \"image-registry-54f75948cb-56nh8\" (UID: \"e2852183-1514-4902-8fc4-8534e5be285b\") " pod="openshift-image-registry/image-registry-54f75948cb-56nh8" Jul 28 15:34:14.968652 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.968634 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2852183-1514-4902-8fc4-8534e5be285b-trusted-ca\") pod \"image-registry-54f75948cb-56nh8\" (UID: \"e2852183-1514-4902-8fc4-8534e5be285b\") " pod="openshift-image-registry/image-registry-54f75948cb-56nh8" Jul 28 15:34:14.969715 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.969689 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2852183-1514-4902-8fc4-8534e5be285b-registry-tls\") pod \"image-registry-54f75948cb-56nh8\" (UID: \"e2852183-1514-4902-8fc4-8534e5be285b\") " pod="openshift-image-registry/image-registry-54f75948cb-56nh8" Jul 28 15:34:14.969838 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.969818 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2852183-1514-4902-8fc4-8534e5be285b-installation-pull-secrets\") pod \"image-registry-54f75948cb-56nh8\" (UID: \"e2852183-1514-4902-8fc4-8534e5be285b\") " pod="openshift-image-registry/image-registry-54f75948cb-56nh8" Jul 28 15:34:14.969888 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.969842 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2852183-1514-4902-8fc4-8534e5be285b-image-registry-private-configuration\") pod \"image-registry-54f75948cb-56nh8\" (UID: \"e2852183-1514-4902-8fc4-8534e5be285b\") " pod="openshift-image-registry/image-registry-54f75948cb-56nh8" Jul 28 15:34:14.977405 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.977383 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2852183-1514-4902-8fc4-8534e5be285b-bound-sa-token\") pod \"image-registry-54f75948cb-56nh8\" (UID: \"e2852183-1514-4902-8fc4-8534e5be285b\") " pod="openshift-image-registry/image-registry-54f75948cb-56nh8" Jul 28 15:34:14.977868 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:14.977847 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq8qx\" (UniqueName: \"kubernetes.io/projected/e2852183-1514-4902-8fc4-8534e5be285b-kube-api-access-mq8qx\") pod \"image-registry-54f75948cb-56nh8\" (UID: \"e2852183-1514-4902-8fc4-8534e5be285b\") " pod="openshift-image-registry/image-registry-54f75948cb-56nh8" Jul 28 15:34:15.056970 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:15.056943 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54f75948cb-56nh8" Jul 28 15:34:15.185030 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:15.184987 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54f75948cb-56nh8"] Jul 28 15:34:15.188030 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:34:15.188005 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2852183_1514_4902_8fc4_8534e5be285b.slice/crio-7f5ab1f4e559990c3157af1d5593bd6a1abd0fc4b96e8b70af31d32b5029355f WatchSource:0}: Error finding container 7f5ab1f4e559990c3157af1d5593bd6a1abd0fc4b96e8b70af31d32b5029355f: Status 404 returned error can't find the container with id 7f5ab1f4e559990c3157af1d5593bd6a1abd0fc4b96e8b70af31d32b5029355f Jul 28 15:34:15.505361 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:15.505275 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54f75948cb-56nh8" event={"ID":"e2852183-1514-4902-8fc4-8534e5be285b","Type":"ContainerStarted","Data":"e4f67b6281111c9f20f1499615644ace9d79c80a431fdf4946493ea9b1bc76c2"} Jul 28 15:34:15.505361 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:15.505340 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54f75948cb-56nh8" event={"ID":"e2852183-1514-4902-8fc4-8534e5be285b","Type":"ContainerStarted","Data":"7f5ab1f4e559990c3157af1d5593bd6a1abd0fc4b96e8b70af31d32b5029355f"} Jul 28 15:34:15.505842 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:15.505479 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-54f75948cb-56nh8" Jul 28 15:34:15.507433 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:15.507405 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79f5485774-d6rqg" event={"ID":"7d9e05ce-face-420a-8197-fe838267a0f7","Type":"ContainerStarted","Data":"69d36c9d37d0ca927afcbc83f794611028cd7396790a76a85f01e600acac407d"} Jul 28 15:34:15.775878 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:15.775835 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8b205f56-5230-402a-8d99-e8f21735c842-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zl8kx\" (UID: \"8b205f56-5230-402a-8d99-e8f21735c842\") " pod="openshift-insights/insights-runtime-extractor-zl8kx" Jul 28 15:34:15.778607 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:15.778576 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8b205f56-5230-402a-8d99-e8f21735c842-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zl8kx\" (UID: \"8b205f56-5230-402a-8d99-e8f21735c842\") " pod="openshift-insights/insights-runtime-extractor-zl8kx" Jul 28 15:34:15.931814 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:15.931782 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wgs6z\"" Jul 28 15:34:15.939382 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:15.939334 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zl8kx" Jul 28 15:34:16.090533 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:16.090472 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-54f75948cb-56nh8" podStartSLOduration=2.090449053 podStartE2EDuration="2.090449053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:34:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:34:15.527216953 +0000 UTC m=+76.996717134" watchObservedRunningTime="2026-07-28 15:34:16.090449053 +0000 UTC m=+77.559949230" Jul 28 15:34:16.090702 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:16.090684 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zl8kx"] Jul 28 15:34:16.093935 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:34:16.093910 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b205f56_5230_402a_8d99_e8f21735c842.slice/crio-6a4829794d2ca75fa741b89de868e5bfa354e45e21702740e527866cff8b0e71 WatchSource:0}: Error finding container 6a4829794d2ca75fa741b89de868e5bfa354e45e21702740e527866cff8b0e71: Status 404 returned error can't find the container with id 6a4829794d2ca75fa741b89de868e5bfa354e45e21702740e527866cff8b0e71 Jul 28 15:34:16.513118 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:16.513084 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zl8kx" event={"ID":"8b205f56-5230-402a-8d99-e8f21735c842","Type":"ContainerStarted","Data":"6a4829794d2ca75fa741b89de868e5bfa354e45e21702740e527866cff8b0e71"} Jul 28 15:34:17.520058 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:17.520025 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79f5485774-d6rqg" event={"ID":"7d9e05ce-face-420a-8197-fe838267a0f7","Type":"ContainerStarted","Data":"07787a7ac0cebfeb62277c7dbd7a44321278b74246361fe770fe25b2ddbcd7ca"} Jul 28 15:34:17.536784 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:17.536728 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79f5485774-d6rqg" podStartSLOduration=1.249030037 podStartE2EDuration="3.536710134s" totalImagesPullingTime="2.287680097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:34:17.535440401 +0000 UTC m=+79.004940577" watchObservedRunningTime="2026-07-28 15:34:17.536710134 +0000 UTC m=+79.006210311" Jul 28 15:34:22.493672 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:22.493569 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wspq5" Jul 28 15:34:22.540335 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:22.540256 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zl8kx" event={"ID":"8b205f56-5230-402a-8d99-e8f21735c842","Type":"ContainerStarted","Data":"58d41ecdba706e08a2ad6b4a4d8f4137a3d0ebe016fc98efee78212127703d8e"} Jul 28 15:34:25.553365 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:25.553322 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zl8kx" event={"ID":"8b205f56-5230-402a-8d99-e8f21735c842","Type":"ContainerStarted","Data":"63b18bfd207467f80f78d16c6b65cd9bbf3edf18cb3b27ac154ce262faeb5cf0"} Jul 28 15:34:25.570432 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:25.570400 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-b488j"] Jul 28 15:34:25.574134 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:25.574115 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-b488j" Jul 28 15:34:25.576697 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:25.576456 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 28 15:34:25.576697 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:25.576498 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 28 15:34:25.576697 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:25.576461 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-fm4fd\"" Jul 28 15:34:25.582448 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:25.582431 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-b488j"] Jul 28 15:34:25.652641 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:25.652599 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whxkq\" (UniqueName: \"kubernetes.io/projected/71855b26-90b6-4583-80d8-adeb3099e54b-kube-api-access-whxkq\") pod \"downloads-7c97dc4555-b488j\" (UID: \"71855b26-90b6-4583-80d8-adeb3099e54b\") " pod="openshift-console/downloads-7c97dc4555-b488j" Jul 28 15:34:25.754646 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:25.754612 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whxkq\" (UniqueName: \"kubernetes.io/projected/71855b26-90b6-4583-80d8-adeb3099e54b-kube-api-access-whxkq\") pod \"downloads-7c97dc4555-b488j\" (UID: \"71855b26-90b6-4583-80d8-adeb3099e54b\") " pod="openshift-console/downloads-7c97dc4555-b488j" Jul 28 15:34:25.770776 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:25.770742 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whxkq\" (UniqueName: \"kubernetes.io/projected/71855b26-90b6-4583-80d8-adeb3099e54b-kube-api-access-whxkq\") pod \"downloads-7c97dc4555-b488j\" (UID: \"71855b26-90b6-4583-80d8-adeb3099e54b\") " pod="openshift-console/downloads-7c97dc4555-b488j" Jul 28 15:34:25.886137 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:25.886046 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-b488j" Jul 28 15:34:26.036286 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.036231 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-92rv6"] Jul 28 15:34:26.043393 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.043338 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-b488j"] Jul 28 15:34:26.044081 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.043586 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-92rv6" Jul 28 15:34:26.046277 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:34:26.046241 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71855b26_90b6_4583_80d8_adeb3099e54b.slice/crio-afa46dfbe7b3765a68b3d889b7688097d0a74c5b163fee3747f528b03f36f25e WatchSource:0}: Error finding container afa46dfbe7b3765a68b3d889b7688097d0a74c5b163fee3747f528b03f36f25e: Status 404 returned error can't find the container with id afa46dfbe7b3765a68b3d889b7688097d0a74c5b163fee3747f528b03f36f25e Jul 28 15:34:26.047315 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.047292 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 28 15:34:26.049680 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.049661 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 15:34:26.049871 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.049856 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-wp29q\"" Jul 28 15:34:26.050043 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.050027 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 28 15:34:26.051640 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.051605 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-r2r45"] Jul 28 15:34:26.056282 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.056261 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-92rv6"] Jul 28 15:34:26.056395 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.056382 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r2r45" Jul 28 15:34:26.057080 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.057059 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-g77g8"] Jul 28 15:34:26.059768 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.059467 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 28 15:34:26.059768 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.059482 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 28 15:34:26.059768 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.059645 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-hmthf\"" Jul 28 15:34:26.059768 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.059475 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 28 15:34:26.060953 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.060935 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g77g8" Jul 28 15:34:26.064073 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.063420 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 15:34:26.064073 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.063483 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4lhqk\"" Jul 28 15:34:26.064073 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.063658 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 15:34:26.064073 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.063918 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 15:34:26.090824 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.090799 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-r2r45"] Jul 28 15:34:26.158802 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.158726 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e323d0e4-48e7-4ffc-904f-ad5158d52fc2-node-exporter-accelerators-collector-config\") pod \"node-exporter-g77g8\" (UID: \"e323d0e4-48e7-4ffc-904f-ad5158d52fc2\") " pod="openshift-monitoring/node-exporter-g77g8" Jul 28 15:34:26.158802 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.158762 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e323d0e4-48e7-4ffc-904f-ad5158d52fc2-sys\") pod \"node-exporter-g77g8\" (UID: \"e323d0e4-48e7-4ffc-904f-ad5158d52fc2\") " pod="openshift-monitoring/node-exporter-g77g8" Jul 28 15:34:26.158802 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.158787 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e323d0e4-48e7-4ffc-904f-ad5158d52fc2-node-exporter-tls\") pod \"node-exporter-g77g8\" (UID: \"e323d0e4-48e7-4ffc-904f-ad5158d52fc2\") " pod="openshift-monitoring/node-exporter-g77g8" Jul 28 15:34:26.159022 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.158807 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv2hq\" (UniqueName: \"kubernetes.io/projected/e323d0e4-48e7-4ffc-904f-ad5158d52fc2-kube-api-access-qv2hq\") pod \"node-exporter-g77g8\" (UID: \"e323d0e4-48e7-4ffc-904f-ad5158d52fc2\") " pod="openshift-monitoring/node-exporter-g77g8" Jul 28 15:34:26.159022 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.158825 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06f122a6-68d9-481e-a74a-236e1ada9e1b-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-92rv6\" (UID: \"06f122a6-68d9-481e-a74a-236e1ada9e1b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-92rv6" Jul 28 15:34:26.159022 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.158842 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/06f122a6-68d9-481e-a74a-236e1ada9e1b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-92rv6\" (UID: \"06f122a6-68d9-481e-a74a-236e1ada9e1b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-92rv6" Jul 28 15:34:26.159022 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.158860 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e323d0e4-48e7-4ffc-904f-ad5158d52fc2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g77g8\" (UID: \"e323d0e4-48e7-4ffc-904f-ad5158d52fc2\") " pod="openshift-monitoring/node-exporter-g77g8" Jul 28 15:34:26.159022 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.158914 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/06f122a6-68d9-481e-a74a-236e1ada9e1b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-92rv6\" (UID: \"06f122a6-68d9-481e-a74a-236e1ada9e1b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-92rv6" Jul 28 15:34:26.159022 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.158938 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zxmz\" (UniqueName: \"kubernetes.io/projected/06f122a6-68d9-481e-a74a-236e1ada9e1b-kube-api-access-5zxmz\") pod \"openshift-state-metrics-b8f49f5c6-92rv6\" (UID: \"06f122a6-68d9-481e-a74a-236e1ada9e1b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-92rv6" Jul 28 15:34:26.159022 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.159007 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e323d0e4-48e7-4ffc-904f-ad5158d52fc2-metrics-client-ca\") pod \"node-exporter-g77g8\" (UID: \"e323d0e4-48e7-4ffc-904f-ad5158d52fc2\") " pod="openshift-monitoring/node-exporter-g77g8" Jul 28 15:34:26.159367 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.159042 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gqbb\" (UniqueName: \"kubernetes.io/projected/49036815-1fae-4750-b5d0-f25f8faf9b6e-kube-api-access-5gqbb\") pod \"kube-state-metrics-56d9f944b4-r2r45\" (UID: \"49036815-1fae-4750-b5d0-f25f8faf9b6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r2r45" Jul 28 15:34:26.159367 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.159073 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e323d0e4-48e7-4ffc-904f-ad5158d52fc2-root\") pod \"node-exporter-g77g8\" (UID: \"e323d0e4-48e7-4ffc-904f-ad5158d52fc2\") " pod="openshift-monitoring/node-exporter-g77g8" Jul 28 15:34:26.159367 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.159098 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/49036815-1fae-4750-b5d0-f25f8faf9b6e-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-r2r45\" (UID: \"49036815-1fae-4750-b5d0-f25f8faf9b6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r2r45" Jul 28 15:34:26.159367 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.159129 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/49036815-1fae-4750-b5d0-f25f8faf9b6e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-r2r45\" (UID: \"49036815-1fae-4750-b5d0-f25f8faf9b6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r2r45" Jul 28 15:34:26.159367 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.159160 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/49036815-1fae-4750-b5d0-f25f8faf9b6e-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-r2r45\" (UID: \"49036815-1fae-4750-b5d0-f25f8faf9b6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r2r45" Jul 28 15:34:26.159367 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.159222 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e323d0e4-48e7-4ffc-904f-ad5158d52fc2-node-exporter-wtmp\") pod \"node-exporter-g77g8\" (UID: \"e323d0e4-48e7-4ffc-904f-ad5158d52fc2\") " pod="openshift-monitoring/node-exporter-g77g8" Jul 28 15:34:26.159367 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.159252 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49036815-1fae-4750-b5d0-f25f8faf9b6e-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-r2r45\" (UID: \"49036815-1fae-4750-b5d0-f25f8faf9b6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r2r45" Jul 28 15:34:26.159367 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.159279 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e323d0e4-48e7-4ffc-904f-ad5158d52fc2-node-exporter-textfile\") pod \"node-exporter-g77g8\" (UID: \"e323d0e4-48e7-4ffc-904f-ad5158d52fc2\") " pod="openshift-monitoring/node-exporter-g77g8" Jul 28 15:34:26.159367 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.159354 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/49036815-1fae-4750-b5d0-f25f8faf9b6e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-r2r45\" (UID: \"49036815-1fae-4750-b5d0-f25f8faf9b6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r2r45" Jul 28 15:34:26.260078 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.260041 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e323d0e4-48e7-4ffc-904f-ad5158d52fc2-node-exporter-accelerators-collector-config\") pod \"node-exporter-g77g8\" (UID: \"e323d0e4-48e7-4ffc-904f-ad5158d52fc2\") " pod="openshift-monitoring/node-exporter-g77g8" Jul 28 15:34:26.260275 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.260099 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e323d0e4-48e7-4ffc-904f-ad5158d52fc2-sys\") pod \"node-exporter-g77g8\" (UID: \"e323d0e4-48e7-4ffc-904f-ad5158d52fc2\") " pod="openshift-monitoring/node-exporter-g77g8" Jul 28 15:34:26.260275 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.260138 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e323d0e4-48e7-4ffc-904f-ad5158d52fc2-node-exporter-tls\") pod \"node-exporter-g77g8\" (UID: \"e323d0e4-48e7-4ffc-904f-ad5158d52fc2\") " pod="openshift-monitoring/node-exporter-g77g8" Jul 28 15:34:26.260275 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.260179 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv2hq\" (UniqueName: \"kubernetes.io/projected/e323d0e4-48e7-4ffc-904f-ad5158d52fc2-kube-api-access-qv2hq\") pod \"node-exporter-g77g8\" (UID: \"e323d0e4-48e7-4ffc-904f-ad5158d52fc2\") " pod="openshift-monitoring/node-exporter-g77g8" Jul 28 15:34:26.260275 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.260203 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e323d0e4-48e7-4ffc-904f-ad5158d52fc2-sys\") pod \"node-exporter-g77g8\" (UID: \"e323d0e4-48e7-4ffc-904f-ad5158d52fc2\") " pod="openshift-monitoring/node-exporter-g77g8" Jul 28 15:34:26.260275 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.260211 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06f122a6-68d9-481e-a74a-236e1ada9e1b-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-92rv6\" (UID: \"06f122a6-68d9-481e-a74a-236e1ada9e1b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-92rv6" Jul 28 15:34:26.260539 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.260275 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/06f122a6-68d9-481e-a74a-236e1ada9e1b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-92rv6\" (UID: \"06f122a6-68d9-481e-a74a-236e1ada9e1b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-92rv6" Jul 28 15:34:26.260539 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.260311 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e323d0e4-48e7-4ffc-904f-ad5158d52fc2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g77g8\" (UID: \"e323d0e4-48e7-4ffc-904f-ad5158d52fc2\") " pod="openshift-monitoring/node-exporter-g77g8" Jul 28 15:34:26.260539 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.260348 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/06f122a6-68d9-481e-a74a-236e1ada9e1b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-92rv6\" (UID: \"06f122a6-68d9-481e-a74a-236e1ada9e1b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-92rv6" Jul 28 15:34:26.260539 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.260376 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zxmz\" (UniqueName: \"kubernetes.io/projected/06f122a6-68d9-481e-a74a-236e1ada9e1b-kube-api-access-5zxmz\") pod \"openshift-state-metrics-b8f49f5c6-92rv6\" (UID: \"06f122a6-68d9-481e-a74a-236e1ada9e1b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-92rv6" Jul 28 15:34:26.260539 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.260402 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e323d0e4-48e7-4ffc-904f-ad5158d52fc2-metrics-client-ca\") pod \"node-exporter-g77g8\" (UID: \"e323d0e4-48e7-4ffc-904f-ad5158d52fc2\") " pod="openshift-monitoring/node-exporter-g77g8" Jul 28 15:34:26.260539 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.260425 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gqbb\" (UniqueName: \"kubernetes.io/projected/49036815-1fae-4750-b5d0-f25f8faf9b6e-kube-api-access-5gqbb\") pod \"kube-state-metrics-56d9f944b4-r2r45\" (UID: \"49036815-1fae-4750-b5d0-f25f8faf9b6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r2r45" Jul 28 15:34:26.260539 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.260450 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e323d0e4-48e7-4ffc-904f-ad5158d52fc2-root\") pod \"node-exporter-g77g8\" (UID: \"e323d0e4-48e7-4ffc-904f-ad5158d52fc2\") " pod="openshift-monitoring/node-exporter-g77g8" Jul 28 15:34:26.260539 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.260474 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/49036815-1fae-4750-b5d0-f25f8faf9b6e-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-r2r45\" (UID: \"49036815-1fae-4750-b5d0-f25f8faf9b6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r2r45" Jul 28 15:34:26.260539 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.260506 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/49036815-1fae-4750-b5d0-f25f8faf9b6e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-r2r45\" (UID: \"49036815-1fae-4750-b5d0-f25f8faf9b6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r2r45" Jul 28 15:34:26.260539 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.260535 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/49036815-1fae-4750-b5d0-f25f8faf9b6e-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-r2r45\" (UID: \"49036815-1fae-4750-b5d0-f25f8faf9b6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r2r45" Jul 28 15:34:26.261034 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.260565 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e323d0e4-48e7-4ffc-904f-ad5158d52fc2-node-exporter-wtmp\") pod \"node-exporter-g77g8\" (UID: \"e323d0e4-48e7-4ffc-904f-ad5158d52fc2\") " pod="openshift-monitoring/node-exporter-g77g8" Jul 28 15:34:26.261034 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.260605 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49036815-1fae-4750-b5d0-f25f8faf9b6e-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-r2r45\" (UID: \"49036815-1fae-4750-b5d0-f25f8faf9b6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r2r45" Jul 28 15:34:26.261034 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.260632 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e323d0e4-48e7-4ffc-904f-ad5158d52fc2-node-exporter-textfile\") pod \"node-exporter-g77g8\" (UID: \"e323d0e4-48e7-4ffc-904f-ad5158d52fc2\") " pod="openshift-monitoring/node-exporter-g77g8" Jul 28 15:34:26.261034 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.260661 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/49036815-1fae-4750-b5d0-f25f8faf9b6e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-r2r45\" (UID: \"49036815-1fae-4750-b5d0-f25f8faf9b6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r2r45" Jul 28 15:34:26.261034 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.260748 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e323d0e4-48e7-4ffc-904f-ad5158d52fc2-root\") pod \"node-exporter-g77g8\" (UID: \"e323d0e4-48e7-4ffc-904f-ad5158d52fc2\") " pod="openshift-monitoring/node-exporter-g77g8" Jul 28 15:34:26.261034 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.260777 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e323d0e4-48e7-4ffc-904f-ad5158d52fc2-node-exporter-accelerators-collector-config\") pod \"node-exporter-g77g8\" (UID: \"e323d0e4-48e7-4ffc-904f-ad5158d52fc2\") " pod="openshift-monitoring/node-exporter-g77g8" Jul 28 15:34:26.261034 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.260937 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06f122a6-68d9-481e-a74a-236e1ada9e1b-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-92rv6\" (UID: \"06f122a6-68d9-481e-a74a-236e1ada9e1b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-92rv6" Jul 28 15:34:26.261420 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:34:26.261107 2554 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 28 15:34:26.261420 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:34:26.261197 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49036815-1fae-4750-b5d0-f25f8faf9b6e-kube-state-metrics-tls podName:49036815-1fae-4750-b5d0-f25f8faf9b6e nodeName:}" failed. No retries permitted until 2026-07-28 15:34:26.761159282 +0000 UTC m=+88.230659437 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/49036815-1fae-4750-b5d0-f25f8faf9b6e-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-r2r45" (UID: "49036815-1fae-4750-b5d0-f25f8faf9b6e") : secret "kube-state-metrics-tls" not found Jul 28 15:34:26.261533 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.261464 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e323d0e4-48e7-4ffc-904f-ad5158d52fc2-node-exporter-textfile\") pod \"node-exporter-g77g8\" (UID: \"e323d0e4-48e7-4ffc-904f-ad5158d52fc2\") " pod="openshift-monitoring/node-exporter-g77g8" Jul 28 15:34:26.261712 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.261693 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/49036815-1fae-4750-b5d0-f25f8faf9b6e-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-r2r45\" (UID: \"49036815-1fae-4750-b5d0-f25f8faf9b6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r2r45" Jul 28 15:34:26.261887 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.261868 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49036815-1fae-4750-b5d0-f25f8faf9b6e-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-r2r45\" (UID: \"49036815-1fae-4750-b5d0-f25f8faf9b6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r2r45" Jul 28 15:34:26.262023 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.261996 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e323d0e4-48e7-4ffc-904f-ad5158d52fc2-node-exporter-wtmp\") pod \"node-exporter-g77g8\" (UID: \"e323d0e4-48e7-4ffc-904f-ad5158d52fc2\") " pod="openshift-monitoring/node-exporter-g77g8" Jul 28 15:34:26.262375 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.262321 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/49036815-1fae-4750-b5d0-f25f8faf9b6e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-r2r45\" (UID: \"49036815-1fae-4750-b5d0-f25f8faf9b6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r2r45" Jul 28 15:34:26.262808 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.262786 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e323d0e4-48e7-4ffc-904f-ad5158d52fc2-metrics-client-ca\") pod \"node-exporter-g77g8\" (UID: \"e323d0e4-48e7-4ffc-904f-ad5158d52fc2\") " pod="openshift-monitoring/node-exporter-g77g8" Jul 28 15:34:26.264004 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.263979 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/49036815-1fae-4750-b5d0-f25f8faf9b6e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-r2r45\" (UID: \"49036815-1fae-4750-b5d0-f25f8faf9b6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r2r45" Jul 28 15:34:26.264458 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.264434 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/06f122a6-68d9-481e-a74a-236e1ada9e1b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-92rv6\" (UID: \"06f122a6-68d9-481e-a74a-236e1ada9e1b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-92rv6" Jul 28 15:34:26.264830 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.264811 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e323d0e4-48e7-4ffc-904f-ad5158d52fc2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g77g8\" (UID: \"e323d0e4-48e7-4ffc-904f-ad5158d52fc2\") " pod="openshift-monitoring/node-exporter-g77g8" Jul 28 15:34:26.264965 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.264940 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/06f122a6-68d9-481e-a74a-236e1ada9e1b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-92rv6\" (UID: \"06f122a6-68d9-481e-a74a-236e1ada9e1b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-92rv6" Jul 28 15:34:26.265409 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.265388 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e323d0e4-48e7-4ffc-904f-ad5158d52fc2-node-exporter-tls\") pod \"node-exporter-g77g8\" (UID: \"e323d0e4-48e7-4ffc-904f-ad5158d52fc2\") " pod="openshift-monitoring/node-exporter-g77g8" Jul 28 15:34:26.273300 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.273258 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zxmz\" (UniqueName: \"kubernetes.io/projected/06f122a6-68d9-481e-a74a-236e1ada9e1b-kube-api-access-5zxmz\") pod \"openshift-state-metrics-b8f49f5c6-92rv6\" (UID: \"06f122a6-68d9-481e-a74a-236e1ada9e1b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-92rv6" Jul 28 15:34:26.273625 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.273594 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv2hq\" (UniqueName: \"kubernetes.io/projected/e323d0e4-48e7-4ffc-904f-ad5158d52fc2-kube-api-access-qv2hq\") pod \"node-exporter-g77g8\" (UID: \"e323d0e4-48e7-4ffc-904f-ad5158d52fc2\") " pod="openshift-monitoring/node-exporter-g77g8" Jul 28 15:34:26.274335 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.274287 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gqbb\" (UniqueName: \"kubernetes.io/projected/49036815-1fae-4750-b5d0-f25f8faf9b6e-kube-api-access-5gqbb\") pod \"kube-state-metrics-56d9f944b4-r2r45\" (UID: \"49036815-1fae-4750-b5d0-f25f8faf9b6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r2r45" Jul 28 15:34:26.367643 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.367612 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-92rv6" Jul 28 15:34:26.384020 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.383991 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g77g8" Jul 28 15:34:26.397430 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:34:26.397393 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode323d0e4_48e7_4ffc_904f_ad5158d52fc2.slice/crio-92d4bdf399aea151886cd235e892a3a08194b272a292681583b171d459201356 WatchSource:0}: Error finding container 92d4bdf399aea151886cd235e892a3a08194b272a292681583b171d459201356: Status 404 returned error can't find the container with id 92d4bdf399aea151886cd235e892a3a08194b272a292681583b171d459201356 Jul 28 15:34:26.529113 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.529080 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-92rv6"] Jul 28 15:34:26.533331 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:34:26.533296 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06f122a6_68d9_481e_a74a_236e1ada9e1b.slice/crio-4fc62424bca2c1e87811176bad109aae04cc8b8aef491fa3c5718b00ccbc04be WatchSource:0}: Error finding container 4fc62424bca2c1e87811176bad109aae04cc8b8aef491fa3c5718b00ccbc04be: Status 404 returned error can't find the container with id 4fc62424bca2c1e87811176bad109aae04cc8b8aef491fa3c5718b00ccbc04be Jul 28 15:34:26.559277 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.559243 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-92rv6" event={"ID":"06f122a6-68d9-481e-a74a-236e1ada9e1b","Type":"ContainerStarted","Data":"4fc62424bca2c1e87811176bad109aae04cc8b8aef491fa3c5718b00ccbc04be"} Jul 28 15:34:26.560826 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.560793 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g77g8" event={"ID":"e323d0e4-48e7-4ffc-904f-ad5158d52fc2","Type":"ContainerStarted","Data":"92d4bdf399aea151886cd235e892a3a08194b272a292681583b171d459201356"} Jul 28 15:34:26.562684 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.562331 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-b488j" event={"ID":"71855b26-90b6-4583-80d8-adeb3099e54b","Type":"ContainerStarted","Data":"afa46dfbe7b3765a68b3d889b7688097d0a74c5b163fee3747f528b03f36f25e"} Jul 28 15:34:26.764820 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.764259 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/49036815-1fae-4750-b5d0-f25f8faf9b6e-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-r2r45\" (UID: \"49036815-1fae-4750-b5d0-f25f8faf9b6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r2r45" Jul 28 15:34:26.767901 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.767851 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/49036815-1fae-4750-b5d0-f25f8faf9b6e-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-r2r45\" (UID: \"49036815-1fae-4750-b5d0-f25f8faf9b6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r2r45" Jul 28 15:34:26.977209 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:26.976892 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r2r45" Jul 28 15:34:27.185564 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:27.183607 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-r2r45"] Jul 28 15:34:27.189918 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:34:27.189883 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49036815_1fae_4750_b5d0_f25f8faf9b6e.slice/crio-9dddb956677e2e5e18391739e015caf83d256c6b35e630b72945fa69b6769fbe WatchSource:0}: Error finding container 9dddb956677e2e5e18391739e015caf83d256c6b35e630b72945fa69b6769fbe: Status 404 returned error can't find the container with id 9dddb956677e2e5e18391739e015caf83d256c6b35e630b72945fa69b6769fbe Jul 28 15:34:27.570200 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:27.570148 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-92rv6" event={"ID":"06f122a6-68d9-481e-a74a-236e1ada9e1b","Type":"ContainerStarted","Data":"c55734b0dc00c4c0035d4d939b7f078fed2f820a6758e9d187a4d66e696b7257"} Jul 28 15:34:27.570679 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:27.570236 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-92rv6" event={"ID":"06f122a6-68d9-481e-a74a-236e1ada9e1b","Type":"ContainerStarted","Data":"f09d66efabe2486d439bbee9ab9f996ef9cd1c2a76372fdaac65c45f4e3bd4c6"} Jul 28 15:34:27.572324 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:27.572294 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r2r45" event={"ID":"49036815-1fae-4750-b5d0-f25f8faf9b6e","Type":"ContainerStarted","Data":"9dddb956677e2e5e18391739e015caf83d256c6b35e630b72945fa69b6769fbe"} Jul 28 15:34:30.496500 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.496471 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-648fc6c747-sfs5s"] Jul 28 15:34:30.499917 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.499896 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-648fc6c747-sfs5s" Jul 28 15:34:30.502578 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.502299 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 28 15:34:30.502578 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.502310 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 28 15:34:30.502578 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.502373 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 28 15:34:30.502578 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.502376 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 28 15:34:30.504158 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.504106 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-41696i6aajjdo\"" Jul 28 15:34:30.504252 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.504195 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-hzj94\"" Jul 28 15:34:30.514279 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.514158 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-648fc6c747-sfs5s"] Jul 28 15:34:30.592907 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.592879 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zl8kx" event={"ID":"8b205f56-5230-402a-8d99-e8f21735c842","Type":"ContainerStarted","Data":"d9510bbf55d6bf0bec054537bf4e27fa2c6a05781e24f1b66ba25361d90ca63a"} Jul 28 15:34:30.600864 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.600341 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnmc9\" (UniqueName: \"kubernetes.io/projected/5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1-kube-api-access-fnmc9\") pod \"metrics-server-648fc6c747-sfs5s\" (UID: \"5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1\") " pod="openshift-monitoring/metrics-server-648fc6c747-sfs5s" Jul 28 15:34:30.600864 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.600426 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1-secret-metrics-server-tls\") pod \"metrics-server-648fc6c747-sfs5s\" (UID: \"5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1\") " pod="openshift-monitoring/metrics-server-648fc6c747-sfs5s" Jul 28 15:34:30.600864 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.600466 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1-metrics-server-audit-profiles\") pod \"metrics-server-648fc6c747-sfs5s\" (UID: \"5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1\") " pod="openshift-monitoring/metrics-server-648fc6c747-sfs5s" Jul 28 15:34:30.600864 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.600502 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1-secret-metrics-server-client-certs\") pod \"metrics-server-648fc6c747-sfs5s\" (UID: \"5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1\") " pod="openshift-monitoring/metrics-server-648fc6c747-sfs5s" Jul 28 15:34:30.600864 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.600527 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1-client-ca-bundle\") pod \"metrics-server-648fc6c747-sfs5s\" (UID: \"5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1\") " pod="openshift-monitoring/metrics-server-648fc6c747-sfs5s" Jul 28 15:34:30.600864 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.600559 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-648fc6c747-sfs5s\" (UID: \"5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1\") " pod="openshift-monitoring/metrics-server-648fc6c747-sfs5s" Jul 28 15:34:30.600864 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.600608 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1-audit-log\") pod \"metrics-server-648fc6c747-sfs5s\" (UID: \"5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1\") " pod="openshift-monitoring/metrics-server-648fc6c747-sfs5s" Jul 28 15:34:30.616445 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.615566 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zl8kx" podStartSLOduration=33.394678259 podStartE2EDuration="47.615545908s" totalImagesPullingTime="14.220867649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:33:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:34:30.613865267 +0000 UTC m=+92.083365446" watchObservedRunningTime="2026-07-28 15:34:30.615545908 +0000 UTC m=+92.085046087" Jul 28 15:34:30.702049 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.701593 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1-metrics-server-audit-profiles\") pod \"metrics-server-648fc6c747-sfs5s\" (UID: \"5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1\") " pod="openshift-monitoring/metrics-server-648fc6c747-sfs5s" Jul 28 15:34:30.702049 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.701637 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1-secret-metrics-server-client-certs\") pod \"metrics-server-648fc6c747-sfs5s\" (UID: \"5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1\") " pod="openshift-monitoring/metrics-server-648fc6c747-sfs5s" Jul 28 15:34:30.702328 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.702057 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1-client-ca-bundle\") pod \"metrics-server-648fc6c747-sfs5s\" (UID: \"5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1\") " pod="openshift-monitoring/metrics-server-648fc6c747-sfs5s" Jul 28 15:34:30.702328 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.702108 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-648fc6c747-sfs5s\" (UID: \"5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1\") " pod="openshift-monitoring/metrics-server-648fc6c747-sfs5s" Jul 28 15:34:30.702328 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.702202 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1-audit-log\") pod \"metrics-server-648fc6c747-sfs5s\" (UID: \"5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1\") " pod="openshift-monitoring/metrics-server-648fc6c747-sfs5s" Jul 28 15:34:30.702328 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.702255 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnmc9\" (UniqueName: \"kubernetes.io/projected/5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1-kube-api-access-fnmc9\") pod \"metrics-server-648fc6c747-sfs5s\" (UID: \"5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1\") " pod="openshift-monitoring/metrics-server-648fc6c747-sfs5s" Jul 28 15:34:30.702538 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.702347 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1-secret-metrics-server-tls\") pod \"metrics-server-648fc6c747-sfs5s\" (UID: \"5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1\") " pod="openshift-monitoring/metrics-server-648fc6c747-sfs5s" Jul 28 15:34:30.704237 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.702667 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1-metrics-server-audit-profiles\") pod \"metrics-server-648fc6c747-sfs5s\" (UID: \"5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1\") " pod="openshift-monitoring/metrics-server-648fc6c747-sfs5s" Jul 28 15:34:30.704237 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.703033 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1-audit-log\") pod \"metrics-server-648fc6c747-sfs5s\" (UID: \"5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1\") " pod="openshift-monitoring/metrics-server-648fc6c747-sfs5s" Jul 28 15:34:30.704237 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.703597 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-648fc6c747-sfs5s\" (UID: \"5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1\") " pod="openshift-monitoring/metrics-server-648fc6c747-sfs5s" Jul 28 15:34:30.706736 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.706611 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1-secret-metrics-server-client-certs\") pod \"metrics-server-648fc6c747-sfs5s\" (UID: \"5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1\") " pod="openshift-monitoring/metrics-server-648fc6c747-sfs5s" Jul 28 15:34:30.707373 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.707350 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1-secret-metrics-server-tls\") pod \"metrics-server-648fc6c747-sfs5s\" (UID: \"5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1\") " pod="openshift-monitoring/metrics-server-648fc6c747-sfs5s" Jul 28 15:34:30.709840 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.709598 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1-client-ca-bundle\") pod \"metrics-server-648fc6c747-sfs5s\" (UID: \"5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1\") " pod="openshift-monitoring/metrics-server-648fc6c747-sfs5s" Jul 28 15:34:30.715889 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.714842 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnmc9\" (UniqueName: \"kubernetes.io/projected/5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1-kube-api-access-fnmc9\") pod \"metrics-server-648fc6c747-sfs5s\" (UID: \"5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1\") " pod="openshift-monitoring/metrics-server-648fc6c747-sfs5s" Jul 28 15:34:30.890467 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:30.890431 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-648fc6c747-sfs5s" Jul 28 15:34:31.038065 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:31.038020 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-648fc6c747-sfs5s"] Jul 28 15:34:31.042331 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:34:31.042306 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c60e9db_5f08_4b0f_ab5e_93a16cd0b0c1.slice/crio-af59f6a01e56900477761c2160f092ad00d51dedd8f039a2d1ab9921e4f78963 WatchSource:0}: Error finding container af59f6a01e56900477761c2160f092ad00d51dedd8f039a2d1ab9921e4f78963: Status 404 returned error can't find the container with id af59f6a01e56900477761c2160f092ad00d51dedd8f039a2d1ab9921e4f78963 Jul 28 15:34:31.603114 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:31.603077 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-92rv6" event={"ID":"06f122a6-68d9-481e-a74a-236e1ada9e1b","Type":"ContainerStarted","Data":"ff138b7e506d36dcb93f17bab224bcc535729de4cee698df52fd7cab1617eab4"} Jul 28 15:34:31.605453 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:31.605425 2554 generic.go:356] "Generic (PLEG): container finished" podID="e323d0e4-48e7-4ffc-904f-ad5158d52fc2" containerID="d2a840f6e057e33ddbd66e2a5dd35cbd753b8f4cc0fa21cb87e283bcdb47a1b4" exitCode=0 Jul 28 15:34:31.605574 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:31.605514 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g77g8" event={"ID":"e323d0e4-48e7-4ffc-904f-ad5158d52fc2","Type":"ContainerDied","Data":"d2a840f6e057e33ddbd66e2a5dd35cbd753b8f4cc0fa21cb87e283bcdb47a1b4"} Jul 28 15:34:31.610735 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:31.609646 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r2r45" event={"ID":"49036815-1fae-4750-b5d0-f25f8faf9b6e","Type":"ContainerStarted","Data":"f6ad232f289acc234312254016db0870e2dce39fb318e668b88af751cf7ff5a0"} Jul 28 15:34:31.610735 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:31.609740 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r2r45" event={"ID":"49036815-1fae-4750-b5d0-f25f8faf9b6e","Type":"ContainerStarted","Data":"815b8b287b1a61494a71ea695f0e86e67218e17e10655466911280b199bf7eee"} Jul 28 15:34:31.610735 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:31.609778 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r2r45" event={"ID":"49036815-1fae-4750-b5d0-f25f8faf9b6e","Type":"ContainerStarted","Data":"2d341624a0d703efdf13206c45f65c8dca20409b600015946d67cdbb4a3f1968"} Jul 28 15:34:31.611704 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:31.611675 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-648fc6c747-sfs5s" event={"ID":"5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1","Type":"ContainerStarted","Data":"af59f6a01e56900477761c2160f092ad00d51dedd8f039a2d1ab9921e4f78963"} Jul 28 15:34:31.624641 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:31.624576 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-92rv6" podStartSLOduration=1.8812433259999999 podStartE2EDuration="5.624557876s" totalImagesPullingTime="3.74331455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:34:31.622072553 +0000 UTC m=+93.091572747" watchObservedRunningTime="2026-07-28 15:34:31.624557876 +0000 UTC m=+93.094058054" Jul 28 15:34:31.639381 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:31.639327 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-r2r45" podStartSLOduration=2.343908735 podStartE2EDuration="5.639306031s" totalImagesPullingTime="3.295397296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:34:31.638579485 +0000 UTC m=+93.108079665" watchObservedRunningTime="2026-07-28 15:34:31.639306031 +0000 UTC m=+93.108806211" Jul 28 15:34:32.271146 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.271106 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 15:34:32.276210 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.275664 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.278675 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.278649 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 15:34:32.278990 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.278906 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 15:34:32.279188 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.279149 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 15:34:32.279813 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.279789 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-m9vrx\"" Jul 28 15:34:32.279906 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.279844 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 15:34:32.279906 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.279858 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 15:34:32.280010 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.279845 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 15:34:32.280056 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.280017 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 15:34:32.280102 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.280065 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 15:34:32.280102 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.280080 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 15:34:32.280201 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.280124 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 15:34:32.280252 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.280019 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 15:34:32.280252 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.280230 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 15:34:32.280341 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.280277 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-emqqsf2c8sd5u\"" Jul 28 15:34:32.280930 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.280685 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 15:34:32.281951 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.281925 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 15:34:32.293460 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.293390 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 15:34:32.416906 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.416779 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-web-config\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.416906 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.416838 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.417186 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.416908 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.417186 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.416952 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.417186 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.416983 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d5de7079-5de5-499f-b4fe-b9bfeb55a529-config-out\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.417186 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.417012 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.417186 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.417039 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d5de7079-5de5-499f-b4fe-b9bfeb55a529-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.417186 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.417069 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-config\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.417186 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.417100 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.417186 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.417129 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.417186 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.417152 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.417628 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.417207 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.417628 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.417255 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.417628 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.417292 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.417628 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.417323 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d5de7079-5de5-499f-b4fe-b9bfeb55a529-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.417628 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.417360 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.417628 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.417386 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hxnb\" (UniqueName: \"kubernetes.io/projected/d5de7079-5de5-499f-b4fe-b9bfeb55a529-kube-api-access-7hxnb\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.417628 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.417405 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.417628 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.417434 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.417628 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.417457 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.518272 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.518228 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.518272 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.518278 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hxnb\" (UniqueName: \"kubernetes.io/projected/d5de7079-5de5-499f-b4fe-b9bfeb55a529-kube-api-access-7hxnb\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.518517 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.518308 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.518517 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.518341 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.518517 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.518363 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.518517 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.518408 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-web-config\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.518517 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.518439 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.518517 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.518470 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.518517 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.518515 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.518870 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.518545 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d5de7079-5de5-499f-b4fe-b9bfeb55a529-config-out\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.518870 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.518577 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.518870 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.518606 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d5de7079-5de5-499f-b4fe-b9bfeb55a529-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.518870 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.518635 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-config\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.518870 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.518673 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.518870 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.518706 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.518870 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.518730 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.519396 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.519364 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.519523 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.519473 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.519738 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.519700 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.519851 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.519752 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.519851 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.519781 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.519851 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.519821 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d5de7079-5de5-499f-b4fe-b9bfeb55a529-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.520065 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.520038 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.520406 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.520232 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d5de7079-5de5-499f-b4fe-b9bfeb55a529-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.521607 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.521546 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.522593 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.522564 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.522879 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.522857 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.523310 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.523270 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.524722 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.524695 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.525576 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.525550 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d5de7079-5de5-499f-b4fe-b9bfeb55a529-config-out\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.526626 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.526605 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.527516 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.527477 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.528091 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.528007 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-config\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.528091 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.528061 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-web-config\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.528790 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.528766 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hxnb\" (UniqueName: \"kubernetes.io/projected/d5de7079-5de5-499f-b4fe-b9bfeb55a529-kube-api-access-7hxnb\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.528899 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.528847 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.529660 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.529636 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.529764 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.529662 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.530129 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.530110 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d5de7079-5de5-499f-b4fe-b9bfeb55a529-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.531140 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.531119 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.587495 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.587459 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:34:32.619246 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.619204 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g77g8" event={"ID":"e323d0e4-48e7-4ffc-904f-ad5158d52fc2","Type":"ContainerStarted","Data":"5e7c7f772afc624efe53979c0a191aa4bd9a46712358c543a185eabecea452f4"} Jul 28 15:34:32.619651 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.619268 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g77g8" event={"ID":"e323d0e4-48e7-4ffc-904f-ad5158d52fc2","Type":"ContainerStarted","Data":"1ddb5f8d298aac7f690f4c6f2d70d1945bea8257ebb7ab99b4a257b4003ee4fa"} Jul 28 15:34:32.638862 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.638802 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-g77g8" podStartSLOduration=2.511636007 podStartE2EDuration="6.638781235s" totalImagesPullingTime="4.02374122s" totalInitContainerRuntime="103.404008ms" isStatefulPod=true podCreationTimestamp="2026-07-28 15:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:34:32.637559846 +0000 UTC m=+94.107060024" watchObservedRunningTime="2026-07-28 15:34:32.638781235 +0000 UTC m=+94.108281417" Jul 28 15:34:32.801355 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:32.801329 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 15:34:32.804643 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:34:32.804614 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5de7079_5de5_499f_b4fe_b9bfeb55a529.slice/crio-de642a3a2901ed496f57dccf5ca7876906115da1fff66fc245cebfd17126c652 WatchSource:0}: Error finding container de642a3a2901ed496f57dccf5ca7876906115da1fff66fc245cebfd17126c652: Status 404 returned error can't find the container with id de642a3a2901ed496f57dccf5ca7876906115da1fff66fc245cebfd17126c652 Jul 28 15:34:33.625778 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:33.625732 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5de7079-5de5-499f-b4fe-b9bfeb55a529","Type":"ContainerStarted","Data":"de642a3a2901ed496f57dccf5ca7876906115da1fff66fc245cebfd17126c652"} Jul 28 15:34:33.627978 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:33.627950 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-648fc6c747-sfs5s" event={"ID":"5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1","Type":"ContainerStarted","Data":"7a03b7ed1af7b681fa38bbda9e04cc499e6213c6fa4aab5eb3f8b80a164d7795"} Jul 28 15:34:33.648574 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:33.648508 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-648fc6c747-sfs5s" podStartSLOduration=2.001306011 podStartE2EDuration="3.648485222s" totalImagesPullingTime="1.647179211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:34:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:34:33.64828336 +0000 UTC m=+95.117783551" watchObservedRunningTime="2026-07-28 15:34:33.648485222 +0000 UTC m=+95.117985392" Jul 28 15:34:34.634217 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:34.634159 2554 generic.go:356] "Generic (PLEG): container finished" podID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerID="3c7f677a1fdafcf323303d97dec6118d0b404f527b1c82422c8802220745023d" exitCode=0 Jul 28 15:34:34.634639 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:34.634268 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5de7079-5de5-499f-b4fe-b9bfeb55a529","Type":"ContainerDied","Data":"3c7f677a1fdafcf323303d97dec6118d0b404f527b1c82422c8802220745023d"} Jul 28 15:34:36.519350 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:36.519319 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-54f75948cb-56nh8" Jul 28 15:34:41.484532 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:41.484500 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-c5vsn" Jul 28 15:34:45.686222 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:45.686190 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-b488j" event={"ID":"71855b26-90b6-4583-80d8-adeb3099e54b","Type":"ContainerStarted","Data":"917214b629eb21573959685d4baddb9eeca13105af4a0730c4cef06e9976ebf2"} Jul 28 15:34:45.686661 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:45.686509 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-b488j" Jul 28 15:34:45.687722 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:45.687698 2554 patch_prober.go:28] interesting pod/downloads-7c97dc4555-b488j container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.16:8080/\": dial tcp 10.134.0.16:8080: connect: connection refused" start-of-body= Jul 28 15:34:45.687820 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:45.687741 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7c97dc4555-b488j" podUID="71855b26-90b6-4583-80d8-adeb3099e54b" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.16:8080/\": dial tcp 10.134.0.16:8080: connect: connection refused" Jul 28 15:34:45.688340 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:45.688313 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5de7079-5de5-499f-b4fe-b9bfeb55a529","Type":"ContainerStarted","Data":"b07a63cc52435ef1d37fbf7ac76a337074e8d402fe087ccfcbf4fac0dc9759bc"} Jul 28 15:34:45.705453 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:45.705392 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-b488j" podStartSLOduration=1.233506244 podStartE2EDuration="20.705373255s" totalImagesPullingTime="19.471867011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:34:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:34:45.702549653 +0000 UTC m=+107.172049832" watchObservedRunningTime="2026-07-28 15:34:45.705373255 +0000 UTC m=+107.174873432" Jul 28 15:34:45.886668 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:45.886635 2554 patch_prober.go:28] interesting pod/downloads-7c97dc4555-b488j container/download-server namespace/openshift-console: Liveness probe status=failure output="Get \"http://10.134.0.16:8080/\": dial tcp 10.134.0.16:8080: connect: connection refused" start-of-body= Jul 28 15:34:45.886861 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:45.886687 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-console/downloads-7c97dc4555-b488j" podUID="71855b26-90b6-4583-80d8-adeb3099e54b" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.16:8080/\": dial tcp 10.134.0.16:8080: connect: connection refused" Jul 28 15:34:46.695802 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:46.695752 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5de7079-5de5-499f-b4fe-b9bfeb55a529","Type":"ContainerStarted","Data":"09ae728c3167ebf06d4f735aa66c2378ceddfbdb5cffe9a6923dd916262ded5a"} Jul 28 15:34:46.712653 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:46.712610 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-b488j" Jul 28 15:34:49.714066 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:49.714029 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5de7079-5de5-499f-b4fe-b9bfeb55a529","Type":"ContainerStarted","Data":"2cf24228ee7a836a3231b2df0dd8ffca0aef1ea861bf0e7f75f6134c3df64ad6"} Jul 28 15:34:49.714554 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:49.714111 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5de7079-5de5-499f-b4fe-b9bfeb55a529","Type":"ContainerStarted","Data":"9623e8a325de5fda1a3b0b1d9aaff6e58d6cf7cfac0734c5a729663db8d79a11"} Jul 28 15:34:49.714554 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:49.714156 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5de7079-5de5-499f-b4fe-b9bfeb55a529","Type":"ContainerStarted","Data":"1387d603d1fcd91f492a9d978c400dc90c18c74ad35661a373ad42ac81da473e"} Jul 28 15:34:49.714554 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:49.714223 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5de7079-5de5-499f-b4fe-b9bfeb55a529","Type":"ContainerStarted","Data":"a6e02c50baf38f31c493d3ba7bc144af0b36c76890a2969b5f9054d98e5c3a80"} Jul 28 15:34:49.746737 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:49.746679 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.849022466 podStartE2EDuration="17.746656092s" totalImagesPullingTime="14.875615292s" totalInitContainerRuntime="22.018334ms" isStatefulPod=false podCreationTimestamp="2026-07-28 15:34:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:34:49.7445696 +0000 UTC m=+111.214069777" watchObservedRunningTime="2026-07-28 15:34:49.746656092 +0000 UTC m=+111.216156272" Jul 28 15:34:50.891501 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:50.891459 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-648fc6c747-sfs5s" Jul 28 15:34:50.891969 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:50.891581 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-648fc6c747-sfs5s" Jul 28 15:34:52.588360 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:34:52.588316 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:10.896547 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:10.896517 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-648fc6c747-sfs5s" Jul 28 15:35:10.900473 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:10.900448 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-648fc6c747-sfs5s" Jul 28 15:35:13.812479 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:13.812446 2554 generic.go:356] "Generic (PLEG): container finished" podID="bd673619-a13c-46ec-9b3b-11a7701e7153" containerID="472bdfe738b672871a9f17eee2df11ea596d917654a919a142d9c4a351145663" exitCode=0 Jul 28 15:35:13.812906 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:13.812497 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8d4wr" event={"ID":"bd673619-a13c-46ec-9b3b-11a7701e7153","Type":"ContainerDied","Data":"472bdfe738b672871a9f17eee2df11ea596d917654a919a142d9c4a351145663"} Jul 28 15:35:13.812906 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:13.812815 2554 scope.go:117] "RemoveContainer" containerID="472bdfe738b672871a9f17eee2df11ea596d917654a919a142d9c4a351145663" Jul 28 15:35:14.817919 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:14.817888 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8d4wr" event={"ID":"bd673619-a13c-46ec-9b3b-11a7701e7153","Type":"ContainerStarted","Data":"ce780f85ef0049bfb33ee1465e6737e77145417336b982446da6093285fe38c2"} Jul 28 15:35:15.822870 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:15.822836 2554 generic.go:356] "Generic (PLEG): container finished" podID="1dbc5496-4a3a-43cf-9084-aaef1fab6b83" containerID="8d002c9ba5a1c2d6ab02111af1a614de2baf55b12b998817dfac7f3477e282db" exitCode=0 Jul 28 15:35:15.823260 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:15.822910 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-r5sgq" event={"ID":"1dbc5496-4a3a-43cf-9084-aaef1fab6b83","Type":"ContainerDied","Data":"8d002c9ba5a1c2d6ab02111af1a614de2baf55b12b998817dfac7f3477e282db"} Jul 28 15:35:15.823308 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:15.823267 2554 scope.go:117] "RemoveContainer" containerID="8d002c9ba5a1c2d6ab02111af1a614de2baf55b12b998817dfac7f3477e282db" Jul 28 15:35:16.828585 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:16.828551 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-r5sgq" event={"ID":"1dbc5496-4a3a-43cf-9084-aaef1fab6b83","Type":"ContainerStarted","Data":"93060c6023df28d5fb8bb17d8b248f5bb51218010452880c8d8df1186bf7ac61"} Jul 28 15:35:32.588452 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:32.588405 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:32.639467 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:32.639436 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:32.911399 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:32.911331 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:50.675548 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:50.675456 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 15:35:50.676064 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:50.675756 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerName="prometheus" containerID="cri-o://b07a63cc52435ef1d37fbf7ac76a337074e8d402fe087ccfcbf4fac0dc9759bc" gracePeriod=600 Jul 28 15:35:50.676064 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:50.675781 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerName="kube-rbac-proxy" containerID="cri-o://9623e8a325de5fda1a3b0b1d9aaff6e58d6cf7cfac0734c5a729663db8d79a11" gracePeriod=600 Jul 28 15:35:50.676064 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:50.675803 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerName="thanos-sidecar" containerID="cri-o://a6e02c50baf38f31c493d3ba7bc144af0b36c76890a2969b5f9054d98e5c3a80" gracePeriod=600 Jul 28 15:35:50.676064 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:50.675848 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerName="kube-rbac-proxy-web" containerID="cri-o://1387d603d1fcd91f492a9d978c400dc90c18c74ad35661a373ad42ac81da473e" gracePeriod=600 Jul 28 15:35:50.676064 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:50.675876 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerName="kube-rbac-proxy-thanos" containerID="cri-o://2cf24228ee7a836a3231b2df0dd8ffca0aef1ea861bf0e7f75f6134c3df64ad6" gracePeriod=600 Jul 28 15:35:50.676064 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:50.675878 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerName="config-reloader" containerID="cri-o://09ae728c3167ebf06d4f735aa66c2378ceddfbdb5cffe9a6923dd916262ded5a" gracePeriod=600 Jul 28 15:35:50.963471 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:50.963392 2554 generic.go:356] "Generic (PLEG): container finished" podID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerID="2cf24228ee7a836a3231b2df0dd8ffca0aef1ea861bf0e7f75f6134c3df64ad6" exitCode=0 Jul 28 15:35:50.963471 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:50.963416 2554 generic.go:356] "Generic (PLEG): container finished" podID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerID="9623e8a325de5fda1a3b0b1d9aaff6e58d6cf7cfac0734c5a729663db8d79a11" exitCode=0 Jul 28 15:35:50.963471 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:50.963422 2554 generic.go:356] "Generic (PLEG): container finished" podID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerID="a6e02c50baf38f31c493d3ba7bc144af0b36c76890a2969b5f9054d98e5c3a80" exitCode=0 Jul 28 15:35:50.963471 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:50.963431 2554 generic.go:356] "Generic (PLEG): container finished" podID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerID="09ae728c3167ebf06d4f735aa66c2378ceddfbdb5cffe9a6923dd916262ded5a" exitCode=0 Jul 28 15:35:50.963471 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:50.963440 2554 generic.go:356] "Generic (PLEG): container finished" podID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerID="b07a63cc52435ef1d37fbf7ac76a337074e8d402fe087ccfcbf4fac0dc9759bc" exitCode=0 Jul 28 15:35:50.963471 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:50.963460 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5de7079-5de5-499f-b4fe-b9bfeb55a529","Type":"ContainerDied","Data":"2cf24228ee7a836a3231b2df0dd8ffca0aef1ea861bf0e7f75f6134c3df64ad6"} Jul 28 15:35:50.963757 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:50.963524 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5de7079-5de5-499f-b4fe-b9bfeb55a529","Type":"ContainerDied","Data":"9623e8a325de5fda1a3b0b1d9aaff6e58d6cf7cfac0734c5a729663db8d79a11"} Jul 28 15:35:50.963757 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:50.963551 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5de7079-5de5-499f-b4fe-b9bfeb55a529","Type":"ContainerDied","Data":"a6e02c50baf38f31c493d3ba7bc144af0b36c76890a2969b5f9054d98e5c3a80"} Jul 28 15:35:50.963757 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:50.963576 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5de7079-5de5-499f-b4fe-b9bfeb55a529","Type":"ContainerDied","Data":"09ae728c3167ebf06d4f735aa66c2378ceddfbdb5cffe9a6923dd916262ded5a"} Jul 28 15:35:50.963757 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:50.963598 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5de7079-5de5-499f-b4fe-b9bfeb55a529","Type":"ContainerDied","Data":"b07a63cc52435ef1d37fbf7ac76a337074e8d402fe087ccfcbf4fac0dc9759bc"} Jul 28 15:35:51.931849 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:51.931829 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:51.971838 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:51.971810 2554 generic.go:356] "Generic (PLEG): container finished" podID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerID="1387d603d1fcd91f492a9d978c400dc90c18c74ad35661a373ad42ac81da473e" exitCode=0 Jul 28 15:35:51.972001 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:51.971855 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5de7079-5de5-499f-b4fe-b9bfeb55a529","Type":"ContainerDied","Data":"1387d603d1fcd91f492a9d978c400dc90c18c74ad35661a373ad42ac81da473e"} Jul 28 15:35:51.972001 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:51.971888 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:51.972001 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:51.971924 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5de7079-5de5-499f-b4fe-b9bfeb55a529","Type":"ContainerDied","Data":"de642a3a2901ed496f57dccf5ca7876906115da1fff66fc245cebfd17126c652"} Jul 28 15:35:51.972001 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:51.971976 2554 scope.go:117] "RemoveContainer" containerID="2cf24228ee7a836a3231b2df0dd8ffca0aef1ea861bf0e7f75f6134c3df64ad6" Jul 28 15:35:51.980762 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:51.980742 2554 scope.go:117] "RemoveContainer" containerID="9623e8a325de5fda1a3b0b1d9aaff6e58d6cf7cfac0734c5a729663db8d79a11" Jul 28 15:35:51.994509 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:51.994471 2554 scope.go:117] "RemoveContainer" containerID="1387d603d1fcd91f492a9d978c400dc90c18c74ad35661a373ad42ac81da473e" Jul 28 15:35:52.002805 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.002782 2554 scope.go:117] "RemoveContainer" containerID="a6e02c50baf38f31c493d3ba7bc144af0b36c76890a2969b5f9054d98e5c3a80" Jul 28 15:35:52.008979 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.008956 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-kube-rbac-proxy\") pod \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " Jul 28 15:35:52.009090 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.008999 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-prometheus-k8s-tls\") pod \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " Jul 28 15:35:52.009090 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.009033 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-config\") pod \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " Jul 28 15:35:52.009090 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.009060 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d5de7079-5de5-499f-b4fe-b9bfeb55a529-tls-assets\") pod \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " Jul 28 15:35:52.009090 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.009082 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-grpc-tls\") pod \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " Jul 28 15:35:52.009318 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.009111 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-prometheus-k8s-rulefiles-0\") pod \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " Jul 28 15:35:52.009318 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.009136 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " Jul 28 15:35:52.009318 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.009197 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-configmap-kubelet-serving-ca-bundle\") pod \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " Jul 28 15:35:52.009318 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.009223 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hxnb\" (UniqueName: \"kubernetes.io/projected/d5de7079-5de5-499f-b4fe-b9bfeb55a529-kube-api-access-7hxnb\") pod \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " Jul 28 15:35:52.009318 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.009254 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-web-config\") pod \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " Jul 28 15:35:52.009318 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.009283 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-configmap-serving-certs-ca-bundle\") pod \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " Jul 28 15:35:52.009318 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.009311 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d5de7079-5de5-499f-b4fe-b9bfeb55a529-config-out\") pod \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " Jul 28 15:35:52.009660 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.009337 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " Jul 28 15:35:52.009660 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.009387 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-thanos-prometheus-http-client-file\") pod \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " Jul 28 15:35:52.009660 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.009430 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-prometheus-k8s-rulefiles-1\") pod \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " Jul 28 15:35:52.009660 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.009453 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-configmap-metrics-client-ca\") pod \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " Jul 28 15:35:52.009660 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.009489 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-metrics-client-certs\") pod \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " Jul 28 15:35:52.009660 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.009530 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-prometheus-trusted-ca-bundle\") pod \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " Jul 28 15:35:52.009660 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.009566 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-prometheus-k8s-rulefiles-2\") pod \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " Jul 28 15:35:52.009660 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.009619 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d5de7079-5de5-499f-b4fe-b9bfeb55a529-prometheus-k8s-db\") pod \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\" (UID: \"d5de7079-5de5-499f-b4fe-b9bfeb55a529\") " Jul 28 15:35:52.010280 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.010070 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "d5de7079-5de5-499f-b4fe-b9bfeb55a529" (UID: "d5de7079-5de5-499f-b4fe-b9bfeb55a529"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 15:35:52.010280 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.010147 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "d5de7079-5de5-499f-b4fe-b9bfeb55a529" (UID: "d5de7079-5de5-499f-b4fe-b9bfeb55a529"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 15:35:52.010799 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.010771 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "d5de7079-5de5-499f-b4fe-b9bfeb55a529" (UID: "d5de7079-5de5-499f-b4fe-b9bfeb55a529"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 15:35:52.013048 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.012893 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "d5de7079-5de5-499f-b4fe-b9bfeb55a529" (UID: "d5de7079-5de5-499f-b4fe-b9bfeb55a529"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 15:35:52.013048 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.012985 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5de7079-5de5-499f-b4fe-b9bfeb55a529-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "d5de7079-5de5-499f-b4fe-b9bfeb55a529" (UID: "d5de7079-5de5-499f-b4fe-b9bfeb55a529"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 15:35:52.013517 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.013435 2554 scope.go:117] "RemoveContainer" containerID="09ae728c3167ebf06d4f735aa66c2378ceddfbdb5cffe9a6923dd916262ded5a" Jul 28 15:35:52.013821 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.013767 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "d5de7079-5de5-499f-b4fe-b9bfeb55a529" (UID: "d5de7079-5de5-499f-b4fe-b9bfeb55a529"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 15:35:52.014327 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.014299 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "d5de7079-5de5-499f-b4fe-b9bfeb55a529" (UID: "d5de7079-5de5-499f-b4fe-b9bfeb55a529"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 15:35:52.014420 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.014382 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "d5de7079-5de5-499f-b4fe-b9bfeb55a529" (UID: "d5de7079-5de5-499f-b4fe-b9bfeb55a529"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 15:35:52.015053 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.014966 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-config" (OuterVolumeSpecName: "config") pod "d5de7079-5de5-499f-b4fe-b9bfeb55a529" (UID: "d5de7079-5de5-499f-b4fe-b9bfeb55a529"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 15:35:52.015053 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.014990 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "d5de7079-5de5-499f-b4fe-b9bfeb55a529" (UID: "d5de7079-5de5-499f-b4fe-b9bfeb55a529"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 15:35:52.015053 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.015031 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "d5de7079-5de5-499f-b4fe-b9bfeb55a529" (UID: "d5de7079-5de5-499f-b4fe-b9bfeb55a529"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 15:35:52.015694 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.015492 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "d5de7079-5de5-499f-b4fe-b9bfeb55a529" (UID: "d5de7079-5de5-499f-b4fe-b9bfeb55a529"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 15:35:52.015694 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.015558 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5de7079-5de5-499f-b4fe-b9bfeb55a529-config-out" (OuterVolumeSpecName: "config-out") pod "d5de7079-5de5-499f-b4fe-b9bfeb55a529" (UID: "d5de7079-5de5-499f-b4fe-b9bfeb55a529"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 15:35:52.016126 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.016090 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5de7079-5de5-499f-b4fe-b9bfeb55a529-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d5de7079-5de5-499f-b4fe-b9bfeb55a529" (UID: "d5de7079-5de5-499f-b4fe-b9bfeb55a529"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 15:35:52.016126 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.016099 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "d5de7079-5de5-499f-b4fe-b9bfeb55a529" (UID: "d5de7079-5de5-499f-b4fe-b9bfeb55a529"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 15:35:52.016609 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.016584 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5de7079-5de5-499f-b4fe-b9bfeb55a529-kube-api-access-7hxnb" (OuterVolumeSpecName: "kube-api-access-7hxnb") pod "d5de7079-5de5-499f-b4fe-b9bfeb55a529" (UID: "d5de7079-5de5-499f-b4fe-b9bfeb55a529"). InnerVolumeSpecName "kube-api-access-7hxnb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 15:35:52.016852 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.016833 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "d5de7079-5de5-499f-b4fe-b9bfeb55a529" (UID: "d5de7079-5de5-499f-b4fe-b9bfeb55a529"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 15:35:52.016941 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.016859 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "d5de7079-5de5-499f-b4fe-b9bfeb55a529" (UID: "d5de7079-5de5-499f-b4fe-b9bfeb55a529"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 15:35:52.017370 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.017351 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "d5de7079-5de5-499f-b4fe-b9bfeb55a529" (UID: "d5de7079-5de5-499f-b4fe-b9bfeb55a529"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 15:35:52.029822 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.029787 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-web-config" (OuterVolumeSpecName: "web-config") pod "d5de7079-5de5-499f-b4fe-b9bfeb55a529" (UID: "d5de7079-5de5-499f-b4fe-b9bfeb55a529"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 15:35:52.035241 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.035223 2554 scope.go:117] "RemoveContainer" containerID="b07a63cc52435ef1d37fbf7ac76a337074e8d402fe087ccfcbf4fac0dc9759bc" Jul 28 15:35:52.043070 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.043054 2554 scope.go:117] "RemoveContainer" containerID="3c7f677a1fdafcf323303d97dec6118d0b404f527b1c82422c8802220745023d" Jul 28 15:35:52.050004 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.049988 2554 scope.go:117] "RemoveContainer" containerID="2cf24228ee7a836a3231b2df0dd8ffca0aef1ea861bf0e7f75f6134c3df64ad6" Jul 28 15:35:52.050299 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:35:52.050280 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cf24228ee7a836a3231b2df0dd8ffca0aef1ea861bf0e7f75f6134c3df64ad6\": container with ID starting with 2cf24228ee7a836a3231b2df0dd8ffca0aef1ea861bf0e7f75f6134c3df64ad6 not found: ID does not exist" containerID="2cf24228ee7a836a3231b2df0dd8ffca0aef1ea861bf0e7f75f6134c3df64ad6" Jul 28 15:35:52.050349 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.050310 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cf24228ee7a836a3231b2df0dd8ffca0aef1ea861bf0e7f75f6134c3df64ad6"} err="failed to get container status \"2cf24228ee7a836a3231b2df0dd8ffca0aef1ea861bf0e7f75f6134c3df64ad6\": rpc error: code = NotFound desc = could not find container \"2cf24228ee7a836a3231b2df0dd8ffca0aef1ea861bf0e7f75f6134c3df64ad6\": container with ID starting with 2cf24228ee7a836a3231b2df0dd8ffca0aef1ea861bf0e7f75f6134c3df64ad6 not found: ID does not exist" Jul 28 15:35:52.050349 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.050346 2554 scope.go:117] "RemoveContainer" containerID="9623e8a325de5fda1a3b0b1d9aaff6e58d6cf7cfac0734c5a729663db8d79a11" Jul 28 15:35:52.050581 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:35:52.050564 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9623e8a325de5fda1a3b0b1d9aaff6e58d6cf7cfac0734c5a729663db8d79a11\": container with ID starting with 9623e8a325de5fda1a3b0b1d9aaff6e58d6cf7cfac0734c5a729663db8d79a11 not found: ID does not exist" containerID="9623e8a325de5fda1a3b0b1d9aaff6e58d6cf7cfac0734c5a729663db8d79a11" Jul 28 15:35:52.050631 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.050587 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9623e8a325de5fda1a3b0b1d9aaff6e58d6cf7cfac0734c5a729663db8d79a11"} err="failed to get container status \"9623e8a325de5fda1a3b0b1d9aaff6e58d6cf7cfac0734c5a729663db8d79a11\": rpc error: code = NotFound desc = could not find container \"9623e8a325de5fda1a3b0b1d9aaff6e58d6cf7cfac0734c5a729663db8d79a11\": container with ID starting with 9623e8a325de5fda1a3b0b1d9aaff6e58d6cf7cfac0734c5a729663db8d79a11 not found: ID does not exist" Jul 28 15:35:52.050631 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.050603 2554 scope.go:117] "RemoveContainer" containerID="1387d603d1fcd91f492a9d978c400dc90c18c74ad35661a373ad42ac81da473e" Jul 28 15:35:52.050830 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:35:52.050816 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1387d603d1fcd91f492a9d978c400dc90c18c74ad35661a373ad42ac81da473e\": container with ID starting with 1387d603d1fcd91f492a9d978c400dc90c18c74ad35661a373ad42ac81da473e not found: ID does not exist" containerID="1387d603d1fcd91f492a9d978c400dc90c18c74ad35661a373ad42ac81da473e" Jul 28 15:35:52.050872 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.050832 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1387d603d1fcd91f492a9d978c400dc90c18c74ad35661a373ad42ac81da473e"} err="failed to get container status \"1387d603d1fcd91f492a9d978c400dc90c18c74ad35661a373ad42ac81da473e\": rpc error: code = NotFound desc = could not find container \"1387d603d1fcd91f492a9d978c400dc90c18c74ad35661a373ad42ac81da473e\": container with ID starting with 1387d603d1fcd91f492a9d978c400dc90c18c74ad35661a373ad42ac81da473e not found: ID does not exist" Jul 28 15:35:52.050872 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.050843 2554 scope.go:117] "RemoveContainer" containerID="a6e02c50baf38f31c493d3ba7bc144af0b36c76890a2969b5f9054d98e5c3a80" Jul 28 15:35:52.051026 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:35:52.051011 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6e02c50baf38f31c493d3ba7bc144af0b36c76890a2969b5f9054d98e5c3a80\": container with ID starting with a6e02c50baf38f31c493d3ba7bc144af0b36c76890a2969b5f9054d98e5c3a80 not found: ID does not exist" containerID="a6e02c50baf38f31c493d3ba7bc144af0b36c76890a2969b5f9054d98e5c3a80" Jul 28 15:35:52.051063 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.051027 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6e02c50baf38f31c493d3ba7bc144af0b36c76890a2969b5f9054d98e5c3a80"} err="failed to get container status \"a6e02c50baf38f31c493d3ba7bc144af0b36c76890a2969b5f9054d98e5c3a80\": rpc error: code = NotFound desc = could not find container \"a6e02c50baf38f31c493d3ba7bc144af0b36c76890a2969b5f9054d98e5c3a80\": container with ID starting with a6e02c50baf38f31c493d3ba7bc144af0b36c76890a2969b5f9054d98e5c3a80 not found: ID does not exist" Jul 28 15:35:52.051063 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.051039 2554 scope.go:117] "RemoveContainer" containerID="09ae728c3167ebf06d4f735aa66c2378ceddfbdb5cffe9a6923dd916262ded5a" Jul 28 15:35:52.051261 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:35:52.051245 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09ae728c3167ebf06d4f735aa66c2378ceddfbdb5cffe9a6923dd916262ded5a\": container with ID starting with 09ae728c3167ebf06d4f735aa66c2378ceddfbdb5cffe9a6923dd916262ded5a not found: ID does not exist" containerID="09ae728c3167ebf06d4f735aa66c2378ceddfbdb5cffe9a6923dd916262ded5a" Jul 28 15:35:52.051327 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.051265 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09ae728c3167ebf06d4f735aa66c2378ceddfbdb5cffe9a6923dd916262ded5a"} err="failed to get container status \"09ae728c3167ebf06d4f735aa66c2378ceddfbdb5cffe9a6923dd916262ded5a\": rpc error: code = NotFound desc = could not find container \"09ae728c3167ebf06d4f735aa66c2378ceddfbdb5cffe9a6923dd916262ded5a\": container with ID starting with 09ae728c3167ebf06d4f735aa66c2378ceddfbdb5cffe9a6923dd916262ded5a not found: ID does not exist" Jul 28 15:35:52.051327 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.051278 2554 scope.go:117] "RemoveContainer" containerID="b07a63cc52435ef1d37fbf7ac76a337074e8d402fe087ccfcbf4fac0dc9759bc" Jul 28 15:35:52.051480 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:35:52.051462 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b07a63cc52435ef1d37fbf7ac76a337074e8d402fe087ccfcbf4fac0dc9759bc\": container with ID starting with b07a63cc52435ef1d37fbf7ac76a337074e8d402fe087ccfcbf4fac0dc9759bc not found: ID does not exist" containerID="b07a63cc52435ef1d37fbf7ac76a337074e8d402fe087ccfcbf4fac0dc9759bc" Jul 28 15:35:52.051526 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.051484 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b07a63cc52435ef1d37fbf7ac76a337074e8d402fe087ccfcbf4fac0dc9759bc"} err="failed to get container status \"b07a63cc52435ef1d37fbf7ac76a337074e8d402fe087ccfcbf4fac0dc9759bc\": rpc error: code = NotFound desc = could not find container \"b07a63cc52435ef1d37fbf7ac76a337074e8d402fe087ccfcbf4fac0dc9759bc\": container with ID starting with b07a63cc52435ef1d37fbf7ac76a337074e8d402fe087ccfcbf4fac0dc9759bc not found: ID does not exist" Jul 28 15:35:52.051526 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.051498 2554 scope.go:117] "RemoveContainer" containerID="3c7f677a1fdafcf323303d97dec6118d0b404f527b1c82422c8802220745023d" Jul 28 15:35:52.051695 ip-10-0-141-87 kubenswrapper[2554]: E0728 15:35:52.051680 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c7f677a1fdafcf323303d97dec6118d0b404f527b1c82422c8802220745023d\": container with ID starting with 3c7f677a1fdafcf323303d97dec6118d0b404f527b1c82422c8802220745023d not found: ID does not exist" containerID="3c7f677a1fdafcf323303d97dec6118d0b404f527b1c82422c8802220745023d" Jul 28 15:35:52.051730 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.051699 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c7f677a1fdafcf323303d97dec6118d0b404f527b1c82422c8802220745023d"} err="failed to get container status \"3c7f677a1fdafcf323303d97dec6118d0b404f527b1c82422c8802220745023d\": rpc error: code = NotFound desc = could not find container \"3c7f677a1fdafcf323303d97dec6118d0b404f527b1c82422c8802220745023d\": container with ID starting with 3c7f677a1fdafcf323303d97dec6118d0b404f527b1c82422c8802220745023d not found: ID does not exist" Jul 28 15:35:52.111344 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.111310 2554 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d5de7079-5de5-499f-b4fe-b9bfeb55a529-config-out\") on node \"ip-10-0-141-87.ec2.internal\" DevicePath \"\"" Jul 28 15:35:52.111344 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.111343 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-87.ec2.internal\" DevicePath \"\"" Jul 28 15:35:52.111530 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.111358 2554 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-87.ec2.internal\" DevicePath \"\"" Jul 28 15:35:52.111530 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.111370 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-87.ec2.internal\" DevicePath \"\"" Jul 28 15:35:52.111530 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.111379 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-configmap-metrics-client-ca\") on node \"ip-10-0-141-87.ec2.internal\" DevicePath \"\"" Jul 28 15:35:52.111530 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.111387 2554 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-metrics-client-certs\") on node \"ip-10-0-141-87.ec2.internal\" DevicePath \"\"" Jul 28 15:35:52.111530 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.111395 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-87.ec2.internal\" DevicePath \"\"" Jul 28 15:35:52.111530 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.111404 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-87.ec2.internal\" DevicePath \"\"" Jul 28 15:35:52.111530 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.111413 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d5de7079-5de5-499f-b4fe-b9bfeb55a529-prometheus-k8s-db\") on node \"ip-10-0-141-87.ec2.internal\" DevicePath \"\"" Jul 28 15:35:52.111530 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.111423 2554 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-kube-rbac-proxy\") on node \"ip-10-0-141-87.ec2.internal\" DevicePath \"\"" Jul 28 15:35:52.111530 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.111431 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-87.ec2.internal\" DevicePath \"\"" Jul 28 15:35:52.111530 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.111439 2554 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-config\") on node \"ip-10-0-141-87.ec2.internal\" DevicePath \"\"" Jul 28 15:35:52.111530 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.111447 2554 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d5de7079-5de5-499f-b4fe-b9bfeb55a529-tls-assets\") on node \"ip-10-0-141-87.ec2.internal\" DevicePath \"\"" Jul 28 15:35:52.111530 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.111455 2554 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-grpc-tls\") on node \"ip-10-0-141-87.ec2.internal\" DevicePath \"\"" Jul 28 15:35:52.111530 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.111462 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-87.ec2.internal\" DevicePath \"\"" Jul 28 15:35:52.111530 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.111470 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-87.ec2.internal\" DevicePath \"\"" Jul 28 15:35:52.111530 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.111479 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-87.ec2.internal\" DevicePath \"\"" Jul 28 15:35:52.111530 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.111487 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hxnb\" (UniqueName: \"kubernetes.io/projected/d5de7079-5de5-499f-b4fe-b9bfeb55a529-kube-api-access-7hxnb\") on node \"ip-10-0-141-87.ec2.internal\" DevicePath \"\"" Jul 28 15:35:52.111530 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.111496 2554 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d5de7079-5de5-499f-b4fe-b9bfeb55a529-web-config\") on node \"ip-10-0-141-87.ec2.internal\" DevicePath \"\"" Jul 28 15:35:52.111530 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.111504 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5de7079-5de5-499f-b4fe-b9bfeb55a529-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-87.ec2.internal\" DevicePath \"\"" Jul 28 15:35:52.297462 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.297421 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 15:35:52.305037 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.305013 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 15:35:52.331439 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.331412 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 15:35:52.331707 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.331694 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerName="thanos-sidecar" Jul 28 15:35:52.331748 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.331707 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerName="thanos-sidecar" Jul 28 15:35:52.331748 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.331717 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerName="kube-rbac-proxy-thanos" Jul 28 15:35:52.331748 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.331722 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerName="kube-rbac-proxy-thanos" Jul 28 15:35:52.331748 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.331735 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerName="kube-rbac-proxy-web" Jul 28 15:35:52.331748 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.331741 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerName="kube-rbac-proxy-web" Jul 28 15:35:52.331748 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.331747 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerName="config-reloader" Jul 28 15:35:52.331927 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.331752 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerName="config-reloader" Jul 28 15:35:52.331927 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.331759 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerName="kube-rbac-proxy" Jul 28 15:35:52.331927 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.331764 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerName="kube-rbac-proxy" Jul 28 15:35:52.331927 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.331771 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerName="init-config-reloader" Jul 28 15:35:52.331927 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.331775 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerName="init-config-reloader" Jul 28 15:35:52.331927 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.331788 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerName="prometheus" Jul 28 15:35:52.331927 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.331793 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerName="prometheus" Jul 28 15:35:52.331927 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.331834 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerName="config-reloader" Jul 28 15:35:52.331927 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.331842 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerName="thanos-sidecar" Jul 28 15:35:52.331927 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.331847 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerName="kube-rbac-proxy-web" Jul 28 15:35:52.331927 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.331855 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerName="prometheus" Jul 28 15:35:52.331927 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.331862 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerName="kube-rbac-proxy" Jul 28 15:35:52.331927 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.331867 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" containerName="kube-rbac-proxy-thanos" Jul 28 15:35:52.335903 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.335889 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.338730 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.338679 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 15:35:52.338730 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.338723 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 15:35:52.338909 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.338761 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-emqqsf2c8sd5u\"" Jul 28 15:35:52.338909 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.338723 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 15:35:52.338909 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.338723 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 15:35:52.339056 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.338957 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 15:35:52.339129 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.339113 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 15:35:52.339313 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.339295 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 15:35:52.339395 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.339381 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 15:35:52.339668 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.339641 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 15:35:52.339721 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.339644 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 15:35:52.340160 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.340141 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 15:35:52.340263 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.340224 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-m9vrx\"" Jul 28 15:35:52.340326 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.340258 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 15:35:52.342293 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.342275 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 15:35:52.344152 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.344129 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 15:35:52.351214 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.351191 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 15:35:52.415115 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.415083 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.415300 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.415121 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.415300 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.415140 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.415300 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.415191 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.415300 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.415210 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.415300 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.415229 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.415300 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.415243 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.415534 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.415295 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-config-out\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.415534 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.415343 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.415534 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.415361 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-web-config\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.415534 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.415394 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.415534 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.415414 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-config\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.415534 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.415446 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r49l\" (UniqueName: \"kubernetes.io/projected/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-kube-api-access-4r49l\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.415534 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.415497 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.415534 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.415527 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.415803 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.415552 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.415803 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.415571 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.415803 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.415592 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.415803 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.415609 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.415803 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.415630 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.516402 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.516364 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.516402 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.516402 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-web-config\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.516628 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.516431 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.516628 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.516451 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-config\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.516628 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.516472 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r49l\" (UniqueName: \"kubernetes.io/projected/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-kube-api-access-4r49l\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.516628 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.516498 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.516628 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.516526 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.516628 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.516549 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.516628 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.516575 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.516628 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.516596 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.516628 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.516635 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.517054 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.516656 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.517054 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.516673 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.517054 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.516692 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.517054 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.516720 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.517054 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.516747 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.517054 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.516773 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.517054 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.516805 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.517054 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.516829 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.517054 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.516863 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-config-out\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.517505 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.517352 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.519587 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.517835 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.519587 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.518031 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.519587 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.518503 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.519832 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.519615 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-config-out\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.519954 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.519933 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.520014 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.519933 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-web-config\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.520139 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.520116 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.520215 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.520191 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.520418 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.520356 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.520517 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.520461 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.520602 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.520580 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.520941 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.520885 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-config\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.521336 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.521312 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.521810 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.521790 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.522374 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.522356 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.522627 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.522607 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.522817 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.522798 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.522891 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.522875 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.524724 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.524703 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r49l\" (UniqueName: \"kubernetes.io/projected/82d8b984-38f0-407f-b48c-55a2b2b4ee5b-kube-api-access-4r49l\") pod \"prometheus-k8s-0\" (UID: \"82d8b984-38f0-407f-b48c-55a2b2b4ee5b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.645993 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.645907 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:35:52.785710 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.785684 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 15:35:52.788020 ip-10-0-141-87 kubenswrapper[2554]: W0728 15:35:52.787996 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82d8b984_38f0_407f_b48c_55a2b2b4ee5b.slice/crio-97308b6c5bd9df00dab1bd50bc7b5aad85cf56f4920176cc279fc5805635e033 WatchSource:0}: Error finding container 97308b6c5bd9df00dab1bd50bc7b5aad85cf56f4920176cc279fc5805635e033: Status 404 returned error can't find the container with id 97308b6c5bd9df00dab1bd50bc7b5aad85cf56f4920176cc279fc5805635e033 Jul 28 15:35:52.979822 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.979740 2554 generic.go:356] "Generic (PLEG): container finished" podID="82d8b984-38f0-407f-b48c-55a2b2b4ee5b" containerID="04d1ed38ec03e6c32aed5307597ec27ad25950ff4b9067821bdf3a656d476ac1" exitCode=0 Jul 28 15:35:52.979822 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.979805 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82d8b984-38f0-407f-b48c-55a2b2b4ee5b","Type":"ContainerDied","Data":"04d1ed38ec03e6c32aed5307597ec27ad25950ff4b9067821bdf3a656d476ac1"} Jul 28 15:35:52.980236 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:52.979854 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82d8b984-38f0-407f-b48c-55a2b2b4ee5b","Type":"ContainerStarted","Data":"97308b6c5bd9df00dab1bd50bc7b5aad85cf56f4920176cc279fc5805635e033"} Jul 28 15:35:53.077842 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:53.077813 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5de7079-5de5-499f-b4fe-b9bfeb55a529" path="/var/lib/kubelet/pods/d5de7079-5de5-499f-b4fe-b9bfeb55a529/volumes" Jul 28 15:35:53.986289 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:53.986242 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82d8b984-38f0-407f-b48c-55a2b2b4ee5b","Type":"ContainerStarted","Data":"a7d2a8c07bb6d643cb9586684a7c2f33ee705cfe2b83cee2a729ce8405678629"} Jul 28 15:35:53.986639 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:53.986357 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82d8b984-38f0-407f-b48c-55a2b2b4ee5b","Type":"ContainerStarted","Data":"975ab9e0170e6387eac56d159205b04b0209d03f4570c8b81cb9185454e86cd6"} Jul 28 15:35:53.986639 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:53.986401 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82d8b984-38f0-407f-b48c-55a2b2b4ee5b","Type":"ContainerStarted","Data":"0502da3faf26a71e42c056cc2d92d4a65d9611a74bb4033b07e7ed58b7052d1c"} Jul 28 15:35:53.986639 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:53.986439 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82d8b984-38f0-407f-b48c-55a2b2b4ee5b","Type":"ContainerStarted","Data":"8c2664bea0eba0e08d684ba7594fad3d1f9f48a44001dbcedd7c1d5c3db9dcaf"} Jul 28 15:35:53.986639 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:53.986474 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82d8b984-38f0-407f-b48c-55a2b2b4ee5b","Type":"ContainerStarted","Data":"ed341e47ee5c5d0d4c3ebf74e2f3319594a73ee7c53151f517d3968ba1387ca1"} Jul 28 15:35:53.986639 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:53.986508 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82d8b984-38f0-407f-b48c-55a2b2b4ee5b","Type":"ContainerStarted","Data":"656198cdd106779ba7dda32017045ac2860e476f9344d9346ac1004030f9f633"} Jul 28 15:35:54.018428 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:54.018318 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.999488522 podStartE2EDuration="2.018295296s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.806774ms" isStatefulPod=false podCreationTimestamp="2026-07-28 15:35:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:35:54.016839259 +0000 UTC m=+175.486339481" watchObservedRunningTime="2026-07-28 15:35:54.018295296 +0000 UTC m=+175.487795480" Jul 28 15:35:57.646529 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:35:57.646473 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:36:52.646498 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:36:52.646445 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:36:52.662414 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:36:52.662390 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:36:53.223499 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:36:53.223474 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:37:58.866968 ip-10-0-141-87 kubenswrapper[2554]: I0728 15:37:58.866941 2554 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 16:22:31.056617 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:22:31.056583 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ltclp/must-gather-8xqr4"] Jul 28 16:22:31.060326 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:22:31.060307 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ltclp/must-gather-8xqr4" Jul 28 16:22:31.063110 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:22:31.063090 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ltclp\"/\"default-dockercfg-4mq75\"" Jul 28 16:22:31.063569 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:22:31.063552 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ltclp\"/\"openshift-service-ca.crt\"" Jul 28 16:22:31.063569 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:22:31.063564 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ltclp\"/\"kube-root-ca.crt\"" Jul 28 16:22:31.078137 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:22:31.078114 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ltclp/must-gather-8xqr4"] Jul 28 16:22:31.224074 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:22:31.224040 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rmnd\" (UniqueName: \"kubernetes.io/projected/2168f7ba-b396-470f-8efd-bf312db0029a-kube-api-access-8rmnd\") pod \"must-gather-8xqr4\" (UID: \"2168f7ba-b396-470f-8efd-bf312db0029a\") " pod="openshift-must-gather-ltclp/must-gather-8xqr4" Jul 28 16:22:31.224263 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:22:31.224090 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2168f7ba-b396-470f-8efd-bf312db0029a-must-gather-output\") pod \"must-gather-8xqr4\" (UID: \"2168f7ba-b396-470f-8efd-bf312db0029a\") " pod="openshift-must-gather-ltclp/must-gather-8xqr4" Jul 28 16:22:31.325150 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:22:31.325064 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2168f7ba-b396-470f-8efd-bf312db0029a-must-gather-output\") pod \"must-gather-8xqr4\" (UID: \"2168f7ba-b396-470f-8efd-bf312db0029a\") " pod="openshift-must-gather-ltclp/must-gather-8xqr4" Jul 28 16:22:31.325150 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:22:31.325146 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rmnd\" (UniqueName: \"kubernetes.io/projected/2168f7ba-b396-470f-8efd-bf312db0029a-kube-api-access-8rmnd\") pod \"must-gather-8xqr4\" (UID: \"2168f7ba-b396-470f-8efd-bf312db0029a\") " pod="openshift-must-gather-ltclp/must-gather-8xqr4" Jul 28 16:22:31.325439 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:22:31.325420 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2168f7ba-b396-470f-8efd-bf312db0029a-must-gather-output\") pod \"must-gather-8xqr4\" (UID: \"2168f7ba-b396-470f-8efd-bf312db0029a\") " pod="openshift-must-gather-ltclp/must-gather-8xqr4" Jul 28 16:22:31.335622 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:22:31.335599 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rmnd\" (UniqueName: \"kubernetes.io/projected/2168f7ba-b396-470f-8efd-bf312db0029a-kube-api-access-8rmnd\") pod \"must-gather-8xqr4\" (UID: \"2168f7ba-b396-470f-8efd-bf312db0029a\") " pod="openshift-must-gather-ltclp/must-gather-8xqr4" Jul 28 16:22:31.369009 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:22:31.368983 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ltclp/must-gather-8xqr4" Jul 28 16:22:31.500720 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:22:31.500694 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ltclp/must-gather-8xqr4"] Jul 28 16:22:31.502549 ip-10-0-141-87 kubenswrapper[2554]: W0728 16:22:31.502522 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2168f7ba_b396_470f_8efd_bf312db0029a.slice/crio-4f0dddf551629a965a51c536ab43edb74f7e5c901b94bf1987619d14919e411a WatchSource:0}: Error finding container 4f0dddf551629a965a51c536ab43edb74f7e5c901b94bf1987619d14919e411a: Status 404 returned error can't find the container with id 4f0dddf551629a965a51c536ab43edb74f7e5c901b94bf1987619d14919e411a Jul 28 16:22:31.504236 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:22:31.504221 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 16:22:31.606753 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:22:31.606667 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ltclp/must-gather-8xqr4" event={"ID":"2168f7ba-b396-470f-8efd-bf312db0029a","Type":"ContainerStarted","Data":"4f0dddf551629a965a51c536ab43edb74f7e5c901b94bf1987619d14919e411a"} Jul 28 16:22:38.644664 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:22:38.644625 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ltclp/must-gather-8xqr4" event={"ID":"2168f7ba-b396-470f-8efd-bf312db0029a","Type":"ContainerStarted","Data":"3e261ffb78166e56df943e546aa94faee9037a401bcc6941846c9868c4e0b82b"} Jul 28 16:22:38.645073 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:22:38.644674 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ltclp/must-gather-8xqr4" event={"ID":"2168f7ba-b396-470f-8efd-bf312db0029a","Type":"ContainerStarted","Data":"52f6ac2f0a9219de30b62d8a9663108dda8f28dae99fe90b8d51e3f4afa13ea9"} Jul 28 16:22:38.667610 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:22:38.667555 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ltclp/must-gather-8xqr4" podStartSLOduration=1.484651472 podStartE2EDuration="7.667536677s" totalImagesPullingTime="6.182885205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:22:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:22:38.665619453 +0000 UTC m=+2980.135119631" watchObservedRunningTime="2026-07-28 16:22:38.667536677 +0000 UTC m=+2980.137036854" Jul 28 16:23:01.742758 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:01.742722 2554 generic.go:356] "Generic (PLEG): container finished" podID="2168f7ba-b396-470f-8efd-bf312db0029a" containerID="52f6ac2f0a9219de30b62d8a9663108dda8f28dae99fe90b8d51e3f4afa13ea9" exitCode=0 Jul 28 16:23:01.743225 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:01.742767 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ltclp/must-gather-8xqr4" event={"ID":"2168f7ba-b396-470f-8efd-bf312db0029a","Type":"ContainerDied","Data":"52f6ac2f0a9219de30b62d8a9663108dda8f28dae99fe90b8d51e3f4afa13ea9"} Jul 28 16:23:01.743225 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:01.743076 2554 scope.go:117] "RemoveContainer" containerID="52f6ac2f0a9219de30b62d8a9663108dda8f28dae99fe90b8d51e3f4afa13ea9" Jul 28 16:23:01.844919 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:01.844893 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ltclp_must-gather-8xqr4_2168f7ba-b396-470f-8efd-bf312db0029a/gather/0.log" Jul 28 16:23:05.148625 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:05.148601 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jmlvt_41a895b0-ed4d-49c9-802e-767b38b9a01e/global-pull-secret-syncer/0.log" Jul 28 16:23:05.240149 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:05.240117 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-66xhr_27e3bbf1-eb81-4916-8e33-9b587c452873/konnectivity-agent/0.log" Jul 28 16:23:05.332683 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:05.332651 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-87.ec2.internal_dea5fffc9bb3f82e40a6934aaee07e23/haproxy/0.log" Jul 28 16:23:07.320399 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:07.320369 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-ltclp/must-gather-8xqr4"] Jul 28 16:23:07.320878 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:07.320568 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-ltclp/must-gather-8xqr4" podUID="2168f7ba-b396-470f-8efd-bf312db0029a" containerName="copy" containerID="cri-o://3e261ffb78166e56df943e546aa94faee9037a401bcc6941846c9868c4e0b82b" gracePeriod=2 Jul 28 16:23:07.327735 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:07.327702 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-ltclp/must-gather-8xqr4"] Jul 28 16:23:07.550388 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:07.550365 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ltclp_must-gather-8xqr4_2168f7ba-b396-470f-8efd-bf312db0029a/copy/0.log" Jul 28 16:23:07.551846 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:07.551826 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ltclp/must-gather-8xqr4" Jul 28 16:23:07.554571 ip-10-0-141-87 kubenswrapper[2554]: E0728 16:23:07.554544 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-8xqr4\" is forbidden: User \"system:node:ip-10-0-141-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-ltclp\": no relationship found between node 'ip-10-0-141-87.ec2.internal' and this object" podUID="2168f7ba-b396-470f-8efd-bf312db0029a" pod="openshift-must-gather-ltclp/must-gather-8xqr4" Jul 28 16:23:07.649444 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:07.649361 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2168f7ba-b396-470f-8efd-bf312db0029a-must-gather-output\") pod \"2168f7ba-b396-470f-8efd-bf312db0029a\" (UID: \"2168f7ba-b396-470f-8efd-bf312db0029a\") " Jul 28 16:23:07.649444 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:07.649404 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rmnd\" (UniqueName: \"kubernetes.io/projected/2168f7ba-b396-470f-8efd-bf312db0029a-kube-api-access-8rmnd\") pod \"2168f7ba-b396-470f-8efd-bf312db0029a\" (UID: \"2168f7ba-b396-470f-8efd-bf312db0029a\") " Jul 28 16:23:07.650826 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:07.650795 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2168f7ba-b396-470f-8efd-bf312db0029a-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "2168f7ba-b396-470f-8efd-bf312db0029a" (UID: "2168f7ba-b396-470f-8efd-bf312db0029a"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 16:23:07.651690 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:07.651669 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2168f7ba-b396-470f-8efd-bf312db0029a-kube-api-access-8rmnd" (OuterVolumeSpecName: "kube-api-access-8rmnd") pod "2168f7ba-b396-470f-8efd-bf312db0029a" (UID: "2168f7ba-b396-470f-8efd-bf312db0029a"). InnerVolumeSpecName "kube-api-access-8rmnd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 16:23:07.750714 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:07.750677 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rmnd\" (UniqueName: \"kubernetes.io/projected/2168f7ba-b396-470f-8efd-bf312db0029a-kube-api-access-8rmnd\") on node \"ip-10-0-141-87.ec2.internal\" DevicePath \"\"" Jul 28 16:23:07.750714 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:07.750708 2554 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2168f7ba-b396-470f-8efd-bf312db0029a-must-gather-output\") on node \"ip-10-0-141-87.ec2.internal\" DevicePath \"\"" Jul 28 16:23:07.773101 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:07.773072 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ltclp_must-gather-8xqr4_2168f7ba-b396-470f-8efd-bf312db0029a/copy/0.log" Jul 28 16:23:07.773521 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:07.773500 2554 generic.go:356] "Generic (PLEG): container finished" podID="2168f7ba-b396-470f-8efd-bf312db0029a" containerID="3e261ffb78166e56df943e546aa94faee9037a401bcc6941846c9868c4e0b82b" exitCode=143 Jul 28 16:23:07.773580 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:07.773547 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ltclp/must-gather-8xqr4" Jul 28 16:23:07.773639 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:07.773603 2554 scope.go:117] "RemoveContainer" containerID="3e261ffb78166e56df943e546aa94faee9037a401bcc6941846c9868c4e0b82b" Jul 28 16:23:07.777016 ip-10-0-141-87 kubenswrapper[2554]: E0728 16:23:07.776980 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-8xqr4\" is forbidden: User \"system:node:ip-10-0-141-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-ltclp\": no relationship found between node 'ip-10-0-141-87.ec2.internal' and this object" podUID="2168f7ba-b396-470f-8efd-bf312db0029a" pod="openshift-must-gather-ltclp/must-gather-8xqr4" Jul 28 16:23:07.784390 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:07.784375 2554 scope.go:117] "RemoveContainer" containerID="52f6ac2f0a9219de30b62d8a9663108dda8f28dae99fe90b8d51e3f4afa13ea9" Jul 28 16:23:07.785013 ip-10-0-141-87 kubenswrapper[2554]: E0728 16:23:07.784988 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-8xqr4\" is forbidden: User \"system:node:ip-10-0-141-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-ltclp\": no relationship found between node 'ip-10-0-141-87.ec2.internal' and this object" podUID="2168f7ba-b396-470f-8efd-bf312db0029a" pod="openshift-must-gather-ltclp/must-gather-8xqr4" Jul 28 16:23:07.795204 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:07.795188 2554 scope.go:117] "RemoveContainer" containerID="3e261ffb78166e56df943e546aa94faee9037a401bcc6941846c9868c4e0b82b" Jul 28 16:23:07.795437 ip-10-0-141-87 kubenswrapper[2554]: E0728 16:23:07.795420 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e261ffb78166e56df943e546aa94faee9037a401bcc6941846c9868c4e0b82b\": container with ID starting with 3e261ffb78166e56df943e546aa94faee9037a401bcc6941846c9868c4e0b82b not found: ID does not exist" containerID="3e261ffb78166e56df943e546aa94faee9037a401bcc6941846c9868c4e0b82b" Jul 28 16:23:07.795493 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:07.795451 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e261ffb78166e56df943e546aa94faee9037a401bcc6941846c9868c4e0b82b"} err="failed to get container status \"3e261ffb78166e56df943e546aa94faee9037a401bcc6941846c9868c4e0b82b\": rpc error: code = NotFound desc = could not find container \"3e261ffb78166e56df943e546aa94faee9037a401bcc6941846c9868c4e0b82b\": container with ID starting with 3e261ffb78166e56df943e546aa94faee9037a401bcc6941846c9868c4e0b82b not found: ID does not exist" Jul 28 16:23:07.795493 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:07.795476 2554 scope.go:117] "RemoveContainer" containerID="52f6ac2f0a9219de30b62d8a9663108dda8f28dae99fe90b8d51e3f4afa13ea9" Jul 28 16:23:07.795717 ip-10-0-141-87 kubenswrapper[2554]: E0728 16:23:07.795699 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52f6ac2f0a9219de30b62d8a9663108dda8f28dae99fe90b8d51e3f4afa13ea9\": container with ID starting with 52f6ac2f0a9219de30b62d8a9663108dda8f28dae99fe90b8d51e3f4afa13ea9 not found: ID does not exist" containerID="52f6ac2f0a9219de30b62d8a9663108dda8f28dae99fe90b8d51e3f4afa13ea9" Jul 28 16:23:07.795768 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:07.795720 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52f6ac2f0a9219de30b62d8a9663108dda8f28dae99fe90b8d51e3f4afa13ea9"} err="failed to get container status \"52f6ac2f0a9219de30b62d8a9663108dda8f28dae99fe90b8d51e3f4afa13ea9\": rpc error: code = NotFound desc = could not find container \"52f6ac2f0a9219de30b62d8a9663108dda8f28dae99fe90b8d51e3f4afa13ea9\": container with ID starting with 52f6ac2f0a9219de30b62d8a9663108dda8f28dae99fe90b8d51e3f4afa13ea9 not found: ID does not exist" Jul 28 16:23:09.076868 ip-10-0-141-87 kubenswrapper[2554]: E0728 16:23:09.076830 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-8xqr4\" is forbidden: User \"system:node:ip-10-0-141-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-ltclp\": no relationship found between node 'ip-10-0-141-87.ec2.internal' and this object" podUID="2168f7ba-b396-470f-8efd-bf312db0029a" pod="openshift-must-gather-ltclp/must-gather-8xqr4" Jul 28 16:23:09.077263 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:09.077007 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2168f7ba-b396-470f-8efd-bf312db0029a" path="/var/lib/kubelet/pods/2168f7ba-b396-470f-8efd-bf312db0029a/volumes" Jul 28 16:23:10.201677 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:10.201646 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-mnjzv_6f154434-fcc0-4a8e-a19e-f87c6df93f13/cluster-monitoring-operator/0.log" Jul 28 16:23:10.256895 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:10.256868 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-r2r45_49036815-1fae-4750-b5d0-f25f8faf9b6e/kube-state-metrics/0.log" Jul 28 16:23:10.304448 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:10.304410 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-r2r45_49036815-1fae-4750-b5d0-f25f8faf9b6e/kube-rbac-proxy-main/0.log" Jul 28 16:23:10.346614 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:10.346587 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-r2r45_49036815-1fae-4750-b5d0-f25f8faf9b6e/kube-rbac-proxy-self/0.log" Jul 28 16:23:10.387974 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:10.387935 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-648fc6c747-sfs5s_5c60e9db-5f08-4b0f-ab5e-93a16cd0b0c1/metrics-server/0.log" Jul 28 16:23:10.524064 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:10.524039 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g77g8_e323d0e4-48e7-4ffc-904f-ad5158d52fc2/node-exporter/0.log" Jul 28 16:23:10.585852 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:10.585817 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g77g8_e323d0e4-48e7-4ffc-904f-ad5158d52fc2/kube-rbac-proxy/0.log" Jul 28 16:23:10.637686 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:10.637664 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g77g8_e323d0e4-48e7-4ffc-904f-ad5158d52fc2/init-textfile/0.log" Jul 28 16:23:11.018894 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:11.018865 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-92rv6_06f122a6-68d9-481e-a74a-236e1ada9e1b/kube-rbac-proxy-main/0.log" Jul 28 16:23:11.106825 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:11.106800 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-92rv6_06f122a6-68d9-481e-a74a-236e1ada9e1b/kube-rbac-proxy-self/0.log" Jul 28 16:23:11.218091 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:11.218062 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-92rv6_06f122a6-68d9-481e-a74a-236e1ada9e1b/openshift-state-metrics/0.log" Jul 28 16:23:11.365527 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:11.365447 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_82d8b984-38f0-407f-b48c-55a2b2b4ee5b/prometheus/0.log" Jul 28 16:23:11.445369 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:11.445338 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_82d8b984-38f0-407f-b48c-55a2b2b4ee5b/config-reloader/0.log" Jul 28 16:23:11.510426 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:11.510403 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_82d8b984-38f0-407f-b48c-55a2b2b4ee5b/thanos-sidecar/0.log" Jul 28 16:23:11.567690 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:11.567665 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_82d8b984-38f0-407f-b48c-55a2b2b4ee5b/kube-rbac-proxy-web/0.log" Jul 28 16:23:11.611208 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:11.611181 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_82d8b984-38f0-407f-b48c-55a2b2b4ee5b/kube-rbac-proxy/0.log" Jul 28 16:23:11.666207 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:11.666181 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_82d8b984-38f0-407f-b48c-55a2b2b4ee5b/kube-rbac-proxy-thanos/0.log" Jul 28 16:23:11.694772 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:11.694723 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_82d8b984-38f0-407f-b48c-55a2b2b4ee5b/init-config-reloader/0.log" Jul 28 16:23:12.909337 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:12.909303 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bns78/perf-node-gather-daemonset-bdtzm"] Jul 28 16:23:12.909727 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:12.909620 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2168f7ba-b396-470f-8efd-bf312db0029a" containerName="copy" Jul 28 16:23:12.909727 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:12.909631 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="2168f7ba-b396-470f-8efd-bf312db0029a" containerName="copy" Jul 28 16:23:12.909727 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:12.909643 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2168f7ba-b396-470f-8efd-bf312db0029a" containerName="gather" Jul 28 16:23:12.909727 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:12.909649 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="2168f7ba-b396-470f-8efd-bf312db0029a" containerName="gather" Jul 28 16:23:12.909727 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:12.909703 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="2168f7ba-b396-470f-8efd-bf312db0029a" containerName="copy" Jul 28 16:23:12.909727 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:12.909714 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="2168f7ba-b396-470f-8efd-bf312db0029a" containerName="gather" Jul 28 16:23:12.913034 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:12.913015 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bns78/perf-node-gather-daemonset-bdtzm" Jul 28 16:23:12.916839 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:12.916815 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bns78\"/\"kube-root-ca.crt\"" Jul 28 16:23:12.917497 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:12.917483 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bns78\"/\"openshift-service-ca.crt\"" Jul 28 16:23:12.917552 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:12.917494 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bns78\"/\"default-dockercfg-rvrtl\"" Jul 28 16:23:12.933181 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:12.933139 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bns78/perf-node-gather-daemonset-bdtzm"] Jul 28 16:23:12.994709 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:12.994680 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/70b127a8-c288-469c-aeb7-e20c66d2c7f2-proc\") pod \"perf-node-gather-daemonset-bdtzm\" (UID: \"70b127a8-c288-469c-aeb7-e20c66d2c7f2\") " pod="openshift-must-gather-bns78/perf-node-gather-daemonset-bdtzm" Jul 28 16:23:12.994873 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:12.994721 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/70b127a8-c288-469c-aeb7-e20c66d2c7f2-lib-modules\") pod \"perf-node-gather-daemonset-bdtzm\" (UID: \"70b127a8-c288-469c-aeb7-e20c66d2c7f2\") " pod="openshift-must-gather-bns78/perf-node-gather-daemonset-bdtzm" Jul 28 16:23:12.994873 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:12.994762 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js6db\" (UniqueName: \"kubernetes.io/projected/70b127a8-c288-469c-aeb7-e20c66d2c7f2-kube-api-access-js6db\") pod \"perf-node-gather-daemonset-bdtzm\" (UID: \"70b127a8-c288-469c-aeb7-e20c66d2c7f2\") " pod="openshift-must-gather-bns78/perf-node-gather-daemonset-bdtzm" Jul 28 16:23:12.994873 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:12.994796 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70b127a8-c288-469c-aeb7-e20c66d2c7f2-sys\") pod \"perf-node-gather-daemonset-bdtzm\" (UID: \"70b127a8-c288-469c-aeb7-e20c66d2c7f2\") " pod="openshift-must-gather-bns78/perf-node-gather-daemonset-bdtzm" Jul 28 16:23:12.994873 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:12.994822 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/70b127a8-c288-469c-aeb7-e20c66d2c7f2-podres\") pod \"perf-node-gather-daemonset-bdtzm\" (UID: \"70b127a8-c288-469c-aeb7-e20c66d2c7f2\") " pod="openshift-must-gather-bns78/perf-node-gather-daemonset-bdtzm" Jul 28 16:23:13.096264 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:13.096235 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/70b127a8-c288-469c-aeb7-e20c66d2c7f2-podres\") pod \"perf-node-gather-daemonset-bdtzm\" (UID: \"70b127a8-c288-469c-aeb7-e20c66d2c7f2\") " pod="openshift-must-gather-bns78/perf-node-gather-daemonset-bdtzm" Jul 28 16:23:13.096439 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:13.096285 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/70b127a8-c288-469c-aeb7-e20c66d2c7f2-proc\") pod \"perf-node-gather-daemonset-bdtzm\" (UID: \"70b127a8-c288-469c-aeb7-e20c66d2c7f2\") " pod="openshift-must-gather-bns78/perf-node-gather-daemonset-bdtzm" Jul 28 16:23:13.096439 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:13.096313 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/70b127a8-c288-469c-aeb7-e20c66d2c7f2-lib-modules\") pod \"perf-node-gather-daemonset-bdtzm\" (UID: \"70b127a8-c288-469c-aeb7-e20c66d2c7f2\") " pod="openshift-must-gather-bns78/perf-node-gather-daemonset-bdtzm" Jul 28 16:23:13.096439 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:13.096341 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js6db\" (UniqueName: \"kubernetes.io/projected/70b127a8-c288-469c-aeb7-e20c66d2c7f2-kube-api-access-js6db\") pod \"perf-node-gather-daemonset-bdtzm\" (UID: \"70b127a8-c288-469c-aeb7-e20c66d2c7f2\") " pod="openshift-must-gather-bns78/perf-node-gather-daemonset-bdtzm" Jul 28 16:23:13.096439 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:13.096380 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70b127a8-c288-469c-aeb7-e20c66d2c7f2-sys\") pod \"perf-node-gather-daemonset-bdtzm\" (UID: \"70b127a8-c288-469c-aeb7-e20c66d2c7f2\") " pod="openshift-must-gather-bns78/perf-node-gather-daemonset-bdtzm" Jul 28 16:23:13.096439 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:13.096386 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/70b127a8-c288-469c-aeb7-e20c66d2c7f2-podres\") pod \"perf-node-gather-daemonset-bdtzm\" (UID: \"70b127a8-c288-469c-aeb7-e20c66d2c7f2\") " pod="openshift-must-gather-bns78/perf-node-gather-daemonset-bdtzm" Jul 28 16:23:13.096439 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:13.096423 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/70b127a8-c288-469c-aeb7-e20c66d2c7f2-proc\") pod \"perf-node-gather-daemonset-bdtzm\" (UID: \"70b127a8-c288-469c-aeb7-e20c66d2c7f2\") " pod="openshift-must-gather-bns78/perf-node-gather-daemonset-bdtzm" Jul 28 16:23:13.096678 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:13.096475 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70b127a8-c288-469c-aeb7-e20c66d2c7f2-sys\") pod \"perf-node-gather-daemonset-bdtzm\" (UID: \"70b127a8-c288-469c-aeb7-e20c66d2c7f2\") " pod="openshift-must-gather-bns78/perf-node-gather-daemonset-bdtzm" Jul 28 16:23:13.096678 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:13.096489 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/70b127a8-c288-469c-aeb7-e20c66d2c7f2-lib-modules\") pod \"perf-node-gather-daemonset-bdtzm\" (UID: \"70b127a8-c288-469c-aeb7-e20c66d2c7f2\") " pod="openshift-must-gather-bns78/perf-node-gather-daemonset-bdtzm" Jul 28 16:23:13.110460 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:13.110433 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-js6db\" (UniqueName: \"kubernetes.io/projected/70b127a8-c288-469c-aeb7-e20c66d2c7f2-kube-api-access-js6db\") pod \"perf-node-gather-daemonset-bdtzm\" (UID: \"70b127a8-c288-469c-aeb7-e20c66d2c7f2\") " pod="openshift-must-gather-bns78/perf-node-gather-daemonset-bdtzm" Jul 28 16:23:13.221826 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:13.221735 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bns78/perf-node-gather-daemonset-bdtzm" Jul 28 16:23:13.377298 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:13.377267 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bns78/perf-node-gather-daemonset-bdtzm"] Jul 28 16:23:13.380917 ip-10-0-141-87 kubenswrapper[2554]: W0728 16:23:13.380888 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod70b127a8_c288_469c_aeb7_e20c66d2c7f2.slice/crio-860d3cf0707c73c49f9c697e734d2c812f8a0acc8aceba9aaa8bc040041ba904 WatchSource:0}: Error finding container 860d3cf0707c73c49f9c697e734d2c812f8a0acc8aceba9aaa8bc040041ba904: Status 404 returned error can't find the container with id 860d3cf0707c73c49f9c697e734d2c812f8a0acc8aceba9aaa8bc040041ba904 Jul 28 16:23:13.799059 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:13.799022 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bns78/perf-node-gather-daemonset-bdtzm" event={"ID":"70b127a8-c288-469c-aeb7-e20c66d2c7f2","Type":"ContainerStarted","Data":"c29ae1d966d9f6c02e47ef69a8fb98a662bb68457f3cf33ce6fb9e05476111fd"} Jul 28 16:23:13.799246 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:13.799081 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bns78/perf-node-gather-daemonset-bdtzm" event={"ID":"70b127a8-c288-469c-aeb7-e20c66d2c7f2","Type":"ContainerStarted","Data":"860d3cf0707c73c49f9c697e734d2c812f8a0acc8aceba9aaa8bc040041ba904"} Jul 28 16:23:13.799246 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:13.799130 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bns78/perf-node-gather-daemonset-bdtzm" Jul 28 16:23:13.831584 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:13.831536 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bns78/perf-node-gather-daemonset-bdtzm" podStartSLOduration=1.8315199199999999 podStartE2EDuration="1.83151992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:23:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:23:13.829308885 +0000 UTC m=+3015.298809076" watchObservedRunningTime="2026-07-28 16:23:13.83151992 +0000 UTC m=+3015.301020164" Jul 28 16:23:14.833235 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:14.833209 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-b488j_71855b26-90b6-4583-80d8-adeb3099e54b/download-server/0.log" Jul 28 16:23:16.333181 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:16.333142 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wspq5_d0f0bc3e-2d43-4c70-a2b7-ffaea1280559/dns/0.log" Jul 28 16:23:16.357695 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:16.357673 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wspq5_d0f0bc3e-2d43-4c70-a2b7-ffaea1280559/kube-rbac-proxy/0.log" Jul 28 16:23:16.415951 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:16.415928 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jr9vs_5c47c65a-9647-4f2e-a2c4-141989020177/dns-node-resolver/0.log" Jul 28 16:23:16.895890 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:16.895861 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-54f75948cb-56nh8_e2852183-1514-4902-8fc4-8534e5be285b/registry/0.log" Jul 28 16:23:16.917894 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:16.917867 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-49c8p_3584627f-0efc-4d20-bac4-72b209a1f45a/node-ca/0.log" Jul 28 16:23:18.262470 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:18.262422 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bgwn5_b19ceeb0-ef66-415a-b0b3-13b64286b776/serve-healthcheck-canary/0.log" Jul 28 16:23:18.945624 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:18.945600 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zl8kx_8b205f56-5230-402a-8d99-e8f21735c842/kube-rbac-proxy/0.log" Jul 28 16:23:18.967441 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:18.967413 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zl8kx_8b205f56-5230-402a-8d99-e8f21735c842/exporter/0.log" Jul 28 16:23:18.991119 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:18.991091 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zl8kx_8b205f56-5230-402a-8d99-e8f21735c842/extractor/0.log" Jul 28 16:23:19.812815 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:19.812789 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bns78/perf-node-gather-daemonset-bdtzm" Jul 28 16:23:26.387390 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:26.387359 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-q58m6_514abdf8-4584-45d3-a3db-01d88aff6269/migrator/0.log" Jul 28 16:23:26.416803 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:26.416778 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-q58m6_514abdf8-4584-45d3-a3db-01d88aff6269/graceful-termination/0.log" Jul 28 16:23:26.880368 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:26.880330 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-8d4wr_bd673619-a13c-46ec-9b3b-11a7701e7153/kube-storage-version-migrator-operator/1.log" Jul 28 16:23:26.880946 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:26.880929 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-8d4wr_bd673619-a13c-46ec-9b3b-11a7701e7153/kube-storage-version-migrator-operator/0.log" Jul 28 16:23:28.354697 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:28.354657 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xlgxx_5370e1cf-6ffa-48d1-ad1a-ad070a80d79d/kube-multus-additional-cni-plugins/0.log" Jul 28 16:23:28.377941 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:28.377916 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xlgxx_5370e1cf-6ffa-48d1-ad1a-ad070a80d79d/egress-router-binary-copy/0.log" Jul 28 16:23:28.402199 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:28.402160 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xlgxx_5370e1cf-6ffa-48d1-ad1a-ad070a80d79d/cni-plugins/0.log" Jul 28 16:23:28.431910 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:28.431885 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xlgxx_5370e1cf-6ffa-48d1-ad1a-ad070a80d79d/bond-cni-plugin/0.log" Jul 28 16:23:28.468685 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:28.468659 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xlgxx_5370e1cf-6ffa-48d1-ad1a-ad070a80d79d/routeoverride-cni/0.log" Jul 28 16:23:28.500820 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:28.500793 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xlgxx_5370e1cf-6ffa-48d1-ad1a-ad070a80d79d/whereabouts-cni-bincopy/0.log" Jul 28 16:23:28.543377 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:28.543355 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xlgxx_5370e1cf-6ffa-48d1-ad1a-ad070a80d79d/whereabouts-cni/0.log" Jul 28 16:23:28.593564 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:28.593531 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mrjkp_a1414205-e81a-49a1-8844-b184d7df7e1e/kube-multus/0.log" Jul 28 16:23:28.923496 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:28.923414 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zrk89_f5be64c0-1028-484f-8ee1-fe1de8d758f2/network-metrics-daemon/0.log" Jul 28 16:23:28.965808 ip-10-0-141-87 kubenswrapper[2554]: I0728 16:23:28.965785 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zrk89_f5be64c0-1028-484f-8ee1-fe1de8d758f2/kube-rbac-proxy/0.log"