Sep 16 19:38:44.792384 ip-10-0-128-18 systemd[1]: Starting Kubernetes Kubelet... Sep 16 19:38:45.215749 ip-10-0-128-18 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 16 19:38:45.215749 ip-10-0-128-18 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 16 19:38:45.215749 ip-10-0-128-18 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 16 19:38:45.215749 ip-10-0-128-18 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 16 19:38:45.215749 ip-10-0-128-18 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 16 19:38:45.216951 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.216871 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 16 19:38:45.233662 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233634 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 19:38:45.233662 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233652 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 19:38:45.233662 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233657 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 19:38:45.233662 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233661 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 19:38:45.233662 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233665 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 19:38:45.233662 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233669 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 19:38:45.233990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233675 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 19:38:45.233990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233679 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 19:38:45.233990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233683 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 19:38:45.233990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233687 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 19:38:45.233990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233690 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 19:38:45.233990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233694 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 19:38:45.233990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233697 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 19:38:45.233990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233700 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 19:38:45.233990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233705 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 19:38:45.233990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233709 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 19:38:45.233990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233713 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 19:38:45.233990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233716 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 19:38:45.233990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233720 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 19:38:45.233990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233724 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 19:38:45.233990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233727 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 19:38:45.233990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233731 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 19:38:45.233990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233735 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 16 19:38:45.233990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233738 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 19:38:45.233990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233742 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 19:38:45.233990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233746 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 19:38:45.234647 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233750 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 19:38:45.234647 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233756 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 19:38:45.234647 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233762 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 19:38:45.234647 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233766 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 19:38:45.234647 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233770 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 19:38:45.234647 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233773 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 19:38:45.234647 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233778 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 19:38:45.234647 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233782 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 19:38:45.234647 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233786 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 19:38:45.234647 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233790 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 19:38:45.234647 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233794 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 19:38:45.234647 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233798 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 19:38:45.234647 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233802 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 19:38:45.234647 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233807 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 19:38:45.234647 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233812 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 19:38:45.234647 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233816 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 19:38:45.234647 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233820 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 19:38:45.234647 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233824 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 19:38:45.234647 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233828 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 19:38:45.235131 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233832 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 19:38:45.235131 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233837 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 19:38:45.235131 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233841 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 19:38:45.235131 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233845 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 19:38:45.235131 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233849 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 19:38:45.235131 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233854 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 19:38:45.235131 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233858 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 19:38:45.235131 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233862 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 19:38:45.235131 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233866 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 19:38:45.235131 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233870 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 19:38:45.235131 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233875 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 19:38:45.235131 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233879 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 19:38:45.235131 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233883 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 19:38:45.235131 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233889 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 19:38:45.235131 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233893 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 19:38:45.235131 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233897 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 19:38:45.235131 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233901 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 19:38:45.235131 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233906 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 19:38:45.235131 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233910 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 19:38:45.235131 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233914 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 19:38:45.235892 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233918 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 19:38:45.235892 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233922 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 19:38:45.235892 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233926 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 19:38:45.235892 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233930 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 19:38:45.235892 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233934 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 19:38:45.235892 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233938 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 19:38:45.235892 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233944 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 19:38:45.235892 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233949 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 19:38:45.235892 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233953 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 19:38:45.235892 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233957 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 19:38:45.235892 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233964 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 19:38:45.235892 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233972 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 19:38:45.235892 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233976 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 19:38:45.235892 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233984 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 19:38:45.235892 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233988 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 19:38:45.235892 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233993 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 19:38:45.235892 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.233997 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 19:38:45.235892 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.234001 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 19:38:45.235892 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.234012 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 19:38:45.235892 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.234016 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 19:38:45.236765 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.234021 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 19:38:45.236765 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.234025 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 19:38:45.236765 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.234029 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 19:38:45.236765 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.234033 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 19:38:45.236765 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.234037 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 19:38:45.236765 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.234042 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 19:38:45.236765 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.234046 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 19:38:45.236765 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.234050 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 19:38:45.236765 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.234054 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 19:38:45.236765 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.234058 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 19:38:45.236765 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.234065 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 19:38:45.236765 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.234070 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 19:38:45.236765 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.234075 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 19:38:45.236765 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.234080 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 19:38:45.236765 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236268 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 19:38:45.236765 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236280 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 19:38:45.236765 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236285 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 19:38:45.236765 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236289 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 19:38:45.236765 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236293 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 19:38:45.236765 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236297 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 19:38:45.237609 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236301 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 19:38:45.237609 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236305 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 19:38:45.237609 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236309 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 19:38:45.237609 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236313 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 19:38:45.237609 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236318 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 19:38:45.237609 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236322 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 19:38:45.237609 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236326 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 19:38:45.237609 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236332 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 19:38:45.237609 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236337 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 19:38:45.237609 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236341 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 19:38:45.237609 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236349 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 19:38:45.237609 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236356 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 19:38:45.237609 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236362 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 19:38:45.237609 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236370 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 19:38:45.237609 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236375 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 19:38:45.237609 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236380 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 19:38:45.237609 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236385 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 19:38:45.237609 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236389 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 19:38:45.238423 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236401 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 19:38:45.238423 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236405 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 19:38:45.238423 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236410 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 19:38:45.238423 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236414 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 19:38:45.238423 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236418 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 19:38:45.238423 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236422 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 19:38:45.238423 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236426 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 19:38:45.238423 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236430 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 19:38:45.238423 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236434 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 19:38:45.238423 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236438 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 19:38:45.238423 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236442 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 19:38:45.238423 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236456 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 19:38:45.238423 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236460 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 19:38:45.238423 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236464 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 19:38:45.238423 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236468 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 19:38:45.238423 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236472 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 19:38:45.238423 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236476 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 19:38:45.238423 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236480 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 19:38:45.238423 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236485 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 19:38:45.238423 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236489 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 19:38:45.239320 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236493 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 19:38:45.239320 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236497 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 19:38:45.239320 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236501 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 19:38:45.239320 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236506 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 19:38:45.239320 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236510 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 19:38:45.239320 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236514 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 19:38:45.239320 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236519 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 19:38:45.239320 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236524 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 19:38:45.239320 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236529 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 19:38:45.239320 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236533 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 19:38:45.239320 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236537 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 19:38:45.239320 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236541 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 19:38:45.239320 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236545 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 19:38:45.239320 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236549 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 19:38:45.239320 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236554 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 19:38:45.239320 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236558 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 19:38:45.239320 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236562 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 19:38:45.239320 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236566 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 19:38:45.239320 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236570 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 19:38:45.239320 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236574 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 16 19:38:45.239871 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236579 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 19:38:45.239871 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236583 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 19:38:45.239871 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236587 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 19:38:45.239871 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236591 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 19:38:45.239871 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236595 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 19:38:45.239871 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236600 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 19:38:45.239871 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236604 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 19:38:45.239871 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236608 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 19:38:45.239871 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236612 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 19:38:45.239871 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236616 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 19:38:45.239871 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236621 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 19:38:45.239871 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236626 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 19:38:45.239871 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236630 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 19:38:45.239871 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236634 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 19:38:45.239871 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236638 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 19:38:45.239871 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236642 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 19:38:45.239871 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236646 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 19:38:45.239871 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236650 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 19:38:45.239871 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236655 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 19:38:45.239871 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236659 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 19:38:45.240468 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236664 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 19:38:45.240468 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236669 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 19:38:45.240468 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236673 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 19:38:45.240468 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236677 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 19:38:45.240468 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236681 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 19:38:45.240468 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236686 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 19:38:45.240468 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236691 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 19:38:45.240468 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236695 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 19:38:45.240468 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236700 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 19:38:45.240468 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236704 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 19:38:45.240468 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236708 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 19:38:45.240468 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236712 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 19:38:45.240468 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236716 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 19:38:45.240468 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236720 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 19:38:45.240468 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.236725 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 19:38:45.240468 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237365 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 19:38:45.240468 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237375 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 19:38:45.240468 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237381 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 19:38:45.240468 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237386 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 19:38:45.240953 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237390 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 19:38:45.240953 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237395 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 19:38:45.240953 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237400 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 19:38:45.240953 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237404 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 19:38:45.240953 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237409 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 19:38:45.240953 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237413 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 19:38:45.240953 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237418 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 19:38:45.240953 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237422 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 19:38:45.240953 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237426 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 19:38:45.240953 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237430 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 19:38:45.240953 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237435 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 19:38:45.240953 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237439 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 19:38:45.240953 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237443 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 19:38:45.240953 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237448 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 19:38:45.240953 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237452 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 19:38:45.240953 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237456 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 19:38:45.240953 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237460 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 16 19:38:45.240953 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237464 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 19:38:45.240953 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237468 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 19:38:45.240953 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237474 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 19:38:45.241490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237478 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 19:38:45.241490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237482 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 19:38:45.241490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237486 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 19:38:45.241490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237490 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 19:38:45.241490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237494 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 19:38:45.241490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237498 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 19:38:45.241490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237503 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 19:38:45.241490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237507 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 19:38:45.241490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237511 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 19:38:45.241490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237515 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 19:38:45.241490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237519 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 19:38:45.241490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237523 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 19:38:45.241490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237529 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 19:38:45.241490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237535 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 19:38:45.241490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237539 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 19:38:45.241490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237544 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 19:38:45.241490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237548 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 19:38:45.241490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237552 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 19:38:45.241490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237556 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 19:38:45.241490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237561 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 19:38:45.242096 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237565 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 19:38:45.242096 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237569 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 19:38:45.242096 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237573 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 19:38:45.242096 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237577 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 19:38:45.242096 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237582 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 19:38:45.242096 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237587 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 19:38:45.242096 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237592 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 19:38:45.242096 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237596 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 19:38:45.242096 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237600 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 19:38:45.242096 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237604 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 19:38:45.242096 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237607 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 19:38:45.242096 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237612 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 19:38:45.242096 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237618 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 19:38:45.242096 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237624 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 19:38:45.242096 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237629 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 19:38:45.242096 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237634 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 19:38:45.242096 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237639 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 19:38:45.242096 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237644 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 19:38:45.242096 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237648 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 19:38:45.242698 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237652 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 19:38:45.242698 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237657 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 19:38:45.242698 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237661 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 19:38:45.242698 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237665 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 19:38:45.242698 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237669 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 19:38:45.242698 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237673 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 19:38:45.242698 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237677 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 19:38:45.242698 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237681 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 19:38:45.242698 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237685 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 19:38:45.242698 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237690 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 19:38:45.242698 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237694 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 19:38:45.242698 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237698 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 19:38:45.242698 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237703 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 19:38:45.242698 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237710 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 19:38:45.242698 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237714 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 19:38:45.242698 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237718 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 19:38:45.242698 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237722 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 19:38:45.242698 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237726 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 19:38:45.242698 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237731 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 19:38:45.242698 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237744 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 19:38:45.243233 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237748 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 19:38:45.243233 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237752 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 19:38:45.243233 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237757 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 19:38:45.243233 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237763 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 19:38:45.243233 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237769 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 19:38:45.243233 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237774 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 19:38:45.243233 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237778 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 19:38:45.243233 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237782 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 19:38:45.243233 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237786 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 19:38:45.243233 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237790 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 19:38:45.243233 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237794 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 19:38:45.243233 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237798 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 19:38:45.243233 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237802 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 19:38:45.243233 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237807 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 19:38:45.243233 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237810 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 19:38:45.243233 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.237814 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 19:38:45.243233 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.237914 2577 flags.go:64] FLAG: --address="0.0.0.0" Sep 16 19:38:45.243233 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.237965 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 16 19:38:45.243233 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.237978 2577 flags.go:64] FLAG: --anonymous-auth="true" Sep 16 19:38:45.243233 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.237985 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 16 19:38:45.243908 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.237992 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 16 19:38:45.243908 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.237997 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 16 19:38:45.243908 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238003 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 16 19:38:45.243908 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238010 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 16 19:38:45.243908 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238014 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 16 19:38:45.243908 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238019 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 16 19:38:45.243908 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238024 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 16 19:38:45.243908 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238029 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 16 19:38:45.243908 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238034 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 16 19:38:45.243908 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238039 2577 flags.go:64] FLAG: --cgroup-root="" Sep 16 19:38:45.243908 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238043 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 16 19:38:45.243908 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238047 2577 flags.go:64] FLAG: --client-ca-file="" Sep 16 19:38:45.243908 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238060 2577 flags.go:64] FLAG: --cloud-provider="external" Sep 16 19:38:45.243908 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238065 2577 flags.go:64] FLAG: --cluster-dns="[]" Sep 16 19:38:45.243908 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238074 2577 flags.go:64] FLAG: --cluster-domain="" Sep 16 19:38:45.243908 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238079 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 16 19:38:45.243908 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238084 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 16 19:38:45.243908 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238089 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 16 19:38:45.243908 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238095 2577 flags.go:64] FLAG: --container-log-max-files="5" Sep 16 19:38:45.243908 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238101 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 16 19:38:45.243908 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238123 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 16 19:38:45.243908 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238129 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 16 19:38:45.243908 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238134 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 16 19:38:45.244552 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238138 2577 flags.go:64] FLAG: --contention-profiling="false" Sep 16 19:38:45.244552 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238142 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 16 19:38:45.244552 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238147 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 16 19:38:45.244552 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238152 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 16 19:38:45.244552 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238156 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 16 19:38:45.244552 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238162 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 16 19:38:45.244552 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238167 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 16 19:38:45.244552 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238172 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 16 19:38:45.244552 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238176 2577 flags.go:64] FLAG: --enable-load-reader="false" Sep 16 19:38:45.244552 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238181 2577 flags.go:64] FLAG: --enable-server="true" Sep 16 19:38:45.244552 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238186 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 16 19:38:45.244552 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238200 2577 flags.go:64] FLAG: --event-burst="100" Sep 16 19:38:45.244552 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238205 2577 flags.go:64] FLAG: --event-qps="50" Sep 16 19:38:45.244552 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238210 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 16 19:38:45.244552 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238214 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 16 19:38:45.244552 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238219 2577 flags.go:64] FLAG: --eviction-hard="" Sep 16 19:38:45.244552 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238225 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 16 19:38:45.244552 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238229 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 16 19:38:45.244552 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238234 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 16 19:38:45.244552 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238239 2577 flags.go:64] FLAG: --eviction-soft="" Sep 16 19:38:45.244552 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238244 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 16 19:38:45.244552 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238249 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 16 19:38:45.244552 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238255 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 16 19:38:45.244552 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238260 2577 flags.go:64] FLAG: --experimental-mounter-path="" Sep 16 19:38:45.244552 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238264 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 16 19:38:45.245211 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238269 2577 flags.go:64] FLAG: --fail-swap-on="true" Sep 16 19:38:45.245211 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238274 2577 flags.go:64] FLAG: --feature-gates="" Sep 16 19:38:45.245211 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238279 2577 flags.go:64] FLAG: --file-check-frequency="20s" Sep 16 19:38:45.245211 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238284 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 16 19:38:45.245211 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238289 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 16 19:38:45.245211 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238294 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 16 19:38:45.245211 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238299 2577 flags.go:64] FLAG: --healthz-port="10248" Sep 16 19:38:45.245211 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238303 2577 flags.go:64] FLAG: --help="false" Sep 16 19:38:45.245211 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238308 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-128-18.ec2.internal" Sep 16 19:38:45.245211 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238313 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 16 19:38:45.245211 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238318 2577 flags.go:64] FLAG: --http-check-frequency="20s" Sep 16 19:38:45.245211 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238323 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 16 19:38:45.245211 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238328 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 16 19:38:45.245211 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238334 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 16 19:38:45.245211 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238338 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 16 19:38:45.245211 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238342 2577 flags.go:64] FLAG: --image-service-endpoint="" Sep 16 19:38:45.245211 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238352 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 16 19:38:45.245211 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238357 2577 flags.go:64] FLAG: --kube-api-burst="100" Sep 16 19:38:45.245211 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238361 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 16 19:38:45.245211 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238366 2577 flags.go:64] FLAG: --kube-api-qps="50" Sep 16 19:38:45.245211 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238371 2577 flags.go:64] FLAG: --kube-reserved="" Sep 16 19:38:45.245211 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238376 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 16 19:38:45.245211 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238380 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 16 19:38:45.245211 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238385 2577 flags.go:64] FLAG: --kubelet-cgroups="" Sep 16 19:38:45.245796 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238389 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 16 19:38:45.245796 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238394 2577 flags.go:64] FLAG: --lock-file="" Sep 16 19:38:45.245796 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238398 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 16 19:38:45.245796 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238403 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 16 19:38:45.245796 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238408 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 16 19:38:45.245796 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238416 2577 flags.go:64] FLAG: --log-json-split-stream="false" Sep 16 19:38:45.245796 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238422 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 16 19:38:45.245796 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238426 2577 flags.go:64] FLAG: --log-text-split-stream="false" Sep 16 19:38:45.245796 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238430 2577 flags.go:64] FLAG: --logging-format="text" Sep 16 19:38:45.245796 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238435 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 16 19:38:45.245796 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238439 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 16 19:38:45.245796 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238443 2577 flags.go:64] FLAG: --manifest-url="" Sep 16 19:38:45.245796 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238448 2577 flags.go:64] FLAG: --manifest-url-header="" Sep 16 19:38:45.245796 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238455 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 16 19:38:45.245796 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238460 2577 flags.go:64] FLAG: --max-open-files="1000000" Sep 16 19:38:45.245796 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238467 2577 flags.go:64] FLAG: --max-pods="110" Sep 16 19:38:45.245796 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238472 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 16 19:38:45.245796 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238476 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 16 19:38:45.245796 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238481 2577 flags.go:64] FLAG: --memory-manager-policy="None" Sep 16 19:38:45.245796 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238485 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 16 19:38:45.245796 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238490 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 16 19:38:45.245796 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238495 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 16 19:38:45.245796 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238500 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 16 19:38:45.245796 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238510 2577 flags.go:64] FLAG: --node-status-max-images="50" Sep 16 19:38:45.245796 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238517 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 16 19:38:45.246431 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238522 2577 flags.go:64] FLAG: --oom-score-adj="-999" Sep 16 19:38:45.246431 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238527 2577 flags.go:64] FLAG: --pod-cidr="" Sep 16 19:38:45.246431 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238531 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 16 19:38:45.246431 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238539 2577 flags.go:64] FLAG: --pod-manifest-path="" Sep 16 19:38:45.246431 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238543 2577 flags.go:64] FLAG: --pod-max-pids="-1" Sep 16 19:38:45.246431 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238548 2577 flags.go:64] FLAG: --pods-per-core="0" Sep 16 19:38:45.246431 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238553 2577 flags.go:64] FLAG: --port="10250" Sep 16 19:38:45.246431 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238557 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 16 19:38:45.246431 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238563 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-042a94708d2b46edb" Sep 16 19:38:45.246431 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238568 2577 flags.go:64] FLAG: --qos-reserved="" Sep 16 19:38:45.246431 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238573 2577 flags.go:64] FLAG: --read-only-port="10255" Sep 16 19:38:45.246431 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238577 2577 flags.go:64] FLAG: --register-node="true" Sep 16 19:38:45.246431 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238582 2577 flags.go:64] FLAG: --register-with-taints="" Sep 16 19:38:45.246431 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238590 2577 flags.go:64] FLAG: --registry-burst="10" Sep 16 19:38:45.246431 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238595 2577 flags.go:64] FLAG: --registry-qps="5" Sep 16 19:38:45.246431 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238600 2577 flags.go:64] FLAG: --reserved-cpus="" Sep 16 19:38:45.246431 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238604 2577 flags.go:64] FLAG: --reserved-memory="" Sep 16 19:38:45.246431 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238610 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 16 19:38:45.246431 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238615 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 16 19:38:45.246431 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238619 2577 flags.go:64] FLAG: --rotate-certificates="false" Sep 16 19:38:45.246431 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238624 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 16 19:38:45.246431 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238629 2577 flags.go:64] FLAG: --runonce="false" Sep 16 19:38:45.246431 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238633 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 16 19:38:45.246431 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238638 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 16 19:38:45.246431 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238642 2577 flags.go:64] FLAG: --seccomp-default="false" Sep 16 19:38:45.247152 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238647 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 16 19:38:45.247152 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238652 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 16 19:38:45.247152 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238656 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 16 19:38:45.247152 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238661 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 16 19:38:45.247152 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238665 2577 flags.go:64] FLAG: --storage-driver-password="root" Sep 16 19:38:45.247152 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238671 2577 flags.go:64] FLAG: --storage-driver-secure="false" Sep 16 19:38:45.247152 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238675 2577 flags.go:64] FLAG: --storage-driver-table="stats" Sep 16 19:38:45.247152 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238681 2577 flags.go:64] FLAG: --storage-driver-user="root" Sep 16 19:38:45.247152 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238686 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 16 19:38:45.247152 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238690 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 16 19:38:45.247152 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238695 2577 flags.go:64] FLAG: --system-cgroups="" Sep 16 19:38:45.247152 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238700 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 16 19:38:45.247152 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238708 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 16 19:38:45.247152 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238713 2577 flags.go:64] FLAG: --tls-cert-file="" Sep 16 19:38:45.247152 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238717 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 16 19:38:45.247152 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238726 2577 flags.go:64] FLAG: --tls-min-version="" Sep 16 19:38:45.247152 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238732 2577 flags.go:64] FLAG: --tls-private-key-file="" Sep 16 19:38:45.247152 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238736 2577 flags.go:64] FLAG: --topology-manager-policy="none" Sep 16 19:38:45.247152 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238740 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 16 19:38:45.247152 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238746 2577 flags.go:64] FLAG: --topology-manager-scope="container" Sep 16 19:38:45.247152 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238752 2577 flags.go:64] FLAG: --v="2" Sep 16 19:38:45.247152 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238758 2577 flags.go:64] FLAG: --version="false" Sep 16 19:38:45.247152 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238765 2577 flags.go:64] FLAG: --vmodule="" Sep 16 19:38:45.247152 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238771 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 16 19:38:45.247152 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.238776 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 16 19:38:45.247770 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.238964 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 19:38:45.247770 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.238971 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 19:38:45.247770 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.238976 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 19:38:45.247770 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.238980 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 19:38:45.247770 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.238984 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 19:38:45.247770 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.238988 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 19:38:45.247770 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.238993 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 19:38:45.247770 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.238997 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 19:38:45.247770 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239002 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 19:38:45.247770 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239006 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 19:38:45.247770 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239010 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 19:38:45.247770 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239014 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 19:38:45.247770 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239018 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 19:38:45.247770 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239022 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 19:38:45.247770 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239028 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 19:38:45.247770 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239032 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 19:38:45.247770 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239036 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 19:38:45.247770 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239040 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 19:38:45.247770 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239044 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 19:38:45.247770 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239048 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 19:38:45.248280 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239052 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 19:38:45.248280 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239056 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 19:38:45.248280 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239061 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 19:38:45.248280 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239065 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 19:38:45.248280 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239071 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 19:38:45.248280 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239077 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 19:38:45.248280 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239081 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 19:38:45.248280 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239087 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 19:38:45.248280 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239092 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 19:38:45.248280 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239096 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 19:38:45.248280 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239103 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 19:38:45.248280 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239123 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 19:38:45.248280 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239127 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 19:38:45.248280 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239131 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 19:38:45.248280 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239135 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 19:38:45.248280 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239139 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 19:38:45.248280 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239143 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 19:38:45.248280 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239149 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 19:38:45.248280 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239155 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 19:38:45.248761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239159 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 19:38:45.248761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239163 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 19:38:45.248761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239168 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 19:38:45.248761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239172 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 19:38:45.248761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239176 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 19:38:45.248761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239181 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 19:38:45.248761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239185 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 19:38:45.248761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239191 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 19:38:45.248761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239195 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 19:38:45.248761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239199 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 19:38:45.248761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239203 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 19:38:45.248761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239208 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 19:38:45.248761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239212 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 19:38:45.248761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239218 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 19:38:45.248761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239224 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 19:38:45.248761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239229 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 19:38:45.248761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239234 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 19:38:45.248761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239238 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 19:38:45.248761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239243 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 19:38:45.248761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239248 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 19:38:45.249279 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239254 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 19:38:45.249279 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239258 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 19:38:45.249279 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239262 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 19:38:45.249279 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239266 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 19:38:45.249279 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239271 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 19:38:45.249279 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239275 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 19:38:45.249279 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239279 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 19:38:45.249279 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239283 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 19:38:45.249279 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239287 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 19:38:45.249279 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239291 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 19:38:45.249279 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239295 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 19:38:45.249279 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239299 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 19:38:45.249279 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239303 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 19:38:45.249279 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239307 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 19:38:45.249279 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239311 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 19:38:45.249279 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239315 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 19:38:45.249279 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239319 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 16 19:38:45.249279 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239323 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 19:38:45.249279 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239327 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 19:38:45.249279 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239332 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 19:38:45.249761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239336 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 19:38:45.249761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239339 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 19:38:45.249761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239343 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 19:38:45.249761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239347 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 19:38:45.249761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239352 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 19:38:45.249761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239356 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 19:38:45.249761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239360 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 19:38:45.249761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239364 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 19:38:45.249761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239368 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 19:38:45.249761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239372 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 19:38:45.249761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239377 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 19:38:45.249761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239381 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 19:38:45.249761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239387 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 19:38:45.249761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239391 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 19:38:45.249761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239395 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 19:38:45.249761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239400 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 19:38:45.249761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239404 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 19:38:45.249761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239409 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 19:38:45.249761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239413 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 19:38:45.249761 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.239417 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 19:38:45.250262 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.240299 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 16 19:38:45.250262 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.248265 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 16 19:38:45.250262 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.248280 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 16 19:38:45.250262 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.249178 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 16 19:38:45.250262 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.249188 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 16 19:38:45.250262 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249242 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 19:38:45.250262 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249247 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 19:38:45.250262 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249250 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 19:38:45.250262 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249253 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 19:38:45.250262 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249256 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 19:38:45.250262 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249259 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 19:38:45.250262 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249261 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 19:38:45.250262 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249264 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 19:38:45.250262 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249267 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 19:38:45.250262 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249270 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 19:38:45.250668 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249272 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 19:38:45.250668 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249275 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 19:38:45.250668 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249277 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 19:38:45.250668 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249280 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 19:38:45.250668 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249282 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 19:38:45.250668 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249285 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 19:38:45.250668 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249288 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 19:38:45.250668 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249291 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 19:38:45.250668 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249294 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 19:38:45.250668 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249296 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 19:38:45.250668 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249301 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 19:38:45.250668 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249305 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 19:38:45.250668 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249308 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 19:38:45.250668 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249311 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 19:38:45.250668 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249315 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 19:38:45.250668 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249318 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 19:38:45.250668 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249320 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 19:38:45.250668 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249323 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 19:38:45.250668 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249326 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 19:38:45.251145 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249330 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 19:38:45.251145 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249333 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 19:38:45.251145 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249335 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 19:38:45.251145 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249338 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 19:38:45.251145 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249341 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 19:38:45.251145 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249344 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 19:38:45.251145 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249346 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 19:38:45.251145 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249349 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 19:38:45.251145 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249351 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 19:38:45.251145 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249354 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 19:38:45.251145 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249357 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 19:38:45.251145 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249360 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 19:38:45.251145 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249363 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 19:38:45.251145 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249365 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 19:38:45.251145 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249367 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 19:38:45.251145 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249370 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 19:38:45.251145 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249372 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 19:38:45.251145 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249375 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 19:38:45.251145 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249377 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 19:38:45.251145 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249380 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 19:38:45.251628 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249382 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 19:38:45.251628 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249385 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 19:38:45.251628 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249387 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 19:38:45.251628 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249389 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 19:38:45.251628 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249392 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 19:38:45.251628 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249394 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 19:38:45.251628 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249397 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 19:38:45.251628 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249399 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 19:38:45.251628 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249402 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 19:38:45.251628 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249405 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 19:38:45.251628 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249408 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 19:38:45.251628 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249411 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 19:38:45.251628 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249415 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 19:38:45.251628 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249418 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 19:38:45.251628 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249421 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 19:38:45.251628 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249423 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 19:38:45.251628 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249427 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 19:38:45.251628 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249430 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 19:38:45.251628 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249433 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 19:38:45.252082 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249436 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 19:38:45.252082 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249439 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 19:38:45.252082 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249441 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 19:38:45.252082 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249444 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 19:38:45.252082 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249447 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 19:38:45.252082 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249450 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 19:38:45.252082 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249452 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 19:38:45.252082 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249455 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 19:38:45.252082 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249458 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 19:38:45.252082 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249461 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 19:38:45.252082 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249464 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 19:38:45.252082 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249466 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 19:38:45.252082 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249469 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 16 19:38:45.252082 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249472 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 19:38:45.252082 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249474 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 19:38:45.252082 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249476 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 19:38:45.252082 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249479 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 19:38:45.252082 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249482 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 19:38:45.252082 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249485 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 19:38:45.252625 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249488 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 19:38:45.252625 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249490 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 19:38:45.252625 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249493 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 19:38:45.252625 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249496 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 19:38:45.252625 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249499 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 19:38:45.252625 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249501 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 19:38:45.252625 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249505 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 19:38:45.252625 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249507 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 19:38:45.252625 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249509 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 19:38:45.252625 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249512 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 19:38:45.252625 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249515 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 19:38:45.252625 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249517 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 19:38:45.252625 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.249522 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 16 19:38:45.252625 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249623 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 19:38:45.252625 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249627 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 19:38:45.252990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249630 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 19:38:45.252990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249633 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 19:38:45.252990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249635 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 19:38:45.252990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249638 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 19:38:45.252990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249640 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 19:38:45.252990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249642 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 19:38:45.252990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249645 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 19:38:45.252990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249647 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 19:38:45.252990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249649 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 19:38:45.252990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249652 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 19:38:45.252990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249654 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 19:38:45.252990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249657 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 19:38:45.252990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249659 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 19:38:45.252990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249662 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 19:38:45.252990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249664 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 19:38:45.252990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249666 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 19:38:45.252990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249670 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 19:38:45.252990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249673 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 19:38:45.252990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249676 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 19:38:45.252990 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249680 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 19:38:45.253490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249682 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 19:38:45.253490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249686 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 19:38:45.253490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249688 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 19:38:45.253490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249691 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 19:38:45.253490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249694 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 19:38:45.253490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249697 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 19:38:45.253490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249699 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 19:38:45.253490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249702 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 19:38:45.253490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249704 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 19:38:45.253490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249707 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 19:38:45.253490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249709 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 19:38:45.253490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249712 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 19:38:45.253490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249714 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 19:38:45.253490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249717 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 19:38:45.253490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249719 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 19:38:45.253490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249721 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 19:38:45.253490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249724 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 19:38:45.253490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249726 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 19:38:45.253490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249728 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 19:38:45.253490 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249731 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 19:38:45.253967 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249734 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 19:38:45.253967 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249737 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 19:38:45.253967 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249739 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 19:38:45.253967 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249742 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 19:38:45.253967 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249744 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 19:38:45.253967 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249747 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 19:38:45.253967 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249749 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 19:38:45.253967 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249751 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 19:38:45.253967 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249754 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 19:38:45.253967 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249756 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 19:38:45.253967 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249758 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 19:38:45.253967 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249761 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 19:38:45.253967 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249763 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 19:38:45.253967 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249766 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 19:38:45.253967 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249769 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 19:38:45.253967 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249772 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 19:38:45.253967 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249775 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 19:38:45.253967 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249777 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 19:38:45.253967 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249780 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 19:38:45.254436 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249782 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 19:38:45.254436 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249785 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 19:38:45.254436 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249787 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 19:38:45.254436 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249790 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 16 19:38:45.254436 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249792 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 19:38:45.254436 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249795 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 19:38:45.254436 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249797 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 19:38:45.254436 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249799 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 19:38:45.254436 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249802 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 19:38:45.254436 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249804 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 19:38:45.254436 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249806 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 19:38:45.254436 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249809 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 19:38:45.254436 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249811 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 19:38:45.254436 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249814 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 19:38:45.254436 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249816 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 19:38:45.254436 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249818 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 19:38:45.254436 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249821 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 19:38:45.254436 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249823 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 19:38:45.254436 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249825 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 19:38:45.254894 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249828 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 19:38:45.254894 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249830 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 19:38:45.254894 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249833 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 19:38:45.254894 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249836 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 19:38:45.254894 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249839 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 19:38:45.254894 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249841 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 19:38:45.254894 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249844 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 19:38:45.254894 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249846 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 19:38:45.254894 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249848 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 19:38:45.254894 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249852 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 19:38:45.254894 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249854 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 19:38:45.254894 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249857 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 19:38:45.254894 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249859 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 19:38:45.254894 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249862 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 19:38:45.254894 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249864 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 19:38:45.254894 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249868 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 19:38:45.254894 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249871 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 19:38:45.254894 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249874 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 19:38:45.254894 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:45.249876 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 19:38:45.255391 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.249881 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 16 19:38:45.255391 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.249967 2577 server.go:962] "Client rotation is on, will bootstrap in background" Sep 16 19:38:45.255391 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.252234 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 16 19:38:45.255391 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.253344 2577 server.go:1019] "Starting client certificate rotation" Sep 16 19:38:45.255391 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.253439 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 16 19:38:45.255391 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.253476 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 16 19:38:45.256178 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.256165 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 16 19:38:45.259543 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.259529 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 16 19:38:45.273692 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.273670 2577 log.go:25] "Validated CRI v1 runtime API" Sep 16 19:38:45.277024 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.277009 2577 log.go:25] "Validated CRI v1 image API" Sep 16 19:38:45.277867 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.277852 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 16 19:38:45.283687 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.283670 2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c90a3df3-689b-4d35-a77d-727e99ac6efd:/dev/nvme0n1p4 e2002e64-5f2e-4d3b-8409-64b7d749a13f:/dev/nvme0n1p3] Sep 16 19:38:45.283742 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.283687 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 16 19:38:45.285841 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.285821 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 16 19:38:45.289220 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.289116 2577 manager.go:216] Machine: {Timestamp:2026-09-16 19:38:45.287684406 +0000 UTC m=+0.387988472 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100583 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2144b67091ca0c49a6435f69a199ca SystemUUID:ec2144b6-7091-ca0c-49a6-435f69a199ca BootID:f518b707-1e74-407e-9742-0d3f4d995af8 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f1:5b:9a:b7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f1:5b:9a:b7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:65:58:91:cf:e1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 16 19:38:45.289220 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.289213 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 16 19:38:45.289330 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.289283 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 16 19:38:45.292933 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.292913 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 16 19:38:45.293063 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.292937 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-18.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 16 19:38:45.293792 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.293782 2577 topology_manager.go:138] "Creating topology manager with none policy" Sep 16 19:38:45.293827 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.293795 2577 container_manager_linux.go:309] "Creating device plugin manager" Sep 16 19:38:45.293827 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.293802 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 16 19:38:45.294655 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.294644 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 16 19:38:45.295940 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.295930 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 16 19:38:45.300708 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.300697 2577 state_mem.go:36] "Initialized new in-memory state store" Sep 16 19:38:45.300823 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.300813 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 16 19:38:45.300854 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.300843 2577 kubelet.go:486] "Attempting to sync node with API server" Sep 16 19:38:45.300854 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.300853 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 16 19:38:45.300912 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.300866 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 16 19:38:45.300912 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.300875 2577 kubelet.go:398] "Adding apiserver pod source" Sep 16 19:38:45.300912 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.300884 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 16 19:38:45.301231 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.301208 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 16 19:38:45.301231 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.301230 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 16 19:38:45.304973 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.304958 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 16 19:38:45.307725 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.307711 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 16 19:38:45.307786 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.307741 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 16 19:38:45.309922 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.309909 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 16 19:38:45.310002 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.309932 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 16 19:38:45.310002 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.309938 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 16 19:38:45.310002 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.309944 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 16 19:38:45.310002 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.309952 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 16 19:38:45.310002 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.309957 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 16 19:38:45.310002 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.309970 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 16 19:38:45.310002 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.309975 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 16 19:38:45.310002 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.309981 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 16 19:38:45.310002 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.309986 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 16 19:38:45.310002 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.309997 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 16 19:38:45.310002 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.310002 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 16 19:38:45.311826 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.311800 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 16 19:38:45.311826 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.311825 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 16 19:38:45.311947 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:45.310900 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 16 19:38:45.311947 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:45.311841 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-18.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 16 19:38:45.315975 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.315958 2577 server.go:1268] "Started kubelet" Sep 16 19:38:45.316081 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.316028 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 16 19:38:45.316141 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.316046 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 16 19:38:45.316141 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.316130 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 16 19:38:45.316895 ip-10-0-128-18 systemd[1]: Started Kubernetes Kubelet. Sep 16 19:38:45.317288 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.317269 2577 server.go:310] "Adding debug handlers to kubelet server" Sep 16 19:38:45.317978 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.317922 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 16 19:38:45.320085 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:45.320066 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 16 19:38:45.324874 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.324841 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 16 19:38:45.324874 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.324852 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 16 19:38:45.325039 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:45.324946 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-18.ec2.internal\" not found" Sep 16 19:38:45.325263 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.325249 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-18.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 16 19:38:45.325694 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.325681 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 16 19:38:45.325782 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.325698 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 16 19:38:45.325782 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.325684 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 16 19:38:45.325782 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.325770 2577 reconstruct.go:97] "Volume reconstruction finished" Sep 16 19:38:45.325782 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.325780 2577 reconciler.go:29] "Reconciler: start to sync state" Sep 16 19:38:45.325971 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.325811 2577 factory.go:55] Registering systemd factory Sep 16 19:38:45.325971 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.325822 2577 factory.go:223] Registration of the systemd container factory successfully Sep 16 19:38:45.326139 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.326123 2577 factory.go:153] Registering CRI-O factory Sep 16 19:38:45.326207 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.326143 2577 factory.go:223] Registration of the crio container factory successfully Sep 16 19:38:45.326207 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.326196 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 16 19:38:45.326299 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.326215 2577 factory.go:103] Registering Raw factory Sep 16 19:38:45.326299 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.326228 2577 manager.go:1196] Started watching for new ooms in manager Sep 16 19:38:45.326299 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:45.325085 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-18.ec2.internal.18d5e45f64ecfecf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-18.ec2.internal,UID:ip-10-0-128-18.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-18.ec2.internal,},FirstTimestamp:2026-09-16 19:38:45.315919567 +0000 UTC m=+0.416223634,LastTimestamp:2026-09-16 19:38:45.315919567 +0000 UTC m=+0.416223634,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-18.ec2.internal,}" Sep 16 19:38:45.326592 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.326577 2577 manager.go:349] Starting recovery of all containers Sep 16 19:38:45.330689 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:45.330661 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-18.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 16 19:38:45.331341 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:45.331317 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 16 19:38:45.333093 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.333074 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2tfm9" Sep 16 19:38:45.337378 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.337362 2577 manager.go:354] Recovery completed Sep 16 19:38:45.340463 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:45.340339 2577 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Sep 16 19:38:45.341568 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.341552 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2tfm9" Sep 16 19:38:45.343409 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.343397 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 19:38:45.346888 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.346873 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-18.ec2.internal" event="NodeHasSufficientMemory" Sep 16 19:38:45.346989 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.346904 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-18.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 19:38:45.346989 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.346919 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-18.ec2.internal" event="NodeHasSufficientPID" Sep 16 19:38:45.347487 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.347477 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 16 19:38:45.347487 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.347487 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 16 19:38:45.347601 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.347493 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 19:38:45.347601 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.347503 2577 state_mem.go:36] "Initialized new in-memory state store" Sep 16 19:38:45.348274 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.348260 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-18.ec2.internal" event="NodeHasSufficientMemory" Sep 16 19:38:45.348336 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.348287 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-18.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 19:38:45.348336 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.348300 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-18.ec2.internal" event="NodeHasSufficientPID" Sep 16 19:38:45.348870 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:45.348811 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-18.ec2.internal.18d5e45f66c58829 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-18.ec2.internal,UID:ip-10-0-128-18.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-18.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-18.ec2.internal,},FirstTimestamp:2026-09-16 19:38:45.346887721 +0000 UTC m=+0.447191788,LastTimestamp:2026-09-16 19:38:45.346887721 +0000 UTC m=+0.447191788,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-18.ec2.internal,}" Sep 16 19:38:45.349632 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.349606 2577 policy_none.go:49] "None policy: Start" Sep 16 19:38:45.349632 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.349624 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 16 19:38:45.349740 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.349637 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 16 19:38:45.351743 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.351732 2577 policy_none.go:47] "Start" Sep 16 19:38:45.389657 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.389633 2577 manager.go:337] "Starting Device Plugin manager" Sep 16 19:38:45.404219 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:45.389680 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 16 19:38:45.404219 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.389692 2577 server.go:87] "Starting device plugin registration server" Sep 16 19:38:45.404219 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.389968 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 16 19:38:45.404219 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.389979 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 16 19:38:45.404219 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.390065 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 16 19:38:45.404219 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.390163 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 16 19:38:45.404219 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.390174 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 16 19:38:45.404219 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:45.390667 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 16 19:38:45.404219 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:45.390718 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-18.ec2.internal\" not found" Sep 16 19:38:45.421857 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.421831 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 16 19:38:45.423151 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.423132 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 16 19:38:45.425617 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.425602 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 16 19:38:45.425707 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.425634 2577 kubelet.go:2448] "Starting kubelet main sync loop" Sep 16 19:38:45.425754 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:45.425708 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 16 19:38:45.428002 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.427988 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 19:38:45.490899 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.490845 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 19:38:45.491698 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.491682 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-18.ec2.internal" event="NodeHasSufficientMemory" Sep 16 19:38:45.491786 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.491714 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-18.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 19:38:45.491786 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.491730 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-18.ec2.internal" event="NodeHasSufficientPID" Sep 16 19:38:45.491786 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.491756 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-18.ec2.internal" Sep 16 19:38:45.500328 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.500313 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-18.ec2.internal" Sep 16 19:38:45.500407 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:45.500331 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-18.ec2.internal\": node \"ip-10-0-128-18.ec2.internal\" not found" Sep 16 19:38:45.512557 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:45.512538 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-18.ec2.internal\" not found" Sep 16 19:38:45.526669 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.526649 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-18.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-18.ec2.internal"] Sep 16 19:38:45.526796 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.526716 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 19:38:45.527968 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.527954 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-18.ec2.internal" event="NodeHasSufficientMemory" Sep 16 19:38:45.528034 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.527980 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-18.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 19:38:45.528034 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.527990 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-18.ec2.internal" event="NodeHasSufficientPID" Sep 16 19:38:45.530325 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.530314 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 19:38:45.530432 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.530417 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-18.ec2.internal" Sep 16 19:38:45.530486 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.530444 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 19:38:45.530963 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.530950 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-18.ec2.internal" event="NodeHasSufficientMemory" Sep 16 19:38:45.531028 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.530974 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-18.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 19:38:45.531028 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.530983 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-18.ec2.internal" event="NodeHasSufficientPID" Sep 16 19:38:45.531559 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.531544 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-18.ec2.internal" event="NodeHasSufficientMemory" Sep 16 19:38:45.531637 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.531571 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-18.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 19:38:45.531637 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.531585 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-18.ec2.internal" event="NodeHasSufficientPID" Sep 16 19:38:45.533271 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.533258 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-18.ec2.internal" Sep 16 19:38:45.533328 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.533281 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 19:38:45.533935 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.533920 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-18.ec2.internal" event="NodeHasSufficientMemory" Sep 16 19:38:45.533996 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.533944 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-18.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 19:38:45.533996 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.533954 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-18.ec2.internal" event="NodeHasSufficientPID" Sep 16 19:38:45.560650 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:45.560631 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-18.ec2.internal\" not found" node="ip-10-0-128-18.ec2.internal" Sep 16 19:38:45.564948 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:45.564935 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-18.ec2.internal\" not found" node="ip-10-0-128-18.ec2.internal" Sep 16 19:38:45.613302 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:45.613286 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-18.ec2.internal\" not found" Sep 16 19:38:45.627579 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.627559 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/26845c0b3b67ab14283ca3124672441d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-18.ec2.internal\" (UID: \"26845c0b3b67ab14283ca3124672441d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-18.ec2.internal" Sep 16 19:38:45.627641 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.627583 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26845c0b3b67ab14283ca3124672441d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-18.ec2.internal\" (UID: \"26845c0b3b67ab14283ca3124672441d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-18.ec2.internal" Sep 16 19:38:45.627641 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.627600 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/81eb68d3a2c532023a6d1abc2053e6b2-config\") pod \"kube-apiserver-proxy-ip-10-0-128-18.ec2.internal\" (UID: \"81eb68d3a2c532023a6d1abc2053e6b2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-18.ec2.internal" Sep 16 19:38:45.713753 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:45.713715 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-18.ec2.internal\" not found" Sep 16 19:38:45.728139 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.728101 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26845c0b3b67ab14283ca3124672441d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-18.ec2.internal\" (UID: \"26845c0b3b67ab14283ca3124672441d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-18.ec2.internal" Sep 16 19:38:45.728226 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.728142 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26845c0b3b67ab14283ca3124672441d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-18.ec2.internal\" (UID: \"26845c0b3b67ab14283ca3124672441d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-18.ec2.internal" Sep 16 19:38:45.728226 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.728187 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/81eb68d3a2c532023a6d1abc2053e6b2-config\") pod \"kube-apiserver-proxy-ip-10-0-128-18.ec2.internal\" (UID: \"81eb68d3a2c532023a6d1abc2053e6b2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-18.ec2.internal" Sep 16 19:38:45.728226 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.728203 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/26845c0b3b67ab14283ca3124672441d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-18.ec2.internal\" (UID: \"26845c0b3b67ab14283ca3124672441d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-18.ec2.internal" Sep 16 19:38:45.728320 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.728240 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/26845c0b3b67ab14283ca3124672441d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-18.ec2.internal\" (UID: \"26845c0b3b67ab14283ca3124672441d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-18.ec2.internal" Sep 16 19:38:45.728320 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.728267 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/81eb68d3a2c532023a6d1abc2053e6b2-config\") pod \"kube-apiserver-proxy-ip-10-0-128-18.ec2.internal\" (UID: \"81eb68d3a2c532023a6d1abc2053e6b2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-18.ec2.internal" Sep 16 19:38:45.814556 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:45.814487 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-18.ec2.internal\" not found" Sep 16 19:38:45.863993 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.863969 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-18.ec2.internal" Sep 16 19:38:45.867568 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:45.867553 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-18.ec2.internal" Sep 16 19:38:45.915582 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:45.915555 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-18.ec2.internal\" not found" Sep 16 19:38:46.016084 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:46.016052 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-18.ec2.internal\" not found" Sep 16 19:38:46.116671 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:46.116613 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-18.ec2.internal\" not found" Sep 16 19:38:46.217098 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:46.217076 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-18.ec2.internal\" not found" Sep 16 19:38:46.252631 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:46.252614 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 16 19:38:46.252756 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:46.252732 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 16 19:38:46.318133 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:46.318079 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-18.ec2.internal\" not found" Sep 16 19:38:46.335437 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:46.335412 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 19:38:46.345602 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:46.345574 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-15 19:33:45 +0000 UTC" deadline="2028-05-09 00:17:00.010973343 +0000 UTC" Sep 16 19:38:46.345602 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:46.345598 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14404h38m13.665378381s" Sep 16 19:38:46.396028 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:46.395987 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 19:38:46.418824 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:46.418801 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-18.ec2.internal\" not found" Sep 16 19:38:46.430472 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:46.430442 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26845c0b3b67ab14283ca3124672441d.slice/crio-fb5d643648470aeb0be445f7590de8475abbd514756265178494db65a54f55af WatchSource:0}: Error finding container fb5d643648470aeb0be445f7590de8475abbd514756265178494db65a54f55af: Status 404 returned error can't find the container with id fb5d643648470aeb0be445f7590de8475abbd514756265178494db65a54f55af Sep 16 19:38:46.434444 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:46.434430 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 16 19:38:46.518950 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:46.518917 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-18.ec2.internal\" not found" Sep 16 19:38:46.619046 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:46.619028 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-18.ec2.internal\" not found" Sep 16 19:38:46.719611 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:46.719551 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-18.ec2.internal\" not found" Sep 16 19:38:46.820487 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:46.820456 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-18.ec2.internal\" not found" Sep 16 19:38:46.844211 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:46.844188 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 19:38:46.925075 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:46.925049 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-18.ec2.internal" Sep 16 19:38:46.937316 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:46.937291 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 16 19:38:46.938433 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:46.938411 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-18.ec2.internal" Sep 16 19:38:46.958541 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:46.958520 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 16 19:38:47.302913 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.302881 2577 apiserver.go:52] "Watching apiserver" Sep 16 19:38:47.312862 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.312830 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 16 19:38:47.314280 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.314247 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-qnnzz","kube-system/kube-apiserver-proxy-ip-10-0-128-18.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvpls","openshift-dns/node-resolver-wf7dr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-18.ec2.internal","openshift-multus/multus-qcgh2","openshift-multus/network-metrics-daemon-cgqxj","openshift-network-operator/iptables-alerter-9zct4","kube-system/global-pull-secret-syncer-5cc8s","openshift-cluster-node-tuning-operator/tuned-lgnl8","openshift-image-registry/node-ca-s6r7f","openshift-multus/multus-additional-cni-plugins-cmmh9","openshift-network-diagnostics/network-check-target-mm5r8","openshift-ovn-kubernetes/ovnkube-node-pn7bt"] Sep 16 19:38:47.316876 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.316849 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:38:47.317009 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:47.316942 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cgqxj" podUID="aafe6dc2-78c4-4a74-bea1-8b7221c9f467" Sep 16 19:38:47.319067 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.319041 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s6r7f" Sep 16 19:38:47.321938 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.321396 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvpls" Sep 16 19:38:47.322623 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.322294 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 16 19:38:47.322623 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.322372 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 16 19:38:47.322623 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.322411 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 16 19:38:47.322623 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.322427 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2kd6s\"" Sep 16 19:38:47.323851 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.323827 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wf7dr" Sep 16 19:38:47.324267 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.324249 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 16 19:38:47.324384 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.324361 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 16 19:38:47.324493 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.324477 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-d7mmz\"" Sep 16 19:38:47.324601 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.324584 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 16 19:38:47.325636 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.325610 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 16 19:38:47.326542 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.326521 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.326775 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.326734 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 16 19:38:47.327124 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.327087 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5vbcz\"" Sep 16 19:38:47.327213 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.327145 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 16 19:38:47.328960 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.328939 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.329877 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.329658 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 16 19:38:47.329877 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.329732 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 16 19:38:47.330025 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.329879 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 16 19:38:47.330025 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.329924 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 16 19:38:47.331176 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.331154 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 16 19:38:47.331176 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.331168 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 16 19:38:47.331380 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.331166 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l5mmd\"" Sep 16 19:38:47.331624 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.331603 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:38:47.331723 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:47.331691 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cc8s" podUID="f11b5a57-9bb4-4b8c-be52-363ccdda5466" Sep 16 19:38:47.331842 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.331824 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 16 19:38:47.332104 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.332085 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 16 19:38:47.332321 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.332305 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 16 19:38:47.332321 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.332318 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gqzqh\"" Sep 16 19:38:47.332574 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.332542 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 16 19:38:47.334245 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.334228 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:38:47.334361 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:47.334283 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm5r8" podUID="1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6" Sep 16 19:38:47.335431 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.335413 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/536a4230-7582-4958-9653-31c99fd62796-hosts-file\") pod \"node-resolver-wf7dr\" (UID: \"536a4230-7582-4958-9653-31c99fd62796\") " pod="openshift-dns/node-resolver-wf7dr" Sep 16 19:38:47.335544 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.335436 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-host-cni-bin\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.335544 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.335453 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/16907ec1-adc2-4234-b82b-f926dabaa21f-env-overrides\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.335544 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.335469 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aafe6dc2-78c4-4a74-bea1-8b7221c9f467-metrics-certs\") pod \"network-metrics-daemon-cgqxj\" (UID: \"aafe6dc2-78c4-4a74-bea1-8b7221c9f467\") " pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:38:47.335544 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.335491 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0b8440ca-9a7a-4106-bfc5-6fb59780fb54-socket-dir\") pod \"aws-ebs-csi-driver-node-wvpls\" (UID: \"0b8440ca-9a7a-4106-bfc5-6fb59780fb54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvpls" Sep 16 19:38:47.335873 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.335567 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8rf6\" (UniqueName: \"kubernetes.io/projected/536a4230-7582-4958-9653-31c99fd62796-kube-api-access-s8rf6\") pod \"node-resolver-wf7dr\" (UID: \"536a4230-7582-4958-9653-31c99fd62796\") " pod="openshift-dns/node-resolver-wf7dr" Sep 16 19:38:47.335873 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.335601 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/16907ec1-adc2-4234-b82b-f926dabaa21f-ovnkube-config\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.335873 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.335629 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ec497417-cb80-4876-9c6a-c922f1a9a1bc-serviceca\") pod \"node-ca-s6r7f\" (UID: \"ec497417-cb80-4876-9c6a-c922f1a9a1bc\") " pod="openshift-image-registry/node-ca-s6r7f" Sep 16 19:38:47.335873 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.335654 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm6kr\" (UniqueName: \"kubernetes.io/projected/0b8440ca-9a7a-4106-bfc5-6fb59780fb54-kube-api-access-pm6kr\") pod \"aws-ebs-csi-driver-node-wvpls\" (UID: \"0b8440ca-9a7a-4106-bfc5-6fb59780fb54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvpls" Sep 16 19:38:47.335873 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.335681 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-etc-openvswitch\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.335873 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.335705 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-run-openvswitch\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.335873 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.335735 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-host-run-ovn-kubernetes\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.335873 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.335760 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v982m\" (UniqueName: \"kubernetes.io/projected/aafe6dc2-78c4-4a74-bea1-8b7221c9f467-kube-api-access-v982m\") pod \"network-metrics-daemon-cgqxj\" (UID: \"aafe6dc2-78c4-4a74-bea1-8b7221c9f467\") " pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:38:47.336844 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.336820 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0b8440ca-9a7a-4106-bfc5-6fb59780fb54-etc-selinux\") pod \"aws-ebs-csi-driver-node-wvpls\" (UID: \"0b8440ca-9a7a-4106-bfc5-6fb59780fb54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvpls" Sep 16 19:38:47.336946 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.336870 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-systemd-units\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.336946 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.336903 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-host-slash\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.337092 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.336941 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmnn4\" (UniqueName: \"kubernetes.io/projected/16907ec1-adc2-4234-b82b-f926dabaa21f-kube-api-access-tmnn4\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.337092 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.336990 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-host-run-netns\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.337092 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.337025 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-var-lib-openvswitch\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.337092 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.337069 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-run-ovn\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.337368 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.337100 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-log-socket\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.337368 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.337132 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-host-cni-netd\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.337368 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.337170 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.337368 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.337228 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kcfv\" (UniqueName: \"kubernetes.io/projected/ec497417-cb80-4876-9c6a-c922f1a9a1bc-kube-api-access-2kcfv\") pod \"node-ca-s6r7f\" (UID: \"ec497417-cb80-4876-9c6a-c922f1a9a1bc\") " pod="openshift-image-registry/node-ca-s6r7f" Sep 16 19:38:47.337368 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.337262 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0b8440ca-9a7a-4106-bfc5-6fb59780fb54-registration-dir\") pod \"aws-ebs-csi-driver-node-wvpls\" (UID: \"0b8440ca-9a7a-4106-bfc5-6fb59780fb54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvpls" Sep 16 19:38:47.337368 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.337297 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0b8440ca-9a7a-4106-bfc5-6fb59780fb54-device-dir\") pod \"aws-ebs-csi-driver-node-wvpls\" (UID: \"0b8440ca-9a7a-4106-bfc5-6fb59780fb54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvpls" Sep 16 19:38:47.337661 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.337430 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-run-systemd\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.337661 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.337465 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0b8440ca-9a7a-4106-bfc5-6fb59780fb54-sys-fs\") pod \"aws-ebs-csi-driver-node-wvpls\" (UID: \"0b8440ca-9a7a-4106-bfc5-6fb59780fb54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvpls" Sep 16 19:38:47.337661 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.337502 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/536a4230-7582-4958-9653-31c99fd62796-tmp-dir\") pod \"node-resolver-wf7dr\" (UID: \"536a4230-7582-4958-9653-31c99fd62796\") " pod="openshift-dns/node-resolver-wf7dr" Sep 16 19:38:47.337661 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.337535 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec497417-cb80-4876-9c6a-c922f1a9a1bc-host\") pod \"node-ca-s6r7f\" (UID: \"ec497417-cb80-4876-9c6a-c922f1a9a1bc\") " pod="openshift-image-registry/node-ca-s6r7f" Sep 16 19:38:47.337661 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.337570 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0b8440ca-9a7a-4106-bfc5-6fb59780fb54-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wvpls\" (UID: \"0b8440ca-9a7a-4106-bfc5-6fb59780fb54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvpls" Sep 16 19:38:47.337661 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.337604 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-host-kubelet\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.337661 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.337640 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-node-log\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.338031 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.337677 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/16907ec1-adc2-4234-b82b-f926dabaa21f-ovn-node-metrics-cert\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.338031 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.337712 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/16907ec1-adc2-4234-b82b-f926dabaa21f-ovnkube-script-lib\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.339460 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.339441 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9zct4" Sep 16 19:38:47.340301 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.340275 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.342478 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.342322 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 16 19:38:47.342573 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.342557 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fqkdw\"" Sep 16 19:38:47.342797 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.342766 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 16 19:38:47.342797 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.342771 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 16 19:38:47.343063 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.343043 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qnnzz" Sep 16 19:38:47.343199 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.343164 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 16 19:38:47.343293 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.343271 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 16 19:38:47.343965 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.343946 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 16 19:38:47.344254 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.344236 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dzr8q\"" Sep 16 19:38:47.346329 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.345609 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cmmh9" Sep 16 19:38:47.346329 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.345973 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 16 19:38:47.346329 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.346056 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cwgj6\"" Sep 16 19:38:47.346329 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.346180 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 16 19:38:47.348375 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.348352 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 16 19:38:47.348493 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.348468 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 16 19:38:47.349133 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.349113 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xbknp\"" Sep 16 19:38:47.373422 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.373400 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9mtwg" Sep 16 19:38:47.375839 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.375818 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 19:38:47.379742 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.379722 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9mtwg" Sep 16 19:38:47.427042 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.427022 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 16 19:38:47.430757 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.430712 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-18.ec2.internal" event={"ID":"26845c0b3b67ab14283ca3124672441d","Type":"ContainerStarted","Data":"fb5d643648470aeb0be445f7590de8475abbd514756265178494db65a54f55af"} Sep 16 19:38:47.432053 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.432029 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-18.ec2.internal" event={"ID":"81eb68d3a2c532023a6d1abc2053e6b2","Type":"ContainerStarted","Data":"0b5f2149f5aa9a99149cc85a301a5d82eb2197ae48590173ab6fddadcbfd1116"} Sep 16 19:38:47.437876 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.437855 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0b8440ca-9a7a-4106-bfc5-6fb59780fb54-socket-dir\") pod \"aws-ebs-csi-driver-node-wvpls\" (UID: \"0b8440ca-9a7a-4106-bfc5-6fb59780fb54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvpls" Sep 16 19:38:47.437977 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.437922 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8rf6\" (UniqueName: \"kubernetes.io/projected/536a4230-7582-4958-9653-31c99fd62796-kube-api-access-s8rf6\") pod \"node-resolver-wf7dr\" (UID: \"536a4230-7582-4958-9653-31c99fd62796\") " pod="openshift-dns/node-resolver-wf7dr" Sep 16 19:38:47.437977 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.437961 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-host-run-multus-certs\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.438084 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.437991 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbdp9\" (UniqueName: \"kubernetes.io/projected/86548323-286f-4fad-953a-82adc1a58a0d-kube-api-access-bbdp9\") pod \"iptables-alerter-9zct4\" (UID: \"86548323-286f-4fad-953a-82adc1a58a0d\") " pod="openshift-network-operator/iptables-alerter-9zct4" Sep 16 19:38:47.438084 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438058 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0b8440ca-9a7a-4106-bfc5-6fb59780fb54-socket-dir\") pod \"aws-ebs-csi-driver-node-wvpls\" (UID: \"0b8440ca-9a7a-4106-bfc5-6fb59780fb54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvpls" Sep 16 19:38:47.438084 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438067 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27c7c9ec-2ec2-4fe5-878e-3ff97368cb96-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cmmh9\" (UID: \"27c7c9ec-2ec2-4fe5-878e-3ff97368cb96\") " pod="openshift-multus/multus-additional-cni-plugins-cmmh9" Sep 16 19:38:47.438247 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438120 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-etc-modprobe-d\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.438247 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438180 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-etc-sysconfig\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.438353 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438243 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-host\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.438353 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438302 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc9cp\" (UniqueName: \"kubernetes.io/projected/1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6-kube-api-access-jc9cp\") pod \"network-check-target-mm5r8\" (UID: \"1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6\") " pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:38:47.438353 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438331 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e058c38-f126-4835-b2bf-050ea01fc7b5-multus-daemon-config\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.438507 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438363 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0b8440ca-9a7a-4106-bfc5-6fb59780fb54-etc-selinux\") pod \"aws-ebs-csi-driver-node-wvpls\" (UID: \"0b8440ca-9a7a-4106-bfc5-6fb59780fb54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvpls" Sep 16 19:38:47.438507 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438426 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-systemd-units\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.438507 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438437 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0b8440ca-9a7a-4106-bfc5-6fb59780fb54-etc-selinux\") pod \"aws-ebs-csi-driver-node-wvpls\" (UID: \"0b8440ca-9a7a-4106-bfc5-6fb59780fb54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvpls" Sep 16 19:38:47.438507 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438454 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-host-var-lib-cni-bin\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.438507 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438479 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf4d8\" (UniqueName: \"kubernetes.io/projected/2e058c38-f126-4835-b2bf-050ea01fc7b5-kube-api-access-hf4d8\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.438507 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438480 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-systemd-units\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.438507 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438506 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-run-ovn\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.438935 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438552 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-log-socket\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.438935 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438565 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-run-ovn\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.438935 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438582 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-host-cni-netd\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.438935 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438602 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.438935 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438610 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-log-socket\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.438935 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438621 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-multus-socket-dir-parent\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.438935 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438639 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/27c7c9ec-2ec2-4fe5-878e-3ff97368cb96-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cmmh9\" (UID: \"27c7c9ec-2ec2-4fe5-878e-3ff97368cb96\") " pod="openshift-multus/multus-additional-cni-plugins-cmmh9" Sep 16 19:38:47.438935 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438646 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-host-cni-netd\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.438935 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438654 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.438935 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438667 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f11b5a57-9bb4-4b8c-be52-363ccdda5466-original-pull-secret\") pod \"global-pull-secret-syncer-5cc8s\" (UID: \"f11b5a57-9bb4-4b8c-be52-363ccdda5466\") " pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:38:47.438935 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438745 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0b8440ca-9a7a-4106-bfc5-6fb59780fb54-device-dir\") pod \"aws-ebs-csi-driver-node-wvpls\" (UID: \"0b8440ca-9a7a-4106-bfc5-6fb59780fb54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvpls" Sep 16 19:38:47.438935 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438771 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-run-systemd\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.438935 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438801 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-system-cni-dir\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.438935 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438827 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27c7c9ec-2ec2-4fe5-878e-3ff97368cb96-cnibin\") pod \"multus-additional-cni-plugins-cmmh9\" (UID: \"27c7c9ec-2ec2-4fe5-878e-3ff97368cb96\") " pod="openshift-multus/multus-additional-cni-plugins-cmmh9" Sep 16 19:38:47.438935 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438857 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec497417-cb80-4876-9c6a-c922f1a9a1bc-host\") pod \"node-ca-s6r7f\" (UID: \"ec497417-cb80-4876-9c6a-c922f1a9a1bc\") " pod="openshift-image-registry/node-ca-s6r7f" Sep 16 19:38:47.438935 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438872 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-run-systemd\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.438935 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438885 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-cnibin\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.439880 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438935 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0b8440ca-9a7a-4106-bfc5-6fb59780fb54-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wvpls\" (UID: \"0b8440ca-9a7a-4106-bfc5-6fb59780fb54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvpls" Sep 16 19:38:47.439880 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438965 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0b8440ca-9a7a-4106-bfc5-6fb59780fb54-device-dir\") pod \"aws-ebs-csi-driver-node-wvpls\" (UID: \"0b8440ca-9a7a-4106-bfc5-6fb59780fb54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvpls" Sep 16 19:38:47.439880 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.439011 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec497417-cb80-4876-9c6a-c922f1a9a1bc-host\") pod \"node-ca-s6r7f\" (UID: \"ec497417-cb80-4876-9c6a-c922f1a9a1bc\") " pod="openshift-image-registry/node-ca-s6r7f" Sep 16 19:38:47.439880 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.439023 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-host-kubelet\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.439880 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.438999 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0b8440ca-9a7a-4106-bfc5-6fb59780fb54-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wvpls\" (UID: \"0b8440ca-9a7a-4106-bfc5-6fb59780fb54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvpls" Sep 16 19:38:47.439880 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.439073 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-node-log\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.439880 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.439077 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-host-kubelet\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.439880 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.439110 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f11b5a57-9bb4-4b8c-be52-363ccdda5466-dbus\") pod \"global-pull-secret-syncer-5cc8s\" (UID: \"f11b5a57-9bb4-4b8c-be52-363ccdda5466\") " pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:38:47.439880 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.439184 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-node-log\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.439880 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.439237 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/536a4230-7582-4958-9653-31c99fd62796-hosts-file\") pod \"node-resolver-wf7dr\" (UID: \"536a4230-7582-4958-9653-31c99fd62796\") " pod="openshift-dns/node-resolver-wf7dr" Sep 16 19:38:47.439880 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.439273 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/16907ec1-adc2-4234-b82b-f926dabaa21f-env-overrides\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.439880 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.439302 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aafe6dc2-78c4-4a74-bea1-8b7221c9f467-metrics-certs\") pod \"network-metrics-daemon-cgqxj\" (UID: \"aafe6dc2-78c4-4a74-bea1-8b7221c9f467\") " pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:38:47.439880 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.439364 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e058c38-f126-4835-b2bf-050ea01fc7b5-cni-binary-copy\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.439880 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.439437 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-host-run-netns\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.439880 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:47.439470 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 19:38:47.439880 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.439539 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/536a4230-7582-4958-9653-31c99fd62796-hosts-file\") pod \"node-resolver-wf7dr\" (UID: \"536a4230-7582-4958-9653-31c99fd62796\") " pod="openshift-dns/node-resolver-wf7dr" Sep 16 19:38:47.439880 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.439573 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-etc-kubernetes\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.439880 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.439588 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-etc-sysctl-d\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.440804 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.439606 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/16907ec1-adc2-4234-b82b-f926dabaa21f-ovnkube-config\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.440804 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.439634 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ec497417-cb80-4876-9c6a-c922f1a9a1bc-serviceca\") pod \"node-ca-s6r7f\" (UID: \"ec497417-cb80-4876-9c6a-c922f1a9a1bc\") " pod="openshift-image-registry/node-ca-s6r7f" Sep 16 19:38:47.440804 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.439658 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/86548323-286f-4fad-953a-82adc1a58a0d-iptables-alerter-script\") pod \"iptables-alerter-9zct4\" (UID: \"86548323-286f-4fad-953a-82adc1a58a0d\") " pod="openshift-network-operator/iptables-alerter-9zct4" Sep 16 19:38:47.440804 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.439683 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27c7c9ec-2ec2-4fe5-878e-3ff97368cb96-system-cni-dir\") pod \"multus-additional-cni-plugins-cmmh9\" (UID: \"27c7c9ec-2ec2-4fe5-878e-3ff97368cb96\") " pod="openshift-multus/multus-additional-cni-plugins-cmmh9" Sep 16 19:38:47.440804 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.439702 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm6kr\" (UniqueName: \"kubernetes.io/projected/0b8440ca-9a7a-4106-bfc5-6fb59780fb54-kube-api-access-pm6kr\") pod \"aws-ebs-csi-driver-node-wvpls\" (UID: \"0b8440ca-9a7a-4106-bfc5-6fb59780fb54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvpls" Sep 16 19:38:47.440804 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.439717 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-etc-openvswitch\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.440804 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.439763 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-run-openvswitch\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.440804 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.439912 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-etc-openvswitch\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.440804 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.439936 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-host-run-ovn-kubernetes\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.440804 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.439978 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v982m\" (UniqueName: \"kubernetes.io/projected/aafe6dc2-78c4-4a74-bea1-8b7221c9f467-kube-api-access-v982m\") pod \"network-metrics-daemon-cgqxj\" (UID: \"aafe6dc2-78c4-4a74-bea1-8b7221c9f467\") " pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:38:47.440804 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.440012 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-etc-sysctl-conf\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.440804 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.440042 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-lib-modules\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.440804 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.440075 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vblhh\" (UniqueName: \"kubernetes.io/projected/009f8205-ef6a-41db-b282-7a5bd13dfb9d-kube-api-access-vblhh\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.440804 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.440235 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-host-var-lib-cni-multus\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.440804 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.440271 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-hostroot\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.440804 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.440305 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-host-slash\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.441745 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:47.440385 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aafe6dc2-78c4-4a74-bea1-8b7221c9f467-metrics-certs podName:aafe6dc2-78c4-4a74-bea1-8b7221c9f467 nodeName:}" failed. No retries permitted until 2026-09-16 19:38:47.940336899 +0000 UTC m=+3.040640970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aafe6dc2-78c4-4a74-bea1-8b7221c9f467-metrics-certs") pod "network-metrics-daemon-cgqxj" (UID: "aafe6dc2-78c4-4a74-bea1-8b7221c9f467") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 19:38:47.441745 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.440392 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-host-slash\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.441745 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.440385 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-host-run-ovn-kubernetes\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.441745 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.440418 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmnn4\" (UniqueName: \"kubernetes.io/projected/16907ec1-adc2-4234-b82b-f926dabaa21f-kube-api-access-tmnn4\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.441745 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.440507 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ec497417-cb80-4876-9c6a-c922f1a9a1bc-serviceca\") pod \"node-ca-s6r7f\" (UID: \"ec497417-cb80-4876-9c6a-c922f1a9a1bc\") " pod="openshift-image-registry/node-ca-s6r7f" Sep 16 19:38:47.441745 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.440568 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-run-openvswitch\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.441745 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.440597 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-multus-cni-dir\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.441745 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.440673 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/16907ec1-adc2-4234-b82b-f926dabaa21f-env-overrides\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.441745 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.440729 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-run\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.441745 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.440766 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-var-lib-kubelet\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.441745 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.440794 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27c7c9ec-2ec2-4fe5-878e-3ff97368cb96-cni-binary-copy\") pod \"multus-additional-cni-plugins-cmmh9\" (UID: \"27c7c9ec-2ec2-4fe5-878e-3ff97368cb96\") " pod="openshift-multus/multus-additional-cni-plugins-cmmh9" Sep 16 19:38:47.441745 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.440828 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-host-run-k8s-cni-cncf-io\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.441745 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.440872 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-host-run-netns\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.441745 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.440932 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-var-lib-openvswitch\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.441745 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.440961 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/16907ec1-adc2-4234-b82b-f926dabaa21f-ovnkube-config\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.441745 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.440979 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kcfv\" (UniqueName: \"kubernetes.io/projected/ec497417-cb80-4876-9c6a-c922f1a9a1bc-kube-api-access-2kcfv\") pod \"node-ca-s6r7f\" (UID: \"ec497417-cb80-4876-9c6a-c922f1a9a1bc\") " pod="openshift-image-registry/node-ca-s6r7f" Sep 16 19:38:47.442617 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.441011 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-host-run-netns\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.442617 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.441037 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-var-lib-openvswitch\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.442617 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.441069 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/009f8205-ef6a-41db-b282-7a5bd13dfb9d-etc-tuned\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.442617 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.441104 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/27c7c9ec-2ec2-4fe5-878e-3ff97368cb96-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cmmh9\" (UID: \"27c7c9ec-2ec2-4fe5-878e-3ff97368cb96\") " pod="openshift-multus/multus-additional-cni-plugins-cmmh9" Sep 16 19:38:47.442617 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.441182 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfplr\" (UniqueName: \"kubernetes.io/projected/27c7c9ec-2ec2-4fe5-878e-3ff97368cb96-kube-api-access-bfplr\") pod \"multus-additional-cni-plugins-cmmh9\" (UID: \"27c7c9ec-2ec2-4fe5-878e-3ff97368cb96\") " pod="openshift-multus/multus-additional-cni-plugins-cmmh9" Sep 16 19:38:47.442617 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.441247 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/12edd32e-5262-4839-b280-1decb30891ea-konnectivity-ca\") pod \"konnectivity-agent-qnnzz\" (UID: \"12edd32e-5262-4839-b280-1decb30891ea\") " pod="kube-system/konnectivity-agent-qnnzz" Sep 16 19:38:47.442617 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.441331 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0b8440ca-9a7a-4106-bfc5-6fb59780fb54-registration-dir\") pod \"aws-ebs-csi-driver-node-wvpls\" (UID: \"0b8440ca-9a7a-4106-bfc5-6fb59780fb54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvpls" Sep 16 19:38:47.442617 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.441380 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/009f8205-ef6a-41db-b282-7a5bd13dfb9d-tmp\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.442617 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.441399 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0b8440ca-9a7a-4106-bfc5-6fb59780fb54-registration-dir\") pod \"aws-ebs-csi-driver-node-wvpls\" (UID: \"0b8440ca-9a7a-4106-bfc5-6fb59780fb54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvpls" Sep 16 19:38:47.442617 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.441403 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f11b5a57-9bb4-4b8c-be52-363ccdda5466-kubelet-config\") pod \"global-pull-secret-syncer-5cc8s\" (UID: \"f11b5a57-9bb4-4b8c-be52-363ccdda5466\") " pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:38:47.442617 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.441447 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0b8440ca-9a7a-4106-bfc5-6fb59780fb54-sys-fs\") pod \"aws-ebs-csi-driver-node-wvpls\" (UID: \"0b8440ca-9a7a-4106-bfc5-6fb59780fb54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvpls" Sep 16 19:38:47.442617 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.441485 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/536a4230-7582-4958-9653-31c99fd62796-tmp-dir\") pod \"node-resolver-wf7dr\" (UID: \"536a4230-7582-4958-9653-31c99fd62796\") " pod="openshift-dns/node-resolver-wf7dr" Sep 16 19:38:47.442617 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.441516 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-multus-conf-dir\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.442617 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.441540 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-sys\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.442617 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.441491 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0b8440ca-9a7a-4106-bfc5-6fb59780fb54-sys-fs\") pod \"aws-ebs-csi-driver-node-wvpls\" (UID: \"0b8440ca-9a7a-4106-bfc5-6fb59780fb54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvpls" Sep 16 19:38:47.442617 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.441598 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/12edd32e-5262-4839-b280-1decb30891ea-agent-certs\") pod \"konnectivity-agent-qnnzz\" (UID: \"12edd32e-5262-4839-b280-1decb30891ea\") " pod="kube-system/konnectivity-agent-qnnzz" Sep 16 19:38:47.442617 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.441629 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/16907ec1-adc2-4234-b82b-f926dabaa21f-ovn-node-metrics-cert\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.443497 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.441669 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/16907ec1-adc2-4234-b82b-f926dabaa21f-ovnkube-script-lib\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.443497 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.441692 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-etc-kubernetes\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.443497 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.441716 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-host-cni-bin\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.443497 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.441731 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-host-var-lib-kubelet\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.443497 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.441745 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/536a4230-7582-4958-9653-31c99fd62796-tmp-dir\") pod \"node-resolver-wf7dr\" (UID: \"536a4230-7582-4958-9653-31c99fd62796\") " pod="openshift-dns/node-resolver-wf7dr" Sep 16 19:38:47.443497 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.441757 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86548323-286f-4fad-953a-82adc1a58a0d-host-slash\") pod \"iptables-alerter-9zct4\" (UID: \"86548323-286f-4fad-953a-82adc1a58a0d\") " pod="openshift-network-operator/iptables-alerter-9zct4" Sep 16 19:38:47.443497 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.441802 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-etc-systemd\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.443497 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.441832 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/16907ec1-adc2-4234-b82b-f926dabaa21f-host-cni-bin\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.443497 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.442058 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 16 19:38:47.443497 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.442643 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/16907ec1-adc2-4234-b82b-f926dabaa21f-ovnkube-script-lib\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.446996 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.446971 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/16907ec1-adc2-4234-b82b-f926dabaa21f-ovn-node-metrics-cert\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.449639 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.449618 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8rf6\" (UniqueName: \"kubernetes.io/projected/536a4230-7582-4958-9653-31c99fd62796-kube-api-access-s8rf6\") pod \"node-resolver-wf7dr\" (UID: \"536a4230-7582-4958-9653-31c99fd62796\") " pod="openshift-dns/node-resolver-wf7dr" Sep 16 19:38:47.452552 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.452528 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kcfv\" (UniqueName: \"kubernetes.io/projected/ec497417-cb80-4876-9c6a-c922f1a9a1bc-kube-api-access-2kcfv\") pod \"node-ca-s6r7f\" (UID: \"ec497417-cb80-4876-9c6a-c922f1a9a1bc\") " pod="openshift-image-registry/node-ca-s6r7f" Sep 16 19:38:47.452659 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.452642 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm6kr\" (UniqueName: \"kubernetes.io/projected/0b8440ca-9a7a-4106-bfc5-6fb59780fb54-kube-api-access-pm6kr\") pod \"aws-ebs-csi-driver-node-wvpls\" (UID: \"0b8440ca-9a7a-4106-bfc5-6fb59780fb54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvpls" Sep 16 19:38:47.453204 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.453168 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v982m\" (UniqueName: \"kubernetes.io/projected/aafe6dc2-78c4-4a74-bea1-8b7221c9f467-kube-api-access-v982m\") pod \"network-metrics-daemon-cgqxj\" (UID: \"aafe6dc2-78c4-4a74-bea1-8b7221c9f467\") " pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:38:47.453306 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.453172 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmnn4\" (UniqueName: \"kubernetes.io/projected/16907ec1-adc2-4234-b82b-f926dabaa21f-kube-api-access-tmnn4\") pod \"ovnkube-node-pn7bt\" (UID: \"16907ec1-adc2-4234-b82b-f926dabaa21f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.542451 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.542420 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-multus-conf-dir\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.542603 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.542470 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-sys\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.542603 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.542491 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/12edd32e-5262-4839-b280-1decb30891ea-agent-certs\") pod \"konnectivity-agent-qnnzz\" (UID: \"12edd32e-5262-4839-b280-1decb30891ea\") " pod="kube-system/konnectivity-agent-qnnzz" Sep 16 19:38:47.542603 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.542488 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-multus-conf-dir\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.542603 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.542510 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-etc-kubernetes\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.542603 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.542538 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-host-var-lib-kubelet\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.542603 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.542600 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86548323-286f-4fad-953a-82adc1a58a0d-host-slash\") pod \"iptables-alerter-9zct4\" (UID: \"86548323-286f-4fad-953a-82adc1a58a0d\") " pod="openshift-network-operator/iptables-alerter-9zct4" Sep 16 19:38:47.542863 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.542610 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-etc-kubernetes\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.542863 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.542622 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-sys\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.542863 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.542628 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-etc-systemd\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.542863 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.542673 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86548323-286f-4fad-953a-82adc1a58a0d-host-slash\") pod \"iptables-alerter-9zct4\" (UID: \"86548323-286f-4fad-953a-82adc1a58a0d\") " pod="openshift-network-operator/iptables-alerter-9zct4" Sep 16 19:38:47.542863 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.542681 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-etc-systemd\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.542863 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.542676 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-host-var-lib-kubelet\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.542863 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.542682 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-host-run-multus-certs\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.542863 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.542718 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-host-run-multus-certs\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.542863 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.542722 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbdp9\" (UniqueName: \"kubernetes.io/projected/86548323-286f-4fad-953a-82adc1a58a0d-kube-api-access-bbdp9\") pod \"iptables-alerter-9zct4\" (UID: \"86548323-286f-4fad-953a-82adc1a58a0d\") " pod="openshift-network-operator/iptables-alerter-9zct4" Sep 16 19:38:47.542863 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.542763 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27c7c9ec-2ec2-4fe5-878e-3ff97368cb96-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cmmh9\" (UID: \"27c7c9ec-2ec2-4fe5-878e-3ff97368cb96\") " pod="openshift-multus/multus-additional-cni-plugins-cmmh9" Sep 16 19:38:47.543399 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.542877 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-etc-modprobe-d\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.543399 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.542909 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-etc-sysconfig\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.543399 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.542937 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-host\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.543399 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.542964 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc9cp\" (UniqueName: \"kubernetes.io/projected/1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6-kube-api-access-jc9cp\") pod \"network-check-target-mm5r8\" (UID: \"1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6\") " pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:38:47.543399 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.542991 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e058c38-f126-4835-b2bf-050ea01fc7b5-multus-daemon-config\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.543399 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.542997 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27c7c9ec-2ec2-4fe5-878e-3ff97368cb96-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cmmh9\" (UID: \"27c7c9ec-2ec2-4fe5-878e-3ff97368cb96\") " pod="openshift-multus/multus-additional-cni-plugins-cmmh9" Sep 16 19:38:47.543399 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543021 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-host-var-lib-cni-bin\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.543399 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543026 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-etc-sysconfig\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.543399 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543033 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-etc-modprobe-d\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.543399 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543048 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf4d8\" (UniqueName: \"kubernetes.io/projected/2e058c38-f126-4835-b2bf-050ea01fc7b5-kube-api-access-hf4d8\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.543399 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543088 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-host\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.543399 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543098 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-multus-socket-dir-parent\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.543399 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543125 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/27c7c9ec-2ec2-4fe5-878e-3ff97368cb96-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cmmh9\" (UID: \"27c7c9ec-2ec2-4fe5-878e-3ff97368cb96\") " pod="openshift-multus/multus-additional-cni-plugins-cmmh9" Sep 16 19:38:47.543399 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543152 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f11b5a57-9bb4-4b8c-be52-363ccdda5466-original-pull-secret\") pod \"global-pull-secret-syncer-5cc8s\" (UID: \"f11b5a57-9bb4-4b8c-be52-363ccdda5466\") " pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:38:47.543399 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543198 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-multus-socket-dir-parent\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.543399 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543200 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-system-cni-dir\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.543399 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543249 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27c7c9ec-2ec2-4fe5-878e-3ff97368cb96-cnibin\") pod \"multus-additional-cni-plugins-cmmh9\" (UID: \"27c7c9ec-2ec2-4fe5-878e-3ff97368cb96\") " pod="openshift-multus/multus-additional-cni-plugins-cmmh9" Sep 16 19:38:47.544262 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543278 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-cnibin\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.544262 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543294 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-system-cni-dir\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.544262 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543154 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-host-var-lib-cni-bin\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.544262 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543312 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f11b5a57-9bb4-4b8c-be52-363ccdda5466-dbus\") pod \"global-pull-secret-syncer-5cc8s\" (UID: \"f11b5a57-9bb4-4b8c-be52-363ccdda5466\") " pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:38:47.544262 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543356 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e058c38-f126-4835-b2bf-050ea01fc7b5-cni-binary-copy\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.544262 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543383 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-host-run-netns\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.544262 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543411 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-etc-kubernetes\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.544262 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543433 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-etc-sysctl-d\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.544262 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543461 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/86548323-286f-4fad-953a-82adc1a58a0d-iptables-alerter-script\") pod \"iptables-alerter-9zct4\" (UID: \"86548323-286f-4fad-953a-82adc1a58a0d\") " pod="openshift-network-operator/iptables-alerter-9zct4" Sep 16 19:38:47.544262 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:47.543481 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 19:38:47.544262 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543488 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27c7c9ec-2ec2-4fe5-878e-3ff97368cb96-system-cni-dir\") pod \"multus-additional-cni-plugins-cmmh9\" (UID: \"27c7c9ec-2ec2-4fe5-878e-3ff97368cb96\") " pod="openshift-multus/multus-additional-cni-plugins-cmmh9" Sep 16 19:38:47.544262 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543518 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-etc-sysctl-conf\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.544262 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:47.543550 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f11b5a57-9bb4-4b8c-be52-363ccdda5466-original-pull-secret podName:f11b5a57-9bb4-4b8c-be52-363ccdda5466 nodeName:}" failed. No retries permitted until 2026-09-16 19:38:48.043531841 +0000 UTC m=+3.143835914 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f11b5a57-9bb4-4b8c-be52-363ccdda5466-original-pull-secret") pod "global-pull-secret-syncer-5cc8s" (UID: "f11b5a57-9bb4-4b8c-be52-363ccdda5466") : object "kube-system"/"original-pull-secret" not registered Sep 16 19:38:47.544262 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543575 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-lib-modules\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.544262 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543607 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vblhh\" (UniqueName: \"kubernetes.io/projected/009f8205-ef6a-41db-b282-7a5bd13dfb9d-kube-api-access-vblhh\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.544262 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543622 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e058c38-f126-4835-b2bf-050ea01fc7b5-multus-daemon-config\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.544262 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543635 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-host-var-lib-cni-multus\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.545133 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543643 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-etc-sysctl-conf\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.545133 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543669 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-hostroot\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.545133 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543686 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-host-var-lib-cni-multus\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.545133 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543699 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-multus-cni-dir\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.545133 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543723 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-run\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.545133 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543746 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-var-lib-kubelet\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.545133 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543773 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27c7c9ec-2ec2-4fe5-878e-3ff97368cb96-cni-binary-copy\") pod \"multus-additional-cni-plugins-cmmh9\" (UID: \"27c7c9ec-2ec2-4fe5-878e-3ff97368cb96\") " pod="openshift-multus/multus-additional-cni-plugins-cmmh9" Sep 16 19:38:47.545133 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543800 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-host-run-k8s-cni-cncf-io\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.545133 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543830 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/009f8205-ef6a-41db-b282-7a5bd13dfb9d-etc-tuned\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.545133 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543855 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/27c7c9ec-2ec2-4fe5-878e-3ff97368cb96-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cmmh9\" (UID: \"27c7c9ec-2ec2-4fe5-878e-3ff97368cb96\") " pod="openshift-multus/multus-additional-cni-plugins-cmmh9" Sep 16 19:38:47.545133 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543873 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/27c7c9ec-2ec2-4fe5-878e-3ff97368cb96-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cmmh9\" (UID: \"27c7c9ec-2ec2-4fe5-878e-3ff97368cb96\") " pod="openshift-multus/multus-additional-cni-plugins-cmmh9" Sep 16 19:38:47.545133 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543882 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfplr\" (UniqueName: \"kubernetes.io/projected/27c7c9ec-2ec2-4fe5-878e-3ff97368cb96-kube-api-access-bfplr\") pod \"multus-additional-cni-plugins-cmmh9\" (UID: \"27c7c9ec-2ec2-4fe5-878e-3ff97368cb96\") " pod="openshift-multus/multus-additional-cni-plugins-cmmh9" Sep 16 19:38:47.545133 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543883 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-lib-modules\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.545133 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543953 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27c7c9ec-2ec2-4fe5-878e-3ff97368cb96-cnibin\") pod \"multus-additional-cni-plugins-cmmh9\" (UID: \"27c7c9ec-2ec2-4fe5-878e-3ff97368cb96\") " pod="openshift-multus/multus-additional-cni-plugins-cmmh9" Sep 16 19:38:47.545133 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.543993 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-host-run-k8s-cni-cncf-io\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.545133 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.544038 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-cnibin\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.545133 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.544091 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/12edd32e-5262-4839-b280-1decb30891ea-konnectivity-ca\") pod \"konnectivity-agent-qnnzz\" (UID: \"12edd32e-5262-4839-b280-1decb30891ea\") " pod="kube-system/konnectivity-agent-qnnzz" Sep 16 19:38:47.545813 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.544102 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f11b5a57-9bb4-4b8c-be52-363ccdda5466-dbus\") pod \"global-pull-secret-syncer-5cc8s\" (UID: \"f11b5a57-9bb4-4b8c-be52-363ccdda5466\") " pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:38:47.545813 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.544126 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/009f8205-ef6a-41db-b282-7a5bd13dfb9d-tmp\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.545813 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.544154 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f11b5a57-9bb4-4b8c-be52-363ccdda5466-kubelet-config\") pod \"global-pull-secret-syncer-5cc8s\" (UID: \"f11b5a57-9bb4-4b8c-be52-363ccdda5466\") " pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:38:47.545813 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.544266 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f11b5a57-9bb4-4b8c-be52-363ccdda5466-kubelet-config\") pod \"global-pull-secret-syncer-5cc8s\" (UID: \"f11b5a57-9bb4-4b8c-be52-363ccdda5466\") " pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:38:47.545813 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.544387 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27c7c9ec-2ec2-4fe5-878e-3ff97368cb96-cni-binary-copy\") pod \"multus-additional-cni-plugins-cmmh9\" (UID: \"27c7c9ec-2ec2-4fe5-878e-3ff97368cb96\") " pod="openshift-multus/multus-additional-cni-plugins-cmmh9" Sep 16 19:38:47.545813 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.544445 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-hostroot\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.545813 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.544505 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-multus-cni-dir\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.545813 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.544529 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e058c38-f126-4835-b2bf-050ea01fc7b5-cni-binary-copy\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.545813 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.544552 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-run\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.545813 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.544583 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e058c38-f126-4835-b2bf-050ea01fc7b5-host-run-netns\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.545813 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.544599 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-var-lib-kubelet\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.545813 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.544701 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-etc-sysctl-d\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.545813 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.544748 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/009f8205-ef6a-41db-b282-7a5bd13dfb9d-etc-kubernetes\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.545813 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.544826 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27c7c9ec-2ec2-4fe5-878e-3ff97368cb96-system-cni-dir\") pod \"multus-additional-cni-plugins-cmmh9\" (UID: \"27c7c9ec-2ec2-4fe5-878e-3ff97368cb96\") " pod="openshift-multus/multus-additional-cni-plugins-cmmh9" Sep 16 19:38:47.545813 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.544839 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/12edd32e-5262-4839-b280-1decb30891ea-konnectivity-ca\") pod \"konnectivity-agent-qnnzz\" (UID: \"12edd32e-5262-4839-b280-1decb30891ea\") " pod="kube-system/konnectivity-agent-qnnzz" Sep 16 19:38:47.545813 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.545100 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/27c7c9ec-2ec2-4fe5-878e-3ff97368cb96-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cmmh9\" (UID: \"27c7c9ec-2ec2-4fe5-878e-3ff97368cb96\") " pod="openshift-multus/multus-additional-cni-plugins-cmmh9" Sep 16 19:38:47.545813 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.545317 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/86548323-286f-4fad-953a-82adc1a58a0d-iptables-alerter-script\") pod \"iptables-alerter-9zct4\" (UID: \"86548323-286f-4fad-953a-82adc1a58a0d\") " pod="openshift-network-operator/iptables-alerter-9zct4" Sep 16 19:38:47.546879 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.546419 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/009f8205-ef6a-41db-b282-7a5bd13dfb9d-etc-tuned\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.546879 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.546551 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/12edd32e-5262-4839-b280-1decb30891ea-agent-certs\") pod \"konnectivity-agent-qnnzz\" (UID: \"12edd32e-5262-4839-b280-1decb30891ea\") " pod="kube-system/konnectivity-agent-qnnzz" Sep 16 19:38:47.547340 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.547311 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/009f8205-ef6a-41db-b282-7a5bd13dfb9d-tmp\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.551539 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:47.551518 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 19:38:47.551539 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:47.551540 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 19:38:47.551713 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:47.551551 2577 projected.go:196] Error preparing data for projected volume kube-api-access-jc9cp for pod openshift-network-diagnostics/network-check-target-mm5r8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 19:38:47.551713 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:47.551611 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6-kube-api-access-jc9cp podName:1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6 nodeName:}" failed. No retries permitted until 2026-09-16 19:38:48.051596316 +0000 UTC m=+3.151900390 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jc9cp" (UniqueName: "kubernetes.io/projected/1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6-kube-api-access-jc9cp") pod "network-check-target-mm5r8" (UID: "1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 19:38:47.554503 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.554453 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfplr\" (UniqueName: \"kubernetes.io/projected/27c7c9ec-2ec2-4fe5-878e-3ff97368cb96-kube-api-access-bfplr\") pod \"multus-additional-cni-plugins-cmmh9\" (UID: \"27c7c9ec-2ec2-4fe5-878e-3ff97368cb96\") " pod="openshift-multus/multus-additional-cni-plugins-cmmh9" Sep 16 19:38:47.554761 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.554740 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vblhh\" (UniqueName: \"kubernetes.io/projected/009f8205-ef6a-41db-b282-7a5bd13dfb9d-kube-api-access-vblhh\") pod \"tuned-lgnl8\" (UID: \"009f8205-ef6a-41db-b282-7a5bd13dfb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.555137 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.555112 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbdp9\" (UniqueName: \"kubernetes.io/projected/86548323-286f-4fad-953a-82adc1a58a0d-kube-api-access-bbdp9\") pod \"iptables-alerter-9zct4\" (UID: \"86548323-286f-4fad-953a-82adc1a58a0d\") " pod="openshift-network-operator/iptables-alerter-9zct4" Sep 16 19:38:47.555452 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.555437 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf4d8\" (UniqueName: \"kubernetes.io/projected/2e058c38-f126-4835-b2bf-050ea01fc7b5-kube-api-access-hf4d8\") pod \"multus-qcgh2\" (UID: \"2e058c38-f126-4835-b2bf-050ea01fc7b5\") " pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.631520 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.631489 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s6r7f" Sep 16 19:38:47.642077 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.642050 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvpls" Sep 16 19:38:47.652207 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.652184 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wf7dr" Sep 16 19:38:47.656402 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.656381 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:38:47.663648 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.663632 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qcgh2" Sep 16 19:38:47.672759 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.672738 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9zct4" Sep 16 19:38:47.679840 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.679820 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" Sep 16 19:38:47.686979 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.686963 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qnnzz" Sep 16 19:38:47.691927 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.691908 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cmmh9" Sep 16 19:38:47.947710 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:47.947633 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aafe6dc2-78c4-4a74-bea1-8b7221c9f467-metrics-certs\") pod \"network-metrics-daemon-cgqxj\" (UID: \"aafe6dc2-78c4-4a74-bea1-8b7221c9f467\") " pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:38:47.947860 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:47.947745 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 19:38:47.947860 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:47.947821 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aafe6dc2-78c4-4a74-bea1-8b7221c9f467-metrics-certs podName:aafe6dc2-78c4-4a74-bea1-8b7221c9f467 nodeName:}" failed. No retries permitted until 2026-09-16 19:38:48.947805833 +0000 UTC m=+4.048109888 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aafe6dc2-78c4-4a74-bea1-8b7221c9f467-metrics-certs") pod "network-metrics-daemon-cgqxj" (UID: "aafe6dc2-78c4-4a74-bea1-8b7221c9f467") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 19:38:48.048393 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:48.048361 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f11b5a57-9bb4-4b8c-be52-363ccdda5466-original-pull-secret\") pod \"global-pull-secret-syncer-5cc8s\" (UID: \"f11b5a57-9bb4-4b8c-be52-363ccdda5466\") " pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:38:48.048563 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:48.048475 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 19:38:48.048563 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:48.048537 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f11b5a57-9bb4-4b8c-be52-363ccdda5466-original-pull-secret podName:f11b5a57-9bb4-4b8c-be52-363ccdda5466 nodeName:}" failed. No retries permitted until 2026-09-16 19:38:49.04851673 +0000 UTC m=+4.148820785 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f11b5a57-9bb4-4b8c-be52-363ccdda5466-original-pull-secret") pod "global-pull-secret-syncer-5cc8s" (UID: "f11b5a57-9bb4-4b8c-be52-363ccdda5466") : object "kube-system"/"original-pull-secret" not registered Sep 16 19:38:48.149661 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:48.149622 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc9cp\" (UniqueName: \"kubernetes.io/projected/1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6-kube-api-access-jc9cp\") pod \"network-check-target-mm5r8\" (UID: \"1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6\") " pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:38:48.149846 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:48.149797 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 19:38:48.149846 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:48.149823 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 19:38:48.149846 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:48.149835 2577 projected.go:196] Error preparing data for projected volume kube-api-access-jc9cp for pod openshift-network-diagnostics/network-check-target-mm5r8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 19:38:48.150012 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:48.149905 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6-kube-api-access-jc9cp podName:1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6 nodeName:}" failed. No retries permitted until 2026-09-16 19:38:49.149884758 +0000 UTC m=+4.250188831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jc9cp" (UniqueName: "kubernetes.io/projected/1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6-kube-api-access-jc9cp") pod "network-check-target-mm5r8" (UID: "1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 19:38:48.368872 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:48.368788 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b8440ca_9a7a_4106_bfc5_6fb59780fb54.slice/crio-3448f4ad263ed225c6f0ccaaffa95eda4670f2b63aa275d8a2b1aa7efea0c24a WatchSource:0}: Error finding container 3448f4ad263ed225c6f0ccaaffa95eda4670f2b63aa275d8a2b1aa7efea0c24a: Status 404 returned error can't find the container with id 3448f4ad263ed225c6f0ccaaffa95eda4670f2b63aa275d8a2b1aa7efea0c24a Sep 16 19:38:48.370593 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:48.370406 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e058c38_f126_4835_b2bf_050ea01fc7b5.slice/crio-e6ec91d0eeb0bc7fffbec6523c9c66dc6965c9155e43cc5777a68807adc90e2f WatchSource:0}: Error finding container e6ec91d0eeb0bc7fffbec6523c9c66dc6965c9155e43cc5777a68807adc90e2f: Status 404 returned error can't find the container with id e6ec91d0eeb0bc7fffbec6523c9c66dc6965c9155e43cc5777a68807adc90e2f Sep 16 19:38:48.372372 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:48.372351 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12edd32e_5262_4839_b280_1decb30891ea.slice/crio-12f81f6f4169fee494c5d1a5e0b1acccfe2bb3ee97fbf2d8eb05bd4ffb702cd8 WatchSource:0}: Error finding container 12f81f6f4169fee494c5d1a5e0b1acccfe2bb3ee97fbf2d8eb05bd4ffb702cd8: Status 404 returned error can't find the container with id 12f81f6f4169fee494c5d1a5e0b1acccfe2bb3ee97fbf2d8eb05bd4ffb702cd8 Sep 16 19:38:48.376453 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:48.376411 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod536a4230_7582_4958_9653_31c99fd62796.slice/crio-220d2dfe3c50547d4c2f69907d88929b2cd7b7a891410e17a010195d4e200234 WatchSource:0}: Error finding container 220d2dfe3c50547d4c2f69907d88929b2cd7b7a891410e17a010195d4e200234: Status 404 returned error can't find the container with id 220d2dfe3c50547d4c2f69907d88929b2cd7b7a891410e17a010195d4e200234 Sep 16 19:38:48.378075 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:48.378042 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod009f8205_ef6a_41db_b282_7a5bd13dfb9d.slice/crio-642b01a7c19768fada2ef047d08b25b363fbdf05085abce583d8da21fa15d3a4 WatchSource:0}: Error finding container 642b01a7c19768fada2ef047d08b25b363fbdf05085abce583d8da21fa15d3a4: Status 404 returned error can't find the container with id 642b01a7c19768fada2ef047d08b25b363fbdf05085abce583d8da21fa15d3a4 Sep 16 19:38:48.378810 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:48.378792 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec497417_cb80_4876_9c6a_c922f1a9a1bc.slice/crio-a8590b218bbb953044647150768375b7c138069fafcc4a7904824427f5f58880 WatchSource:0}: Error finding container a8590b218bbb953044647150768375b7c138069fafcc4a7904824427f5f58880: Status 404 returned error can't find the container with id a8590b218bbb953044647150768375b7c138069fafcc4a7904824427f5f58880 Sep 16 19:38:48.380914 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:48.380770 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86548323_286f_4fad_953a_82adc1a58a0d.slice/crio-907704cc7ae25563507f80fac777b9ef25148095df5f2777d5b3e99f46f26312 WatchSource:0}: Error finding container 907704cc7ae25563507f80fac777b9ef25148095df5f2777d5b3e99f46f26312: Status 404 returned error can't find the container with id 907704cc7ae25563507f80fac777b9ef25148095df5f2777d5b3e99f46f26312 Sep 16 19:38:48.381700 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:48.381613 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16907ec1_adc2_4234_b82b_f926dabaa21f.slice/crio-d5dc8e50cd5c360a2304ddc51f5156d41f706f03fd5842cfdab68ee9d3b8758b WatchSource:0}: Error finding container d5dc8e50cd5c360a2304ddc51f5156d41f706f03fd5842cfdab68ee9d3b8758b: Status 404 returned error can't find the container with id d5dc8e50cd5c360a2304ddc51f5156d41f706f03fd5842cfdab68ee9d3b8758b Sep 16 19:38:48.382798 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:48.382732 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 19:33:47 +0000 UTC" deadline="2028-05-22 21:39:42.971961172 +0000 UTC" Sep 16 19:38:48.382798 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:48.382762 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14738h0m54.589203997s" Sep 16 19:38:48.383841 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:38:48.383792 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27c7c9ec_2ec2_4fe5_878e_3ff97368cb96.slice/crio-a6aa86e75d8523d4dc6af56eb501c17b6356b317b797fcad5281a6264d937be3 WatchSource:0}: Error finding container a6aa86e75d8523d4dc6af56eb501c17b6356b317b797fcad5281a6264d937be3: Status 404 returned error can't find the container with id a6aa86e75d8523d4dc6af56eb501c17b6356b317b797fcad5281a6264d937be3 Sep 16 19:38:48.425998 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:48.425959 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:38:48.426112 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:48.426089 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cgqxj" podUID="aafe6dc2-78c4-4a74-bea1-8b7221c9f467" Sep 16 19:38:48.436536 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:48.436502 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wf7dr" event={"ID":"536a4230-7582-4958-9653-31c99fd62796","Type":"ContainerStarted","Data":"220d2dfe3c50547d4c2f69907d88929b2cd7b7a891410e17a010195d4e200234"} Sep 16 19:38:48.440766 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:48.440744 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cmmh9" event={"ID":"27c7c9ec-2ec2-4fe5-878e-3ff97368cb96","Type":"ContainerStarted","Data":"a6aa86e75d8523d4dc6af56eb501c17b6356b317b797fcad5281a6264d937be3"} Sep 16 19:38:48.442205 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:48.442182 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9zct4" event={"ID":"86548323-286f-4fad-953a-82adc1a58a0d","Type":"ContainerStarted","Data":"907704cc7ae25563507f80fac777b9ef25148095df5f2777d5b3e99f46f26312"} Sep 16 19:38:48.450891 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:48.450866 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s6r7f" event={"ID":"ec497417-cb80-4876-9c6a-c922f1a9a1bc","Type":"ContainerStarted","Data":"a8590b218bbb953044647150768375b7c138069fafcc4a7904824427f5f58880"} Sep 16 19:38:48.453285 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:48.453263 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" event={"ID":"009f8205-ef6a-41db-b282-7a5bd13dfb9d","Type":"ContainerStarted","Data":"642b01a7c19768fada2ef047d08b25b363fbdf05085abce583d8da21fa15d3a4"} Sep 16 19:38:48.454799 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:48.454781 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qnnzz" event={"ID":"12edd32e-5262-4839-b280-1decb30891ea","Type":"ContainerStarted","Data":"12f81f6f4169fee494c5d1a5e0b1acccfe2bb3ee97fbf2d8eb05bd4ffb702cd8"} Sep 16 19:38:48.456036 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:48.456009 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qcgh2" event={"ID":"2e058c38-f126-4835-b2bf-050ea01fc7b5","Type":"ContainerStarted","Data":"e6ec91d0eeb0bc7fffbec6523c9c66dc6965c9155e43cc5777a68807adc90e2f"} Sep 16 19:38:48.457352 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:48.457333 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvpls" event={"ID":"0b8440ca-9a7a-4106-bfc5-6fb59780fb54","Type":"ContainerStarted","Data":"3448f4ad263ed225c6f0ccaaffa95eda4670f2b63aa275d8a2b1aa7efea0c24a"} Sep 16 19:38:48.458571 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:48.458547 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" event={"ID":"16907ec1-adc2-4234-b82b-f926dabaa21f","Type":"ContainerStarted","Data":"d5dc8e50cd5c360a2304ddc51f5156d41f706f03fd5842cfdab68ee9d3b8758b"} Sep 16 19:38:48.956704 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:48.956620 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aafe6dc2-78c4-4a74-bea1-8b7221c9f467-metrics-certs\") pod \"network-metrics-daemon-cgqxj\" (UID: \"aafe6dc2-78c4-4a74-bea1-8b7221c9f467\") " pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:38:48.956876 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:48.956802 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 19:38:48.956876 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:48.956871 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aafe6dc2-78c4-4a74-bea1-8b7221c9f467-metrics-certs podName:aafe6dc2-78c4-4a74-bea1-8b7221c9f467 nodeName:}" failed. No retries permitted until 2026-09-16 19:38:50.95685091 +0000 UTC m=+6.057154979 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aafe6dc2-78c4-4a74-bea1-8b7221c9f467-metrics-certs") pod "network-metrics-daemon-cgqxj" (UID: "aafe6dc2-78c4-4a74-bea1-8b7221c9f467") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 19:38:49.058131 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:49.057507 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f11b5a57-9bb4-4b8c-be52-363ccdda5466-original-pull-secret\") pod \"global-pull-secret-syncer-5cc8s\" (UID: \"f11b5a57-9bb4-4b8c-be52-363ccdda5466\") " pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:38:49.058131 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:49.057698 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 19:38:49.058131 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:49.057764 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f11b5a57-9bb4-4b8c-be52-363ccdda5466-original-pull-secret podName:f11b5a57-9bb4-4b8c-be52-363ccdda5466 nodeName:}" failed. No retries permitted until 2026-09-16 19:38:51.05774477 +0000 UTC m=+6.158048830 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f11b5a57-9bb4-4b8c-be52-363ccdda5466-original-pull-secret") pod "global-pull-secret-syncer-5cc8s" (UID: "f11b5a57-9bb4-4b8c-be52-363ccdda5466") : object "kube-system"/"original-pull-secret" not registered Sep 16 19:38:49.158177 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:49.158122 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc9cp\" (UniqueName: \"kubernetes.io/projected/1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6-kube-api-access-jc9cp\") pod \"network-check-target-mm5r8\" (UID: \"1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6\") " pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:38:49.158376 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:49.158357 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 19:38:49.158439 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:49.158384 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 19:38:49.158439 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:49.158397 2577 projected.go:196] Error preparing data for projected volume kube-api-access-jc9cp for pod openshift-network-diagnostics/network-check-target-mm5r8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 19:38:49.158561 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:49.158454 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6-kube-api-access-jc9cp podName:1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6 nodeName:}" failed. No retries permitted until 2026-09-16 19:38:51.158436435 +0000 UTC m=+6.258740504 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jc9cp" (UniqueName: "kubernetes.io/projected/1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6-kube-api-access-jc9cp") pod "network-check-target-mm5r8" (UID: "1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 19:38:49.383326 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:49.383210 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 19:33:47 +0000 UTC" deadline="2028-06-15 19:24:35.015462312 +0000 UTC" Sep 16 19:38:49.383326 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:49.383274 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15311h45m45.632193303s" Sep 16 19:38:49.426503 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:49.426472 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:38:49.426656 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:49.426610 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cc8s" podUID="f11b5a57-9bb4-4b8c-be52-363ccdda5466" Sep 16 19:38:49.427274 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:49.427250 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:38:49.427423 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:49.427373 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm5r8" podUID="1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6" Sep 16 19:38:49.467213 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:49.466684 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-18.ec2.internal" event={"ID":"81eb68d3a2c532023a6d1abc2053e6b2","Type":"ContainerStarted","Data":"2c32aace7733f40f96633c2ed734600598cbed3df80d731a86d019eb5358767a"} Sep 16 19:38:49.482143 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:49.481310 2577 generic.go:356] "Generic (PLEG): container finished" podID="26845c0b3b67ab14283ca3124672441d" containerID="2ee4e90fa6b7f2c2301b07038e7807a355d92951357acb0773d34439b5d12f86" exitCode=0 Sep 16 19:38:49.482143 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:49.481359 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-18.ec2.internal" event={"ID":"26845c0b3b67ab14283ca3124672441d","Type":"ContainerDied","Data":"2ee4e90fa6b7f2c2301b07038e7807a355d92951357acb0773d34439b5d12f86"} Sep 16 19:38:49.483398 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:49.483322 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-18.ec2.internal" podStartSLOduration=2.483303809 podStartE2EDuration="2.483303809s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 19:38:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:38:49.482437959 +0000 UTC m=+4.582742039" watchObservedRunningTime="2026-09-16 19:38:49.483303809 +0000 UTC m=+4.583607891" Sep 16 19:38:50.426573 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:50.426535 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:38:50.427285 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:50.426672 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cgqxj" podUID="aafe6dc2-78c4-4a74-bea1-8b7221c9f467" Sep 16 19:38:50.506275 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:50.506236 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-18.ec2.internal" event={"ID":"26845c0b3b67ab14283ca3124672441d","Type":"ContainerStarted","Data":"581271a88bb28f8797b13c3b0dd75e640a6d67609835d5048ccd1a9113ca3b51"} Sep 16 19:38:50.973114 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:50.972554 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aafe6dc2-78c4-4a74-bea1-8b7221c9f467-metrics-certs\") pod \"network-metrics-daemon-cgqxj\" (UID: \"aafe6dc2-78c4-4a74-bea1-8b7221c9f467\") " pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:38:50.973114 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:50.972733 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 19:38:50.973114 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:50.972791 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aafe6dc2-78c4-4a74-bea1-8b7221c9f467-metrics-certs podName:aafe6dc2-78c4-4a74-bea1-8b7221c9f467 nodeName:}" failed. No retries permitted until 2026-09-16 19:38:54.972772549 +0000 UTC m=+10.073076619 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aafe6dc2-78c4-4a74-bea1-8b7221c9f467-metrics-certs") pod "network-metrics-daemon-cgqxj" (UID: "aafe6dc2-78c4-4a74-bea1-8b7221c9f467") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 19:38:51.073806 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:51.073756 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f11b5a57-9bb4-4b8c-be52-363ccdda5466-original-pull-secret\") pod \"global-pull-secret-syncer-5cc8s\" (UID: \"f11b5a57-9bb4-4b8c-be52-363ccdda5466\") " pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:38:51.073986 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:51.073916 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 19:38:51.073986 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:51.073985 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f11b5a57-9bb4-4b8c-be52-363ccdda5466-original-pull-secret podName:f11b5a57-9bb4-4b8c-be52-363ccdda5466 nodeName:}" failed. No retries permitted until 2026-09-16 19:38:55.073964222 +0000 UTC m=+10.174268301 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f11b5a57-9bb4-4b8c-be52-363ccdda5466-original-pull-secret") pod "global-pull-secret-syncer-5cc8s" (UID: "f11b5a57-9bb4-4b8c-be52-363ccdda5466") : object "kube-system"/"original-pull-secret" not registered Sep 16 19:38:51.174499 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:51.174460 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc9cp\" (UniqueName: \"kubernetes.io/projected/1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6-kube-api-access-jc9cp\") pod \"network-check-target-mm5r8\" (UID: \"1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6\") " pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:38:51.174845 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:51.174691 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 19:38:51.174845 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:51.174716 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 19:38:51.174845 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:51.174731 2577 projected.go:196] Error preparing data for projected volume kube-api-access-jc9cp for pod openshift-network-diagnostics/network-check-target-mm5r8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 19:38:51.174845 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:51.174795 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6-kube-api-access-jc9cp podName:1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6 nodeName:}" failed. No retries permitted until 2026-09-16 19:38:55.174775769 +0000 UTC m=+10.275079849 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jc9cp" (UniqueName: "kubernetes.io/projected/1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6-kube-api-access-jc9cp") pod "network-check-target-mm5r8" (UID: "1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 19:38:51.428983 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:51.428213 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:38:51.428983 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:51.428406 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cc8s" podUID="f11b5a57-9bb4-4b8c-be52-363ccdda5466" Sep 16 19:38:51.428983 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:51.428776 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:38:51.428983 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:51.428870 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm5r8" podUID="1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6" Sep 16 19:38:52.426588 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:52.426548 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:38:52.426772 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:52.426716 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cgqxj" podUID="aafe6dc2-78c4-4a74-bea1-8b7221c9f467" Sep 16 19:38:53.426682 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:53.426419 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:38:53.426682 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:53.426547 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm5r8" podUID="1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6" Sep 16 19:38:53.426682 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:53.426586 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:38:53.426682 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:53.426652 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cc8s" podUID="f11b5a57-9bb4-4b8c-be52-363ccdda5466" Sep 16 19:38:54.426610 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:54.426555 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:38:54.426795 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:54.426707 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cgqxj" podUID="aafe6dc2-78c4-4a74-bea1-8b7221c9f467" Sep 16 19:38:55.007235 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:55.007200 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aafe6dc2-78c4-4a74-bea1-8b7221c9f467-metrics-certs\") pod \"network-metrics-daemon-cgqxj\" (UID: \"aafe6dc2-78c4-4a74-bea1-8b7221c9f467\") " pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:38:55.007445 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:55.007369 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 19:38:55.007520 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:55.007446 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aafe6dc2-78c4-4a74-bea1-8b7221c9f467-metrics-certs podName:aafe6dc2-78c4-4a74-bea1-8b7221c9f467 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:03.007423468 +0000 UTC m=+18.107727534 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aafe6dc2-78c4-4a74-bea1-8b7221c9f467-metrics-certs") pod "network-metrics-daemon-cgqxj" (UID: "aafe6dc2-78c4-4a74-bea1-8b7221c9f467") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 19:38:55.107771 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:55.107730 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f11b5a57-9bb4-4b8c-be52-363ccdda5466-original-pull-secret\") pod \"global-pull-secret-syncer-5cc8s\" (UID: \"f11b5a57-9bb4-4b8c-be52-363ccdda5466\") " pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:38:55.107935 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:55.107871 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 19:38:55.107935 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:55.107916 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f11b5a57-9bb4-4b8c-be52-363ccdda5466-original-pull-secret podName:f11b5a57-9bb4-4b8c-be52-363ccdda5466 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:03.107903004 +0000 UTC m=+18.208207056 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f11b5a57-9bb4-4b8c-be52-363ccdda5466-original-pull-secret") pod "global-pull-secret-syncer-5cc8s" (UID: "f11b5a57-9bb4-4b8c-be52-363ccdda5466") : object "kube-system"/"original-pull-secret" not registered Sep 16 19:38:55.208233 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:55.208186 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc9cp\" (UniqueName: \"kubernetes.io/projected/1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6-kube-api-access-jc9cp\") pod \"network-check-target-mm5r8\" (UID: \"1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6\") " pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:38:55.208395 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:55.208382 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 19:38:55.208454 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:55.208400 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 19:38:55.208454 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:55.208412 2577 projected.go:196] Error preparing data for projected volume kube-api-access-jc9cp for pod openshift-network-diagnostics/network-check-target-mm5r8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 19:38:55.208544 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:55.208465 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6-kube-api-access-jc9cp podName:1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:03.208447586 +0000 UTC m=+18.308751654 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jc9cp" (UniqueName: "kubernetes.io/projected/1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6-kube-api-access-jc9cp") pod "network-check-target-mm5r8" (UID: "1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 19:38:55.429766 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:55.429691 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:38:55.430231 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:55.429839 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cc8s" podUID="f11b5a57-9bb4-4b8c-be52-363ccdda5466" Sep 16 19:38:55.430231 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:55.429857 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:38:55.430231 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:55.429958 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm5r8" podUID="1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6" Sep 16 19:38:56.426473 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:56.426443 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:38:56.426675 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:56.426578 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cgqxj" podUID="aafe6dc2-78c4-4a74-bea1-8b7221c9f467" Sep 16 19:38:57.426470 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:57.426378 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:38:57.426968 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:57.426505 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cc8s" podUID="f11b5a57-9bb4-4b8c-be52-363ccdda5466" Sep 16 19:38:57.427040 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:57.427016 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:38:57.427168 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:57.427133 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm5r8" podUID="1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6" Sep 16 19:38:58.425994 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:58.425965 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:38:58.426154 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:58.426062 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cgqxj" podUID="aafe6dc2-78c4-4a74-bea1-8b7221c9f467" Sep 16 19:38:59.426401 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:59.426369 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:38:59.426833 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:38:59.426443 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:38:59.426833 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:59.426557 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm5r8" podUID="1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6" Sep 16 19:38:59.426833 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:38:59.426699 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cc8s" podUID="f11b5a57-9bb4-4b8c-be52-363ccdda5466" Sep 16 19:39:00.426645 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:00.426572 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:39:00.427058 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:00.426709 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cgqxj" podUID="aafe6dc2-78c4-4a74-bea1-8b7221c9f467" Sep 16 19:39:01.426052 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:01.426020 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:39:01.426257 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:01.426138 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:39:01.426257 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:01.426181 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cc8s" podUID="f11b5a57-9bb4-4b8c-be52-363ccdda5466" Sep 16 19:39:01.426257 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:01.426226 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm5r8" podUID="1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6" Sep 16 19:39:02.426346 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:02.426312 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:39:02.426795 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:02.426450 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cgqxj" podUID="aafe6dc2-78c4-4a74-bea1-8b7221c9f467" Sep 16 19:39:03.065675 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:03.065647 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aafe6dc2-78c4-4a74-bea1-8b7221c9f467-metrics-certs\") pod \"network-metrics-daemon-cgqxj\" (UID: \"aafe6dc2-78c4-4a74-bea1-8b7221c9f467\") " pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:39:03.065853 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:03.065750 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 19:39:03.065853 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:03.065808 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aafe6dc2-78c4-4a74-bea1-8b7221c9f467-metrics-certs podName:aafe6dc2-78c4-4a74-bea1-8b7221c9f467 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:19.065788145 +0000 UTC m=+34.166092203 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aafe6dc2-78c4-4a74-bea1-8b7221c9f467-metrics-certs") pod "network-metrics-daemon-cgqxj" (UID: "aafe6dc2-78c4-4a74-bea1-8b7221c9f467") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 19:39:03.166888 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:03.166855 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f11b5a57-9bb4-4b8c-be52-363ccdda5466-original-pull-secret\") pod \"global-pull-secret-syncer-5cc8s\" (UID: \"f11b5a57-9bb4-4b8c-be52-363ccdda5466\") " pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:39:03.167069 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:03.167019 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 19:39:03.167173 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:03.167085 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f11b5a57-9bb4-4b8c-be52-363ccdda5466-original-pull-secret podName:f11b5a57-9bb4-4b8c-be52-363ccdda5466 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:19.16706571 +0000 UTC m=+34.267369782 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f11b5a57-9bb4-4b8c-be52-363ccdda5466-original-pull-secret") pod "global-pull-secret-syncer-5cc8s" (UID: "f11b5a57-9bb4-4b8c-be52-363ccdda5466") : object "kube-system"/"original-pull-secret" not registered Sep 16 19:39:03.268093 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:03.268055 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc9cp\" (UniqueName: \"kubernetes.io/projected/1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6-kube-api-access-jc9cp\") pod \"network-check-target-mm5r8\" (UID: \"1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6\") " pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:39:03.268251 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:03.268198 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 19:39:03.268251 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:03.268222 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 19:39:03.268251 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:03.268234 2577 projected.go:196] Error preparing data for projected volume kube-api-access-jc9cp for pod openshift-network-diagnostics/network-check-target-mm5r8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 19:39:03.268415 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:03.268293 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6-kube-api-access-jc9cp podName:1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:19.268275884 +0000 UTC m=+34.368579955 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jc9cp" (UniqueName: "kubernetes.io/projected/1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6-kube-api-access-jc9cp") pod "network-check-target-mm5r8" (UID: "1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 19:39:03.426515 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:03.426449 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:39:03.426872 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:03.426449 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:39:03.426872 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:03.426552 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm5r8" podUID="1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6" Sep 16 19:39:03.426872 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:03.426619 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cc8s" podUID="f11b5a57-9bb4-4b8c-be52-363ccdda5466" Sep 16 19:39:04.426392 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:04.426359 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:39:04.426578 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:04.426517 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cgqxj" podUID="aafe6dc2-78c4-4a74-bea1-8b7221c9f467" Sep 16 19:39:05.427478 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:05.427272 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:39:05.427888 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:05.427326 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:39:05.427888 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:05.427551 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cc8s" podUID="f11b5a57-9bb4-4b8c-be52-363ccdda5466" Sep 16 19:39:05.427888 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:05.427614 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm5r8" podUID="1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6" Sep 16 19:39:06.426540 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:06.426510 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:39:06.426715 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:06.426634 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cgqxj" podUID="aafe6dc2-78c4-4a74-bea1-8b7221c9f467" Sep 16 19:39:07.427984 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:07.427956 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:39:07.432542 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:07.428507 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cc8s" podUID="f11b5a57-9bb4-4b8c-be52-363ccdda5466" Sep 16 19:39:07.432542 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:07.428715 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:39:07.432542 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:07.428840 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm5r8" podUID="1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6" Sep 16 19:39:07.548927 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:07.548220 2577 generic.go:356] "Generic (PLEG): container finished" podID="27c7c9ec-2ec2-4fe5-878e-3ff97368cb96" containerID="a0c8acba0731aabca5b11336dacf3926876be95c56b13d68259cdf41449d35e2" exitCode=0 Sep 16 19:39:07.548927 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:07.548302 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cmmh9" event={"ID":"27c7c9ec-2ec2-4fe5-878e-3ff97368cb96","Type":"ContainerDied","Data":"a0c8acba0731aabca5b11336dacf3926876be95c56b13d68259cdf41449d35e2"} Sep 16 19:39:07.550677 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:07.550604 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s6r7f" event={"ID":"ec497417-cb80-4876-9c6a-c922f1a9a1bc","Type":"ContainerStarted","Data":"d929318d9d073b861f0d7d31be32d81d8666972922bed91dbfcd99da1f327b17"} Sep 16 19:39:07.552966 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:07.552933 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" event={"ID":"009f8205-ef6a-41db-b282-7a5bd13dfb9d","Type":"ContainerStarted","Data":"f9ac6fc730a81766c9bc7b02c41379b98a44b83f1113bf590f045cfaf4f4d091"} Sep 16 19:39:07.554843 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:07.554769 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qnnzz" event={"ID":"12edd32e-5262-4839-b280-1decb30891ea","Type":"ContainerStarted","Data":"8d7b40677d3130ac0af58f6dd72564f644b835565841b0acbc57f35496fbc6fc"} Sep 16 19:39:07.556507 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:07.556485 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qcgh2" event={"ID":"2e058c38-f126-4835-b2bf-050ea01fc7b5","Type":"ContainerStarted","Data":"f2ac87afcfc6725b540c40d911189e647a43962b7f5c8ab61f0d7e996f912a19"} Sep 16 19:39:07.560638 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:07.560602 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvpls" event={"ID":"0b8440ca-9a7a-4106-bfc5-6fb59780fb54","Type":"ContainerStarted","Data":"5114a35867776a54554f4c427a1cba2b1139cedca076ec7efe7c2ae61f83abed"} Sep 16 19:39:07.563182 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:07.563163 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" event={"ID":"16907ec1-adc2-4234-b82b-f926dabaa21f","Type":"ContainerStarted","Data":"91f032bca73d826b124153e3678a569768aab67fe01b75973a57cee82fbe692f"} Sep 16 19:39:07.563264 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:07.563223 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" event={"ID":"16907ec1-adc2-4234-b82b-f926dabaa21f","Type":"ContainerStarted","Data":"5651ea3fb3665753c06b617755418d5e36cd497ff3e73605ca39ea5cbb287e98"} Sep 16 19:39:07.564968 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:07.564947 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wf7dr" event={"ID":"536a4230-7582-4958-9653-31c99fd62796","Type":"ContainerStarted","Data":"91e37d3d7ee0dfc4ee5ae38534622f949b9b43a6c5a6ca93f52f6fe1ffdc90c4"} Sep 16 19:39:07.604977 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:07.604935 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-18.ec2.internal" podStartSLOduration=20.604920843 podStartE2EDuration="20.604920843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 19:38:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:38:50.52277295 +0000 UTC m=+5.623077029" watchObservedRunningTime="2026-09-16 19:39:07.604920843 +0000 UTC m=+22.705224917" Sep 16 19:39:07.626631 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:07.626583 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qnnzz" podStartSLOduration=2.858248754 podStartE2EDuration="21.626572353s" totalImagesPullingTime="18.768323599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:38:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:39:07.626386346 +0000 UTC m=+22.726690412" watchObservedRunningTime="2026-09-16 19:39:07.626572353 +0000 UTC m=+22.726876428" Sep 16 19:39:07.645681 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:07.645647 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wf7dr" podStartSLOduration=2.826661908 podStartE2EDuration="21.645636854s" totalImagesPullingTime="18.818974946s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 19:38:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:39:07.64558674 +0000 UTC m=+22.745890815" watchObservedRunningTime="2026-09-16 19:39:07.645636854 +0000 UTC m=+22.745940929" Sep 16 19:39:07.703344 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:07.703311 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qcgh2" podStartSLOduration=2.823636825 podStartE2EDuration="21.703297774s" totalImagesPullingTime="18.879660949s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 19:38:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:39:07.676706238 +0000 UTC m=+22.777010313" watchObservedRunningTime="2026-09-16 19:39:07.703297774 +0000 UTC m=+22.803601845" Sep 16 19:39:07.745672 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:07.745623 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lgnl8" podStartSLOduration=2.9259843290000003 podStartE2EDuration="21.745604616s" totalImagesPullingTime="18.819620287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 19:38:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:39:07.702882052 +0000 UTC m=+22.803186129" watchObservedRunningTime="2026-09-16 19:39:07.745604616 +0000 UTC m=+22.845908692" Sep 16 19:39:07.745826 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:07.745763 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-s6r7f" podStartSLOduration=2.938124187 podStartE2EDuration="21.745755041s" totalImagesPullingTime="18.807630854s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 19:38:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:39:07.745250448 +0000 UTC m=+22.845554522" watchObservedRunningTime="2026-09-16 19:39:07.745755041 +0000 UTC m=+22.846059118" Sep 16 19:39:08.426359 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:08.426317 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:39:08.426526 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:08.426431 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cgqxj" podUID="aafe6dc2-78c4-4a74-bea1-8b7221c9f467" Sep 16 19:39:08.571861 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:08.571826 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" event={"ID":"16907ec1-adc2-4234-b82b-f926dabaa21f","Type":"ContainerStarted","Data":"7b5c16dd8b8d2307702953857d2567f170c7e7d2b553a9b2a6518d4cae84e294"} Sep 16 19:39:08.572715 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:08.571926 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" event={"ID":"16907ec1-adc2-4234-b82b-f926dabaa21f","Type":"ContainerStarted","Data":"c68df6fa612874d3ac6c1983ce6dc3973abc2566be3dec63c05275dba4c2a178"} Sep 16 19:39:08.572715 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:08.571980 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" event={"ID":"16907ec1-adc2-4234-b82b-f926dabaa21f","Type":"ContainerStarted","Data":"8ce9dc941ce6315bb202a6638c39fcb4141fdf432901ede0119828e8884884f5"} Sep 16 19:39:08.572715 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:08.572032 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" event={"ID":"16907ec1-adc2-4234-b82b-f926dabaa21f","Type":"ContainerStarted","Data":"05b01535705f11e44f3d73fb459f1a4179457744f800b91f8356ee8847bcd293"} Sep 16 19:39:09.142083 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:09.142056 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 16 19:39:09.407195 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:09.407019 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-16T19:39:09.142078047Z","UUID":"21cc5177-7d88-4e0c-ad7a-211f51b2f916","Handler":null,"Name":"","Endpoint":""} Sep 16 19:39:09.409011 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:09.408989 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 16 19:39:09.409181 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:09.409020 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 16 19:39:09.426494 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:09.426471 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:39:09.426625 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:09.426497 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:39:09.426625 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:09.426578 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cc8s" podUID="f11b5a57-9bb4-4b8c-be52-363ccdda5466" Sep 16 19:39:09.426734 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:09.426714 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm5r8" podUID="1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6" Sep 16 19:39:09.577144 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:09.576564 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9zct4" event={"ID":"86548323-286f-4fad-953a-82adc1a58a0d","Type":"ContainerStarted","Data":"4383f2d8457e8a24c2ce5fbc1825a436b6869c2d2601bbb8906169cad6106259"} Sep 16 19:39:09.580878 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:09.580817 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvpls" event={"ID":"0b8440ca-9a7a-4106-bfc5-6fb59780fb54","Type":"ContainerStarted","Data":"35dc176c46caef96ab4a69c8ddf07cb21e93087289c8b8b02e2156da806a82c2"} Sep 16 19:39:09.598544 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:09.597754 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9zct4" podStartSLOduration=4.7832856459999995 podStartE2EDuration="23.59773844s" totalImagesPullingTime="18.814452794s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 19:38:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:39:09.597593844 +0000 UTC m=+24.697897923" watchObservedRunningTime="2026-09-16 19:39:09.59773844 +0000 UTC m=+24.698042516" Sep 16 19:39:10.426664 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:10.426425 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:39:10.426811 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:10.426728 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cgqxj" podUID="aafe6dc2-78c4-4a74-bea1-8b7221c9f467" Sep 16 19:39:10.986401 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:10.986368 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qnnzz" Sep 16 19:39:10.987039 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:10.986999 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qnnzz" Sep 16 19:39:11.426044 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:11.425963 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:39:11.426245 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:11.425974 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:39:11.426245 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:11.426079 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm5r8" podUID="1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6" Sep 16 19:39:11.426245 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:11.426183 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cc8s" podUID="f11b5a57-9bb4-4b8c-be52-363ccdda5466" Sep 16 19:39:11.585364 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:11.585334 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qnnzz" Sep 16 19:39:11.585794 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:11.585780 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qnnzz" Sep 16 19:39:12.426580 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:12.426497 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:39:12.426948 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:12.426606 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cgqxj" podUID="aafe6dc2-78c4-4a74-bea1-8b7221c9f467" Sep 16 19:39:12.590341 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:12.590308 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" event={"ID":"16907ec1-adc2-4234-b82b-f926dabaa21f","Type":"ContainerStarted","Data":"33161d50f775315a95181249284abed0896c4dde93cbff792889d98b686acba0"} Sep 16 19:39:12.592175 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:12.592151 2577 generic.go:356] "Generic (PLEG): container finished" podID="27c7c9ec-2ec2-4fe5-878e-3ff97368cb96" containerID="7f815f68eed138d27996323b3fe16a56bb0270daf108dcc0d1a2a2a9230f85f7" exitCode=0 Sep 16 19:39:12.592312 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:12.592224 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cmmh9" event={"ID":"27c7c9ec-2ec2-4fe5-878e-3ff97368cb96","Type":"ContainerDied","Data":"7f815f68eed138d27996323b3fe16a56bb0270daf108dcc0d1a2a2a9230f85f7"} Sep 16 19:39:12.594520 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:12.594497 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvpls" event={"ID":"0b8440ca-9a7a-4106-bfc5-6fb59780fb54","Type":"ContainerStarted","Data":"07f75ab7d0467ac9657e84f575eb382a5ae9c07ac572c2943de2e0f9308c52c7"} Sep 16 19:39:13.426539 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:13.426515 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:39:13.426633 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:13.426514 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:39:13.426955 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:13.426638 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm5r8" podUID="1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6" Sep 16 19:39:13.426955 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:13.426695 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cc8s" podUID="f11b5a57-9bb4-4b8c-be52-363ccdda5466" Sep 16 19:39:13.598829 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:13.598804 2577 generic.go:356] "Generic (PLEG): container finished" podID="27c7c9ec-2ec2-4fe5-878e-3ff97368cb96" containerID="a900afe388fbc695dfc607113e5e84c15e6297f2ae5a9e5cfb0d5f43a8ba58ed" exitCode=0 Sep 16 19:39:13.598936 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:13.598893 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cmmh9" event={"ID":"27c7c9ec-2ec2-4fe5-878e-3ff97368cb96","Type":"ContainerDied","Data":"a900afe388fbc695dfc607113e5e84c15e6297f2ae5a9e5cfb0d5f43a8ba58ed"} Sep 16 19:39:13.630092 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:13.630053 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvpls" podStartSLOduration=4.519638061 podStartE2EDuration="27.63003866s" totalImagesPullingTime="23.110400599s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 19:38:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:39:12.642075984 +0000 UTC m=+27.742380058" watchObservedRunningTime="2026-09-16 19:39:13.63003866 +0000 UTC m=+28.730342735" Sep 16 19:39:14.426568 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:14.426413 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:39:14.426678 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:14.426652 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cgqxj" podUID="aafe6dc2-78c4-4a74-bea1-8b7221c9f467" Sep 16 19:39:14.604636 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:14.604562 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" event={"ID":"16907ec1-adc2-4234-b82b-f926dabaa21f","Type":"ContainerStarted","Data":"6fe9864e189cbe333602efde6c30257acd622aeead75904d8e0cde3261e156d2"} Sep 16 19:39:14.604830 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:14.604810 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:39:14.607175 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:14.607149 2577 generic.go:356] "Generic (PLEG): container finished" podID="27c7c9ec-2ec2-4fe5-878e-3ff97368cb96" containerID="bb8ec6d6eaac23ea537300d35e4a0f03c3aa781194c54f9dc139ffc257a6fae2" exitCode=0 Sep 16 19:39:14.607276 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:14.607192 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cmmh9" event={"ID":"27c7c9ec-2ec2-4fe5-878e-3ff97368cb96","Type":"ContainerDied","Data":"bb8ec6d6eaac23ea537300d35e4a0f03c3aa781194c54f9dc139ffc257a6fae2"} Sep 16 19:39:14.621036 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:14.621017 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:39:14.636944 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:14.636906 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" podStartSLOduration=9.776499057 podStartE2EDuration="28.636894841s" totalImagesPullingTime="18.860395784s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 19:38:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:39:14.636635687 +0000 UTC m=+29.736939763" watchObservedRunningTime="2026-09-16 19:39:14.636894841 +0000 UTC m=+29.737198915" Sep 16 19:39:15.427154 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:15.427121 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:39:15.427738 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:15.427171 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:39:15.427738 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:15.427247 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cc8s" podUID="f11b5a57-9bb4-4b8c-be52-363ccdda5466" Sep 16 19:39:15.427738 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:15.427313 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm5r8" podUID="1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6" Sep 16 19:39:15.610660 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:15.610627 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:39:15.610829 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:15.610750 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:39:15.630094 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:15.630069 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:39:16.055879 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:16.055849 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5cc8s"] Sep 16 19:39:16.056063 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:16.055975 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:39:16.056144 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:16.056091 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cc8s" podUID="f11b5a57-9bb4-4b8c-be52-363ccdda5466" Sep 16 19:39:16.059513 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:16.059491 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cgqxj"] Sep 16 19:39:16.059632 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:16.059602 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:39:16.059696 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:16.059681 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cgqxj" podUID="aafe6dc2-78c4-4a74-bea1-8b7221c9f467" Sep 16 19:39:16.064592 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:16.064377 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mm5r8"] Sep 16 19:39:16.064592 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:16.064468 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:39:16.064592 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:16.064553 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm5r8" podUID="1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6" Sep 16 19:39:17.426265 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:17.426004 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:39:17.426722 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:17.426004 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:39:17.426722 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:17.426384 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cgqxj" podUID="aafe6dc2-78c4-4a74-bea1-8b7221c9f467" Sep 16 19:39:17.426722 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:17.426011 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:39:17.426722 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:17.426437 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cc8s" podUID="f11b5a57-9bb4-4b8c-be52-363ccdda5466" Sep 16 19:39:17.426722 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:17.426515 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm5r8" podUID="1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6" Sep 16 19:39:19.085503 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:19.085470 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aafe6dc2-78c4-4a74-bea1-8b7221c9f467-metrics-certs\") pod \"network-metrics-daemon-cgqxj\" (UID: \"aafe6dc2-78c4-4a74-bea1-8b7221c9f467\") " pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:39:19.085848 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:19.085607 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 19:39:19.085848 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:19.085660 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aafe6dc2-78c4-4a74-bea1-8b7221c9f467-metrics-certs podName:aafe6dc2-78c4-4a74-bea1-8b7221c9f467 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:51.085646248 +0000 UTC m=+66.185950301 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aafe6dc2-78c4-4a74-bea1-8b7221c9f467-metrics-certs") pod "network-metrics-daemon-cgqxj" (UID: "aafe6dc2-78c4-4a74-bea1-8b7221c9f467") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 19:39:19.185733 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:19.185700 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f11b5a57-9bb4-4b8c-be52-363ccdda5466-original-pull-secret\") pod \"global-pull-secret-syncer-5cc8s\" (UID: \"f11b5a57-9bb4-4b8c-be52-363ccdda5466\") " pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:39:19.185890 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:19.185827 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 19:39:19.185890 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:19.185881 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f11b5a57-9bb4-4b8c-be52-363ccdda5466-original-pull-secret podName:f11b5a57-9bb4-4b8c-be52-363ccdda5466 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:51.185864042 +0000 UTC m=+66.286168097 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f11b5a57-9bb4-4b8c-be52-363ccdda5466-original-pull-secret") pod "global-pull-secret-syncer-5cc8s" (UID: "f11b5a57-9bb4-4b8c-be52-363ccdda5466") : object "kube-system"/"original-pull-secret" not registered Sep 16 19:39:19.286079 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:19.286052 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc9cp\" (UniqueName: \"kubernetes.io/projected/1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6-kube-api-access-jc9cp\") pod \"network-check-target-mm5r8\" (UID: \"1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6\") " pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:39:19.286248 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:19.286231 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 19:39:19.286334 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:19.286255 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 19:39:19.286334 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:19.286269 2577 projected.go:196] Error preparing data for projected volume kube-api-access-jc9cp for pod openshift-network-diagnostics/network-check-target-mm5r8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 19:39:19.286421 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:19.286342 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6-kube-api-access-jc9cp podName:1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:51.286321096 +0000 UTC m=+66.386625152 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jc9cp" (UniqueName: "kubernetes.io/projected/1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6-kube-api-access-jc9cp") pod "network-check-target-mm5r8" (UID: "1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 19:39:19.426914 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:19.426889 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:39:19.427022 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:19.426894 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:39:19.427022 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:19.426998 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cgqxj" podUID="aafe6dc2-78c4-4a74-bea1-8b7221c9f467" Sep 16 19:39:19.427022 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:19.427015 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:39:19.427185 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:19.427162 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cc8s" podUID="f11b5a57-9bb4-4b8c-be52-363ccdda5466" Sep 16 19:39:19.427268 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:19.427242 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm5r8" podUID="1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6" Sep 16 19:39:19.621063 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:19.620979 2577 generic.go:356] "Generic (PLEG): container finished" podID="27c7c9ec-2ec2-4fe5-878e-3ff97368cb96" containerID="427f254e64afc5dd7de46965d485ee28a0b7a6a9ef3984c47f8f794c76917376" exitCode=0 Sep 16 19:39:19.621063 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:19.621040 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cmmh9" event={"ID":"27c7c9ec-2ec2-4fe5-878e-3ff97368cb96","Type":"ContainerDied","Data":"427f254e64afc5dd7de46965d485ee28a0b7a6a9ef3984c47f8f794c76917376"} Sep 16 19:39:20.200752 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.200679 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-18.ec2.internal" event="NodeReady" Sep 16 19:39:20.201234 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.200801 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 16 19:39:20.301544 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.301511 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5658b974c6-rr4r4"] Sep 16 19:39:20.317425 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.317400 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:39:20.320923 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.320902 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 16 19:39:20.321332 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.321308 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 16 19:39:20.321460 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.321422 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 16 19:39:20.330514 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.330498 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kxldl\"" Sep 16 19:39:20.338462 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.338439 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5658b974c6-rr4r4"] Sep 16 19:39:20.341508 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.341352 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 16 19:39:20.342315 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.342295 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qpvrx"] Sep 16 19:39:20.358319 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.358244 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-w2xzs"] Sep 16 19:39:20.358319 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.358311 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qpvrx" Sep 16 19:39:20.363135 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.363091 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 16 19:39:20.363262 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.363241 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 16 19:39:20.363567 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.363536 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 16 19:39:20.363682 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.363642 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5qx7q\"" Sep 16 19:39:20.373000 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.372982 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qpvrx"] Sep 16 19:39:20.373080 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.373064 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w2xzs" Sep 16 19:39:20.376251 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.376237 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 16 19:39:20.376664 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.376646 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cl76f\"" Sep 16 19:39:20.376999 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.376988 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 16 19:39:20.380565 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.380549 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w2xzs"] Sep 16 19:39:20.393718 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.393700 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-ca-trust-extracted\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:39:20.393795 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.393737 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-certificates\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:39:20.393795 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.393754 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-bound-sa-token\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:39:20.393795 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.393778 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlnjr\" (UniqueName: \"kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-kube-api-access-xlnjr\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:39:20.393893 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.393834 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-image-registry-private-configuration\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:39:20.393893 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.393868 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-trusted-ca\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:39:20.393893 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.393884 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-tls\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:39:20.393982 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.393908 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-installation-pull-secrets\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:39:20.494660 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.494586 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-installation-pull-secrets\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:39:20.494660 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.494619 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6d003067-b82c-413a-90fc-aa57066de4ae-config-volume\") pod \"dns-default-w2xzs\" (UID: \"6d003067-b82c-413a-90fc-aa57066de4ae\") " pod="openshift-dns/dns-default-w2xzs" Sep 16 19:39:20.494660 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.494636 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d003067-b82c-413a-90fc-aa57066de4ae-metrics-tls\") pod \"dns-default-w2xzs\" (UID: \"6d003067-b82c-413a-90fc-aa57066de4ae\") " pod="openshift-dns/dns-default-w2xzs" Sep 16 19:39:20.494660 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.494652 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whgph\" (UniqueName: \"kubernetes.io/projected/215ea051-bb2b-41c6-b1a0-8984507e2d1c-kube-api-access-whgph\") pod \"ingress-canary-qpvrx\" (UID: \"215ea051-bb2b-41c6-b1a0-8984507e2d1c\") " pod="openshift-ingress-canary/ingress-canary-qpvrx" Sep 16 19:39:20.494966 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.494668 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knt8m\" (UniqueName: \"kubernetes.io/projected/6d003067-b82c-413a-90fc-aa57066de4ae-kube-api-access-knt8m\") pod \"dns-default-w2xzs\" (UID: \"6d003067-b82c-413a-90fc-aa57066de4ae\") " pod="openshift-dns/dns-default-w2xzs" Sep 16 19:39:20.494966 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.494748 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-ca-trust-extracted\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:39:20.494966 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.494788 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d003067-b82c-413a-90fc-aa57066de4ae-tmp-dir\") pod \"dns-default-w2xzs\" (UID: \"6d003067-b82c-413a-90fc-aa57066de4ae\") " pod="openshift-dns/dns-default-w2xzs" Sep 16 19:39:20.494966 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.494828 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-certificates\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:39:20.494966 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.494855 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-bound-sa-token\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:39:20.494966 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.494938 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlnjr\" (UniqueName: \"kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-kube-api-access-xlnjr\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:39:20.495287 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.494971 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/215ea051-bb2b-41c6-b1a0-8984507e2d1c-cert\") pod \"ingress-canary-qpvrx\" (UID: \"215ea051-bb2b-41c6-b1a0-8984507e2d1c\") " pod="openshift-ingress-canary/ingress-canary-qpvrx" Sep 16 19:39:20.495287 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.495016 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-image-registry-private-configuration\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:39:20.495287 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.495094 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-trusted-ca\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:39:20.495287 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.495158 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-tls\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:39:20.495287 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.495159 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-ca-trust-extracted\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:39:20.495287 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:20.495230 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 16 19:39:20.495287 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:20.495246 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5658b974c6-rr4r4: secret "image-registry-tls" not found Sep 16 19:39:20.495569 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:20.495300 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-tls podName:7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:20.995279559 +0000 UTC m=+36.095583614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-tls") pod "image-registry-5658b974c6-rr4r4" (UID: "7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05") : secret "image-registry-tls" not found Sep 16 19:39:20.495569 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.495443 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-certificates\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:39:20.495976 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.495955 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-trusted-ca\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:39:20.498460 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.498436 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-image-registry-private-configuration\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:39:20.498460 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.498444 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-installation-pull-secrets\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:39:20.522563 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.522537 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-bound-sa-token\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:39:20.523460 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.523441 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlnjr\" (UniqueName: \"kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-kube-api-access-xlnjr\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:39:20.533465 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.533405 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qnnzz_12edd32e-5262-4839-b280-1decb30891ea/konnectivity-agent/0.log" limit=1024 Sep 16 19:39:20.596310 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.596282 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/215ea051-bb2b-41c6-b1a0-8984507e2d1c-cert\") pod \"ingress-canary-qpvrx\" (UID: \"215ea051-bb2b-41c6-b1a0-8984507e2d1c\") " pod="openshift-ingress-canary/ingress-canary-qpvrx" Sep 16 19:39:20.596397 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.596366 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6d003067-b82c-413a-90fc-aa57066de4ae-config-volume\") pod \"dns-default-w2xzs\" (UID: \"6d003067-b82c-413a-90fc-aa57066de4ae\") " pod="openshift-dns/dns-default-w2xzs" Sep 16 19:39:20.596397 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.596388 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d003067-b82c-413a-90fc-aa57066de4ae-metrics-tls\") pod \"dns-default-w2xzs\" (UID: \"6d003067-b82c-413a-90fc-aa57066de4ae\") " pod="openshift-dns/dns-default-w2xzs" Sep 16 19:39:20.596508 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.596413 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whgph\" (UniqueName: \"kubernetes.io/projected/215ea051-bb2b-41c6-b1a0-8984507e2d1c-kube-api-access-whgph\") pod \"ingress-canary-qpvrx\" (UID: \"215ea051-bb2b-41c6-b1a0-8984507e2d1c\") " pod="openshift-ingress-canary/ingress-canary-qpvrx" Sep 16 19:39:20.596508 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.596435 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knt8m\" (UniqueName: \"kubernetes.io/projected/6d003067-b82c-413a-90fc-aa57066de4ae-kube-api-access-knt8m\") pod \"dns-default-w2xzs\" (UID: \"6d003067-b82c-413a-90fc-aa57066de4ae\") " pod="openshift-dns/dns-default-w2xzs" Sep 16 19:39:20.596612 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:20.596544 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 19:39:20.596612 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.596568 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d003067-b82c-413a-90fc-aa57066de4ae-tmp-dir\") pod \"dns-default-w2xzs\" (UID: \"6d003067-b82c-413a-90fc-aa57066de4ae\") " pod="openshift-dns/dns-default-w2xzs" Sep 16 19:39:20.596712 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:20.596622 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d003067-b82c-413a-90fc-aa57066de4ae-metrics-tls podName:6d003067-b82c-413a-90fc-aa57066de4ae nodeName:}" failed. No retries permitted until 2026-09-16 19:39:21.096598957 +0000 UTC m=+36.196903013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d003067-b82c-413a-90fc-aa57066de4ae-metrics-tls") pod "dns-default-w2xzs" (UID: "6d003067-b82c-413a-90fc-aa57066de4ae") : secret "dns-default-metrics-tls" not found Sep 16 19:39:20.596851 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.596832 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d003067-b82c-413a-90fc-aa57066de4ae-tmp-dir\") pod \"dns-default-w2xzs\" (UID: \"6d003067-b82c-413a-90fc-aa57066de4ae\") " pod="openshift-dns/dns-default-w2xzs" Sep 16 19:39:20.596966 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.596948 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6d003067-b82c-413a-90fc-aa57066de4ae-config-volume\") pod \"dns-default-w2xzs\" (UID: \"6d003067-b82c-413a-90fc-aa57066de4ae\") " pod="openshift-dns/dns-default-w2xzs" Sep 16 19:39:20.598596 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.598577 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/215ea051-bb2b-41c6-b1a0-8984507e2d1c-cert\") pod \"ingress-canary-qpvrx\" (UID: \"215ea051-bb2b-41c6-b1a0-8984507e2d1c\") " pod="openshift-ingress-canary/ingress-canary-qpvrx" Sep 16 19:39:20.609470 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.609450 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knt8m\" (UniqueName: \"kubernetes.io/projected/6d003067-b82c-413a-90fc-aa57066de4ae-kube-api-access-knt8m\") pod \"dns-default-w2xzs\" (UID: \"6d003067-b82c-413a-90fc-aa57066de4ae\") " pod="openshift-dns/dns-default-w2xzs" Sep 16 19:39:20.610279 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.610259 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whgph\" (UniqueName: \"kubernetes.io/projected/215ea051-bb2b-41c6-b1a0-8984507e2d1c-kube-api-access-whgph\") pod \"ingress-canary-qpvrx\" (UID: \"215ea051-bb2b-41c6-b1a0-8984507e2d1c\") " pod="openshift-ingress-canary/ingress-canary-qpvrx" Sep 16 19:39:20.626772 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.626747 2577 generic.go:356] "Generic (PLEG): container finished" podID="27c7c9ec-2ec2-4fe5-878e-3ff97368cb96" containerID="8b306c165a8a41546657f8e398ea6c73ebf16da12f82a582fa4459b975b3c0e6" exitCode=0 Sep 16 19:39:20.626861 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.626785 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cmmh9" event={"ID":"27c7c9ec-2ec2-4fe5-878e-3ff97368cb96","Type":"ContainerDied","Data":"8b306c165a8a41546657f8e398ea6c73ebf16da12f82a582fa4459b975b3c0e6"} Sep 16 19:39:20.661968 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.661945 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qnnzz_12edd32e-5262-4839-b280-1decb30891ea/konnectivity-agent/0.log" limit=1024 Sep 16 19:39:20.666760 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.666740 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qpvrx" Sep 16 19:39:20.989069 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.988894 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qpvrx"] Sep 16 19:39:20.991980 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:39:20.991953 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod215ea051_bb2b_41c6_b1a0_8984507e2d1c.slice/crio-17c9106e4365571c1a347df9109269a3fd47dd995e31de9de9242f47670fb3fb WatchSource:0}: Error finding container 17c9106e4365571c1a347df9109269a3fd47dd995e31de9de9242f47670fb3fb: Status 404 returned error can't find the container with id 17c9106e4365571c1a347df9109269a3fd47dd995e31de9de9242f47670fb3fb Sep 16 19:39:20.998727 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:20.998709 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-tls\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:39:20.998810 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:20.998800 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 16 19:39:20.998810 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:20.998810 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5658b974c6-rr4r4: secret "image-registry-tls" not found Sep 16 19:39:20.998885 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:20.998850 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-tls podName:7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:21.998837847 +0000 UTC m=+37.099141899 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-tls") pod "image-registry-5658b974c6-rr4r4" (UID: "7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05") : secret "image-registry-tls" not found Sep 16 19:39:21.099141 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:21.099104 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d003067-b82c-413a-90fc-aa57066de4ae-metrics-tls\") pod \"dns-default-w2xzs\" (UID: \"6d003067-b82c-413a-90fc-aa57066de4ae\") " pod="openshift-dns/dns-default-w2xzs" Sep 16 19:39:21.099283 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:21.099266 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 19:39:21.099334 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:21.099321 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d003067-b82c-413a-90fc-aa57066de4ae-metrics-tls podName:6d003067-b82c-413a-90fc-aa57066de4ae nodeName:}" failed. No retries permitted until 2026-09-16 19:39:22.099307756 +0000 UTC m=+37.199611829 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d003067-b82c-413a-90fc-aa57066de4ae-metrics-tls") pod "dns-default-w2xzs" (UID: "6d003067-b82c-413a-90fc-aa57066de4ae") : secret "dns-default-metrics-tls" not found Sep 16 19:39:21.426867 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:21.426794 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:39:21.427495 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:21.426794 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:39:21.427495 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:21.426803 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:39:21.433415 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:21.433393 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 16 19:39:21.433539 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:21.433501 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 16 19:39:21.434992 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:21.434973 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 16 19:39:21.435126 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:21.434995 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xlhjh\"" Sep 16 19:39:21.435126 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:21.435016 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w2mjh\"" Sep 16 19:39:21.435126 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:21.434974 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 16 19:39:21.630537 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:21.630499 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qpvrx" event={"ID":"215ea051-bb2b-41c6-b1a0-8984507e2d1c","Type":"ContainerStarted","Data":"17c9106e4365571c1a347df9109269a3fd47dd995e31de9de9242f47670fb3fb"} Sep 16 19:39:21.634371 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:21.634344 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cmmh9" event={"ID":"27c7c9ec-2ec2-4fe5-878e-3ff97368cb96","Type":"ContainerStarted","Data":"eac923ddafbaeca56c55205f6e41079f90897672b49e33b8a836b102197d63dd"} Sep 16 19:39:21.669051 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:21.668995 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cmmh9" podStartSLOduration=6.458309849 podStartE2EDuration="35.66897664s" totalImagesPullingTime="29.210666791s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 19:38:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:39:21.667302901 +0000 UTC m=+36.767606994" watchObservedRunningTime="2026-09-16 19:39:21.66897664 +0000 UTC m=+36.769280716" Sep 16 19:39:21.796451 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:21.796420 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qnnzz_12edd32e-5262-4839-b280-1decb30891ea/konnectivity-agent/0.log" limit=1024 Sep 16 19:39:21.875005 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:21.874979 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qnnzz_12edd32e-5262-4839-b280-1decb30891ea/konnectivity-agent/0.log" limit=1024 Sep 16 19:39:21.953627 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:21.953585 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qnnzz_12edd32e-5262-4839-b280-1decb30891ea/konnectivity-agent/0.log" limit=1024 Sep 16 19:39:22.006627 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:22.006599 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-tls\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:39:22.006786 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:22.006766 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 16 19:39:22.006840 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:22.006789 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5658b974c6-rr4r4: secret "image-registry-tls" not found Sep 16 19:39:22.006897 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:22.006858 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-tls podName:7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:24.006838745 +0000 UTC m=+39.107142799 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-tls") pod "image-registry-5658b974c6-rr4r4" (UID: "7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05") : secret "image-registry-tls" not found Sep 16 19:39:22.107918 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:22.107834 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d003067-b82c-413a-90fc-aa57066de4ae-metrics-tls\") pod \"dns-default-w2xzs\" (UID: \"6d003067-b82c-413a-90fc-aa57066de4ae\") " pod="openshift-dns/dns-default-w2xzs" Sep 16 19:39:22.108048 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:22.108013 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 19:39:22.108173 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:22.108084 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d003067-b82c-413a-90fc-aa57066de4ae-metrics-tls podName:6d003067-b82c-413a-90fc-aa57066de4ae nodeName:}" failed. No retries permitted until 2026-09-16 19:39:24.108063105 +0000 UTC m=+39.208367159 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d003067-b82c-413a-90fc-aa57066de4ae-metrics-tls") pod "dns-default-w2xzs" (UID: "6d003067-b82c-413a-90fc-aa57066de4ae") : secret "dns-default-metrics-tls" not found Sep 16 19:39:23.641777 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:23.641698 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qpvrx" event={"ID":"215ea051-bb2b-41c6-b1a0-8984507e2d1c","Type":"ContainerStarted","Data":"bfee066b3eafd9f04a2f2029156d0e761a78b03d0f800a116c98bb8740214982"} Sep 16 19:39:23.660279 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:23.660226 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qpvrx" podStartSLOduration=1.27364339 podStartE2EDuration="3.660211881s" totalImagesPullingTime="2.386568491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:39:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:39:23.659829292 +0000 UTC m=+38.760133368" watchObservedRunningTime="2026-09-16 19:39:23.660211881 +0000 UTC m=+38.760515986" Sep 16 19:39:24.023072 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:24.023033 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-tls\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:39:24.023245 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:24.023164 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 16 19:39:24.023245 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:24.023177 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5658b974c6-rr4r4: secret "image-registry-tls" not found Sep 16 19:39:24.023245 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:24.023229 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-tls podName:7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:28.023214809 +0000 UTC m=+43.123518865 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-tls") pod "image-registry-5658b974c6-rr4r4" (UID: "7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05") : secret "image-registry-tls" not found Sep 16 19:39:24.123715 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:24.123686 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d003067-b82c-413a-90fc-aa57066de4ae-metrics-tls\") pod \"dns-default-w2xzs\" (UID: \"6d003067-b82c-413a-90fc-aa57066de4ae\") " pod="openshift-dns/dns-default-w2xzs" Sep 16 19:39:24.123826 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:24.123782 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 19:39:24.123863 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:24.123827 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d003067-b82c-413a-90fc-aa57066de4ae-metrics-tls podName:6d003067-b82c-413a-90fc-aa57066de4ae nodeName:}" failed. No retries permitted until 2026-09-16 19:39:28.123815313 +0000 UTC m=+43.224119365 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d003067-b82c-413a-90fc-aa57066de4ae-metrics-tls") pod "dns-default-w2xzs" (UID: "6d003067-b82c-413a-90fc-aa57066de4ae") : secret "dns-default-metrics-tls" not found Sep 16 19:39:24.590441 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:24.590399 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qnnzz_12edd32e-5262-4839-b280-1decb30891ea/konnectivity-agent/0.log" limit=1024 Sep 16 19:39:24.659450 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:24.659416 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qnnzz_12edd32e-5262-4839-b280-1decb30891ea/konnectivity-agent/0.log" limit=1024 Sep 16 19:39:25.181198 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:25.181026 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qnnzz_12edd32e-5262-4839-b280-1decb30891ea/konnectivity-agent/0.log" limit=1024 Sep 16 19:39:25.250957 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:25.250930 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qnnzz_12edd32e-5262-4839-b280-1decb30891ea/konnectivity-agent/0.log" limit=1024 Sep 16 19:39:28.050314 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:28.050270 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-tls\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:39:28.050789 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:28.050398 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 16 19:39:28.050789 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:28.050411 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5658b974c6-rr4r4: secret "image-registry-tls" not found Sep 16 19:39:28.050789 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:28.050471 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-tls podName:7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:36.050453097 +0000 UTC m=+51.150757155 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-tls") pod "image-registry-5658b974c6-rr4r4" (UID: "7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05") : secret "image-registry-tls" not found Sep 16 19:39:28.151343 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:28.151312 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d003067-b82c-413a-90fc-aa57066de4ae-metrics-tls\") pod \"dns-default-w2xzs\" (UID: \"6d003067-b82c-413a-90fc-aa57066de4ae\") " pod="openshift-dns/dns-default-w2xzs" Sep 16 19:39:28.151461 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:28.151421 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 19:39:28.151498 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:28.151472 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d003067-b82c-413a-90fc-aa57066de4ae-metrics-tls podName:6d003067-b82c-413a-90fc-aa57066de4ae nodeName:}" failed. No retries permitted until 2026-09-16 19:39:36.151458418 +0000 UTC m=+51.251762471 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d003067-b82c-413a-90fc-aa57066de4ae-metrics-tls") pod "dns-default-w2xzs" (UID: "6d003067-b82c-413a-90fc-aa57066de4ae") : secret "dns-default-metrics-tls" not found Sep 16 19:39:36.101763 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:36.101731 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-tls\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:39:36.102151 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:36.101900 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 16 19:39:36.102151 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:36.101914 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5658b974c6-rr4r4: secret "image-registry-tls" not found Sep 16 19:39:36.102151 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:36.101962 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-tls podName:7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:52.101947773 +0000 UTC m=+67.202251825 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-tls") pod "image-registry-5658b974c6-rr4r4" (UID: "7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05") : secret "image-registry-tls" not found Sep 16 19:39:36.202714 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:36.202684 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d003067-b82c-413a-90fc-aa57066de4ae-metrics-tls\") pod \"dns-default-w2xzs\" (UID: \"6d003067-b82c-413a-90fc-aa57066de4ae\") " pod="openshift-dns/dns-default-w2xzs" Sep 16 19:39:36.202846 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:36.202775 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 19:39:36.202846 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:36.202822 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d003067-b82c-413a-90fc-aa57066de4ae-metrics-tls podName:6d003067-b82c-413a-90fc-aa57066de4ae nodeName:}" failed. No retries permitted until 2026-09-16 19:39:52.202809268 +0000 UTC m=+67.303113322 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d003067-b82c-413a-90fc-aa57066de4ae-metrics-tls") pod "dns-default-w2xzs" (UID: "6d003067-b82c-413a-90fc-aa57066de4ae") : secret "dns-default-metrics-tls" not found Sep 16 19:39:47.624496 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:47.624463 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pn7bt" Sep 16 19:39:51.100885 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:51.100841 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aafe6dc2-78c4-4a74-bea1-8b7221c9f467-metrics-certs\") pod \"network-metrics-daemon-cgqxj\" (UID: \"aafe6dc2-78c4-4a74-bea1-8b7221c9f467\") " pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:39:51.104490 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:51.104463 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 16 19:39:51.111168 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:51.111146 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 16 19:39:51.111247 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:51.111219 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aafe6dc2-78c4-4a74-bea1-8b7221c9f467-metrics-certs podName:aafe6dc2-78c4-4a74-bea1-8b7221c9f467 nodeName:}" failed. No retries permitted until 2026-09-16 19:40:55.111201281 +0000 UTC m=+130.211505335 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aafe6dc2-78c4-4a74-bea1-8b7221c9f467-metrics-certs") pod "network-metrics-daemon-cgqxj" (UID: "aafe6dc2-78c4-4a74-bea1-8b7221c9f467") : secret "metrics-daemon-secret" not found Sep 16 19:39:51.201631 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:51.201601 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f11b5a57-9bb4-4b8c-be52-363ccdda5466-original-pull-secret\") pod \"global-pull-secret-syncer-5cc8s\" (UID: \"f11b5a57-9bb4-4b8c-be52-363ccdda5466\") " pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:39:51.204623 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:51.204606 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 16 19:39:51.215997 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:51.215962 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f11b5a57-9bb4-4b8c-be52-363ccdda5466-original-pull-secret\") pod \"global-pull-secret-syncer-5cc8s\" (UID: \"f11b5a57-9bb4-4b8c-be52-363ccdda5466\") " pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:39:51.302463 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:51.302437 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc9cp\" (UniqueName: \"kubernetes.io/projected/1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6-kube-api-access-jc9cp\") pod \"network-check-target-mm5r8\" (UID: \"1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6\") " pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:39:51.305733 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:51.305717 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 16 19:39:51.316475 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:51.316456 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 16 19:39:51.326815 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:51.326792 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc9cp\" (UniqueName: \"kubernetes.io/projected/1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6-kube-api-access-jc9cp\") pod \"network-check-target-mm5r8\" (UID: \"1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6\") " pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:39:51.436294 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:51.436246 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cc8s" Sep 16 19:39:51.450264 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:51.450244 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w2mjh\"" Sep 16 19:39:51.457702 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:51.457683 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:39:51.711288 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:51.711213 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5cc8s"] Sep 16 19:39:51.713621 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:39:51.713598 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf11b5a57_9bb4_4b8c_be52_363ccdda5466.slice/crio-14dc9a0dff1a637cff062d0ad00a1668ce86b16f0cafa46459c7dca09ec57700 WatchSource:0}: Error finding container 14dc9a0dff1a637cff062d0ad00a1668ce86b16f0cafa46459c7dca09ec57700: Status 404 returned error can't find the container with id 14dc9a0dff1a637cff062d0ad00a1668ce86b16f0cafa46459c7dca09ec57700 Sep 16 19:39:51.734163 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:51.734142 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mm5r8"] Sep 16 19:39:51.736604 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:39:51.736584 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fbf0dcd_d783_4d6c_abe8_ad8250e25bf6.slice/crio-b9940878ec85a2cffc10317d7c07baaaefb9890c8fde368dd334bb5c0dd073da WatchSource:0}: Error finding container b9940878ec85a2cffc10317d7c07baaaefb9890c8fde368dd334bb5c0dd073da: Status 404 returned error can't find the container with id b9940878ec85a2cffc10317d7c07baaaefb9890c8fde368dd334bb5c0dd073da Sep 16 19:39:52.106757 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:52.106727 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-tls\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:39:52.107232 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:52.106865 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 16 19:39:52.107232 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:52.106878 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5658b974c6-rr4r4: secret "image-registry-tls" not found Sep 16 19:39:52.107232 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:52.106942 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-tls podName:7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05 nodeName:}" failed. No retries permitted until 2026-09-16 19:40:24.106926769 +0000 UTC m=+99.207230844 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-tls") pod "image-registry-5658b974c6-rr4r4" (UID: "7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05") : secret "image-registry-tls" not found Sep 16 19:39:52.207876 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:52.207836 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d003067-b82c-413a-90fc-aa57066de4ae-metrics-tls\") pod \"dns-default-w2xzs\" (UID: \"6d003067-b82c-413a-90fc-aa57066de4ae\") " pod="openshift-dns/dns-default-w2xzs" Sep 16 19:39:52.208027 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:52.207992 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 19:39:52.208093 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:39:52.208059 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d003067-b82c-413a-90fc-aa57066de4ae-metrics-tls podName:6d003067-b82c-413a-90fc-aa57066de4ae nodeName:}" failed. No retries permitted until 2026-09-16 19:40:24.208040877 +0000 UTC m=+99.308344936 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d003067-b82c-413a-90fc-aa57066de4ae-metrics-tls") pod "dns-default-w2xzs" (UID: "6d003067-b82c-413a-90fc-aa57066de4ae") : secret "dns-default-metrics-tls" not found Sep 16 19:39:52.709489 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:52.709445 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mm5r8" event={"ID":"1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6","Type":"ContainerStarted","Data":"b9940878ec85a2cffc10317d7c07baaaefb9890c8fde368dd334bb5c0dd073da"} Sep 16 19:39:52.710944 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:52.710888 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5cc8s" event={"ID":"f11b5a57-9bb4-4b8c-be52-363ccdda5466","Type":"ContainerStarted","Data":"14dc9a0dff1a637cff062d0ad00a1668ce86b16f0cafa46459c7dca09ec57700"} Sep 16 19:39:56.722834 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:56.722794 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5cc8s" event={"ID":"f11b5a57-9bb4-4b8c-be52-363ccdda5466","Type":"ContainerStarted","Data":"932d920dbb7f3db19df2dbcaa9275275c09d40152aa5db8b2399aff703c67b4e"} Sep 16 19:39:56.724330 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:56.724307 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mm5r8" event={"ID":"1fbf0dcd-d783-4d6c-abe8-ad8250e25bf6","Type":"ContainerStarted","Data":"3a9cc54063b0e0fd926b4deb615b1aae3e24d2f250db81c868669ce04cfa912b"} Sep 16 19:39:56.724457 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:56.724440 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:39:56.744607 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:56.744564 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5cc8s" podStartSLOduration=66.438404796 podStartE2EDuration="1m10.744551695s" totalImagesPullingTime="4.306146899s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 19:38:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:39:56.743430796 +0000 UTC m=+71.843734870" watchObservedRunningTime="2026-09-16 19:39:56.744551695 +0000 UTC m=+71.844855817" Sep 16 19:39:56.762364 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:39:56.762325 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mm5r8" podStartSLOduration=66.482937055 podStartE2EDuration="1m10.762311365s" totalImagesPullingTime="4.27937431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:38:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:39:56.761721702 +0000 UTC m=+71.862025776" watchObservedRunningTime="2026-09-16 19:39:56.762311365 +0000 UTC m=+71.862615440" Sep 16 19:40:24.114884 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:24.114836 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-tls\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:40:24.115382 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:24.114986 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 16 19:40:24.115382 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:24.115006 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5658b974c6-rr4r4: secret "image-registry-tls" not found Sep 16 19:40:24.115382 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:24.115065 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-tls podName:7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:28.115047003 +0000 UTC m=+163.215351067 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-tls") pod "image-registry-5658b974c6-rr4r4" (UID: "7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05") : secret "image-registry-tls" not found Sep 16 19:40:24.215740 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:24.215721 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d003067-b82c-413a-90fc-aa57066de4ae-metrics-tls\") pod \"dns-default-w2xzs\" (UID: \"6d003067-b82c-413a-90fc-aa57066de4ae\") " pod="openshift-dns/dns-default-w2xzs" Sep 16 19:40:24.215860 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:24.215814 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 19:40:24.215897 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:24.215870 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d003067-b82c-413a-90fc-aa57066de4ae-metrics-tls podName:6d003067-b82c-413a-90fc-aa57066de4ae nodeName:}" failed. No retries permitted until 2026-09-16 19:41:28.215857891 +0000 UTC m=+163.316161944 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d003067-b82c-413a-90fc-aa57066de4ae-metrics-tls") pod "dns-default-w2xzs" (UID: "6d003067-b82c-413a-90fc-aa57066de4ae") : secret "dns-default-metrics-tls" not found Sep 16 19:40:27.730197 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:27.730163 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mm5r8" Sep 16 19:40:36.557497 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.557466 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7jksn"] Sep 16 19:40:36.560269 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.560251 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-4sf5n"] Sep 16 19:40:36.560415 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.560393 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7jksn" Sep 16 19:40:36.563210 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.563189 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4sf5n" Sep 16 19:40:36.563583 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.563556 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 16 19:40:36.563691 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.563597 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 16 19:40:36.563691 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.563675 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-44rsp\"" Sep 16 19:40:36.563895 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.563878 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 16 19:40:36.568912 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.568892 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 16 19:40:36.569011 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.568957 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 16 19:40:36.569102 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.569084 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 16 19:40:36.569192 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.569087 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fzd5t\"" Sep 16 19:40:36.569192 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.569185 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 16 19:40:36.579618 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.579598 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7jksn"] Sep 16 19:40:36.583605 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.583585 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-4sf5n"] Sep 16 19:40:36.597126 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.597091 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5966b9c9-7dcb-4ede-8218-fc03464cf1a2-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-7jksn\" (UID: \"5966b9c9-7dcb-4ede-8218-fc03464cf1a2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7jksn" Sep 16 19:40:36.597210 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.597138 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/700069ae-01f3-4f93-b0df-1c60a7dadf04-serving-cert\") pod \"service-ca-operator-cf7c776b7-4sf5n\" (UID: \"700069ae-01f3-4f93-b0df-1c60a7dadf04\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4sf5n" Sep 16 19:40:36.597210 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.597164 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9wjp\" (UniqueName: \"kubernetes.io/projected/5966b9c9-7dcb-4ede-8218-fc03464cf1a2-kube-api-access-t9wjp\") pod \"cluster-samples-operator-86499c89c4-7jksn\" (UID: \"5966b9c9-7dcb-4ede-8218-fc03464cf1a2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7jksn" Sep 16 19:40:36.597210 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.597196 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/700069ae-01f3-4f93-b0df-1c60a7dadf04-config\") pod \"service-ca-operator-cf7c776b7-4sf5n\" (UID: \"700069ae-01f3-4f93-b0df-1c60a7dadf04\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4sf5n" Sep 16 19:40:36.597324 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.597212 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9d55\" (UniqueName: \"kubernetes.io/projected/700069ae-01f3-4f93-b0df-1c60a7dadf04-kube-api-access-z9d55\") pod \"service-ca-operator-cf7c776b7-4sf5n\" (UID: \"700069ae-01f3-4f93-b0df-1c60a7dadf04\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4sf5n" Sep 16 19:40:36.683237 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.683213 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-2pkpz"] Sep 16 19:40:36.685873 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.685860 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-2pkpz" Sep 16 19:40:36.690656 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.690638 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 16 19:40:36.691038 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.691021 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-2w696\"" Sep 16 19:40:36.691088 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.691039 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 16 19:40:36.697425 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.697408 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/700069ae-01f3-4f93-b0df-1c60a7dadf04-serving-cert\") pod \"service-ca-operator-cf7c776b7-4sf5n\" (UID: \"700069ae-01f3-4f93-b0df-1c60a7dadf04\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4sf5n" Sep 16 19:40:36.697503 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.697437 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9wjp\" (UniqueName: \"kubernetes.io/projected/5966b9c9-7dcb-4ede-8218-fc03464cf1a2-kube-api-access-t9wjp\") pod \"cluster-samples-operator-86499c89c4-7jksn\" (UID: \"5966b9c9-7dcb-4ede-8218-fc03464cf1a2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7jksn" Sep 16 19:40:36.697503 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.697477 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/700069ae-01f3-4f93-b0df-1c60a7dadf04-config\") pod \"service-ca-operator-cf7c776b7-4sf5n\" (UID: \"700069ae-01f3-4f93-b0df-1c60a7dadf04\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4sf5n" Sep 16 19:40:36.697503 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.697500 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9d55\" (UniqueName: \"kubernetes.io/projected/700069ae-01f3-4f93-b0df-1c60a7dadf04-kube-api-access-z9d55\") pod \"service-ca-operator-cf7c776b7-4sf5n\" (UID: \"700069ae-01f3-4f93-b0df-1c60a7dadf04\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4sf5n" Sep 16 19:40:36.697627 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.697553 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5966b9c9-7dcb-4ede-8218-fc03464cf1a2-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-7jksn\" (UID: \"5966b9c9-7dcb-4ede-8218-fc03464cf1a2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7jksn" Sep 16 19:40:36.697735 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:36.697647 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 16 19:40:36.697735 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:36.697707 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5966b9c9-7dcb-4ede-8218-fc03464cf1a2-samples-operator-tls podName:5966b9c9-7dcb-4ede-8218-fc03464cf1a2 nodeName:}" failed. No retries permitted until 2026-09-16 19:40:37.197690495 +0000 UTC m=+112.297994565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5966b9c9-7dcb-4ede-8218-fc03464cf1a2-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-7jksn" (UID: "5966b9c9-7dcb-4ede-8218-fc03464cf1a2") : secret "samples-operator-tls" not found Sep 16 19:40:36.697980 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.697963 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/700069ae-01f3-4f93-b0df-1c60a7dadf04-config\") pod \"service-ca-operator-cf7c776b7-4sf5n\" (UID: \"700069ae-01f3-4f93-b0df-1c60a7dadf04\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4sf5n" Sep 16 19:40:36.699689 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.699672 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/700069ae-01f3-4f93-b0df-1c60a7dadf04-serving-cert\") pod \"service-ca-operator-cf7c776b7-4sf5n\" (UID: \"700069ae-01f3-4f93-b0df-1c60a7dadf04\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4sf5n" Sep 16 19:40:36.704457 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.704435 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-2pkpz"] Sep 16 19:40:36.713276 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.713257 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9wjp\" (UniqueName: \"kubernetes.io/projected/5966b9c9-7dcb-4ede-8218-fc03464cf1a2-kube-api-access-t9wjp\") pod \"cluster-samples-operator-86499c89c4-7jksn\" (UID: \"5966b9c9-7dcb-4ede-8218-fc03464cf1a2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7jksn" Sep 16 19:40:36.718343 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.718307 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9d55\" (UniqueName: \"kubernetes.io/projected/700069ae-01f3-4f93-b0df-1c60a7dadf04-kube-api-access-z9d55\") pod \"service-ca-operator-cf7c776b7-4sf5n\" (UID: \"700069ae-01f3-4f93-b0df-1c60a7dadf04\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4sf5n" Sep 16 19:40:36.798594 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.798567 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfpmf\" (UniqueName: \"kubernetes.io/projected/21cffa90-b1d0-4c97-ab6f-04de94a0eb32-kube-api-access-hfpmf\") pod \"volume-data-source-validator-86695b7cc7-2pkpz\" (UID: \"21cffa90-b1d0-4c97-ab6f-04de94a0eb32\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-2pkpz" Sep 16 19:40:36.875647 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.875575 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4sf5n" Sep 16 19:40:36.899839 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.899816 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfpmf\" (UniqueName: \"kubernetes.io/projected/21cffa90-b1d0-4c97-ab6f-04de94a0eb32-kube-api-access-hfpmf\") pod \"volume-data-source-validator-86695b7cc7-2pkpz\" (UID: \"21cffa90-b1d0-4c97-ab6f-04de94a0eb32\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-2pkpz" Sep 16 19:40:36.909392 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.909367 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfpmf\" (UniqueName: \"kubernetes.io/projected/21cffa90-b1d0-4c97-ab6f-04de94a0eb32-kube-api-access-hfpmf\") pod \"volume-data-source-validator-86695b7cc7-2pkpz\" (UID: \"21cffa90-b1d0-4c97-ab6f-04de94a0eb32\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-2pkpz" Sep 16 19:40:36.993576 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:36.993553 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-2pkpz" Sep 16 19:40:37.163048 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:37.162986 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-4sf5n"] Sep 16 19:40:37.166593 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:40:37.166569 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod700069ae_01f3_4f93_b0df_1c60a7dadf04.slice/crio-479419e0b48580afd626dbf12b187ecd72a2634720263fe4550c3b505c5931d4 WatchSource:0}: Error finding container 479419e0b48580afd626dbf12b187ecd72a2634720263fe4550c3b505c5931d4: Status 404 returned error can't find the container with id 479419e0b48580afd626dbf12b187ecd72a2634720263fe4550c3b505c5931d4 Sep 16 19:40:37.201933 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:37.201908 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5966b9c9-7dcb-4ede-8218-fc03464cf1a2-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-7jksn\" (UID: \"5966b9c9-7dcb-4ede-8218-fc03464cf1a2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7jksn" Sep 16 19:40:37.202021 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:37.202010 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 16 19:40:37.202192 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:37.202063 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5966b9c9-7dcb-4ede-8218-fc03464cf1a2-samples-operator-tls podName:5966b9c9-7dcb-4ede-8218-fc03464cf1a2 nodeName:}" failed. No retries permitted until 2026-09-16 19:40:38.202045586 +0000 UTC m=+113.302349641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5966b9c9-7dcb-4ede-8218-fc03464cf1a2-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-7jksn" (UID: "5966b9c9-7dcb-4ede-8218-fc03464cf1a2") : secret "samples-operator-tls" not found Sep 16 19:40:37.269287 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:37.269266 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-2pkpz"] Sep 16 19:40:37.271178 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:40:37.271149 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21cffa90_b1d0_4c97_ab6f_04de94a0eb32.slice/crio-3b0ec1113c31352f73e2175a646dccd3ed302abdb2d9688ef9e5e6234fb04231 WatchSource:0}: Error finding container 3b0ec1113c31352f73e2175a646dccd3ed302abdb2d9688ef9e5e6234fb04231: Status 404 returned error can't find the container with id 3b0ec1113c31352f73e2175a646dccd3ed302abdb2d9688ef9e5e6234fb04231 Sep 16 19:40:37.823758 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:37.823718 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4sf5n" event={"ID":"700069ae-01f3-4f93-b0df-1c60a7dadf04","Type":"ContainerStarted","Data":"479419e0b48580afd626dbf12b187ecd72a2634720263fe4550c3b505c5931d4"} Sep 16 19:40:37.825126 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:37.825072 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-2pkpz" event={"ID":"21cffa90-b1d0-4c97-ab6f-04de94a0eb32","Type":"ContainerStarted","Data":"3b0ec1113c31352f73e2175a646dccd3ed302abdb2d9688ef9e5e6234fb04231"} Sep 16 19:40:38.207146 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:38.207041 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5966b9c9-7dcb-4ede-8218-fc03464cf1a2-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-7jksn\" (UID: \"5966b9c9-7dcb-4ede-8218-fc03464cf1a2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7jksn" Sep 16 19:40:38.207302 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:38.207198 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 16 19:40:38.207302 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:38.207267 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5966b9c9-7dcb-4ede-8218-fc03464cf1a2-samples-operator-tls podName:5966b9c9-7dcb-4ede-8218-fc03464cf1a2 nodeName:}" failed. No retries permitted until 2026-09-16 19:40:40.207247768 +0000 UTC m=+115.307551834 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5966b9c9-7dcb-4ede-8218-fc03464cf1a2-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-7jksn" (UID: "5966b9c9-7dcb-4ede-8218-fc03464cf1a2") : secret "samples-operator-tls" not found Sep 16 19:40:38.383666 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:38.383623 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-9n6z5"] Sep 16 19:40:38.386685 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:38.386657 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-9n6z5" Sep 16 19:40:38.389813 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:38.389790 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-w5f9p\"" Sep 16 19:40:38.398056 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:38.398032 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-9n6z5"] Sep 16 19:40:38.408245 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:38.408215 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r8pb\" (UniqueName: \"kubernetes.io/projected/643260a5-3819-43ab-80ae-329335369efe-kube-api-access-8r8pb\") pod \"network-check-source-6f8b768455-9n6z5\" (UID: \"643260a5-3819-43ab-80ae-329335369efe\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-9n6z5" Sep 16 19:40:38.509145 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:38.509053 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r8pb\" (UniqueName: \"kubernetes.io/projected/643260a5-3819-43ab-80ae-329335369efe-kube-api-access-8r8pb\") pod \"network-check-source-6f8b768455-9n6z5\" (UID: \"643260a5-3819-43ab-80ae-329335369efe\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-9n6z5" Sep 16 19:40:38.524064 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:38.524038 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r8pb\" (UniqueName: \"kubernetes.io/projected/643260a5-3819-43ab-80ae-329335369efe-kube-api-access-8r8pb\") pod \"network-check-source-6f8b768455-9n6z5\" (UID: \"643260a5-3819-43ab-80ae-329335369efe\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-9n6z5" Sep 16 19:40:38.697627 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:38.697590 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-9n6z5" Sep 16 19:40:39.606770 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:39.606691 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-9n6z5"] Sep 16 19:40:39.609491 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:40:39.609459 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod643260a5_3819_43ab_80ae_329335369efe.slice/crio-9855f2190d07b90d1c5b41639a9b319181f850be8345de8eb77c218eeba0f50e WatchSource:0}: Error finding container 9855f2190d07b90d1c5b41639a9b319181f850be8345de8eb77c218eeba0f50e: Status 404 returned error can't find the container with id 9855f2190d07b90d1c5b41639a9b319181f850be8345de8eb77c218eeba0f50e Sep 16 19:40:39.832298 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:39.832262 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-2pkpz" event={"ID":"21cffa90-b1d0-4c97-ab6f-04de94a0eb32","Type":"ContainerStarted","Data":"6570af7bb2ff79e66730ce6ce567534f285bdf662f89c9aac8337dfe8ad5a76c"} Sep 16 19:40:39.833859 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:39.833826 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-9n6z5" event={"ID":"643260a5-3819-43ab-80ae-329335369efe","Type":"ContainerStarted","Data":"0842013470ed6aa7c13e04197e8d82d237635f878898ef51dba37ba703f72eb2"} Sep 16 19:40:39.833981 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:39.833877 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-9n6z5" event={"ID":"643260a5-3819-43ab-80ae-329335369efe","Type":"ContainerStarted","Data":"9855f2190d07b90d1c5b41639a9b319181f850be8345de8eb77c218eeba0f50e"} Sep 16 19:40:39.835414 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:39.835389 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4sf5n" event={"ID":"700069ae-01f3-4f93-b0df-1c60a7dadf04","Type":"ContainerStarted","Data":"9b5759009140eaf7eb66ef50792ec1db288dbbb1fd16c127d0602e94ff301071"} Sep 16 19:40:39.849706 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:39.849667 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-2pkpz" podStartSLOduration=1.788083823 podStartE2EDuration="3.849655494s" totalImagesPullingTime="2.061571671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:40:39.848961963 +0000 UTC m=+114.949266039" watchObservedRunningTime="2026-09-16 19:40:39.849655494 +0000 UTC m=+114.949959560" Sep 16 19:40:39.869839 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:39.869774 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4sf5n" podStartSLOduration=1.697971265 podStartE2EDuration="3.869760565s" totalImagesPullingTime="2.1717893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:40:39.869009547 +0000 UTC m=+114.969313623" watchObservedRunningTime="2026-09-16 19:40:39.869760565 +0000 UTC m=+114.970064675" Sep 16 19:40:39.889408 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:39.889358 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-9n6z5" podStartSLOduration=1.889340735 podStartE2EDuration="1.889340735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:40:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:40:39.888050896 +0000 UTC m=+114.988354971" watchObservedRunningTime="2026-09-16 19:40:39.889340735 +0000 UTC m=+114.989644812" Sep 16 19:40:40.223420 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:40.223325 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5966b9c9-7dcb-4ede-8218-fc03464cf1a2-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-7jksn\" (UID: \"5966b9c9-7dcb-4ede-8218-fc03464cf1a2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7jksn" Sep 16 19:40:40.223584 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:40.223450 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 16 19:40:40.223584 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:40.223522 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5966b9c9-7dcb-4ede-8218-fc03464cf1a2-samples-operator-tls podName:5966b9c9-7dcb-4ede-8218-fc03464cf1a2 nodeName:}" failed. No retries permitted until 2026-09-16 19:40:44.223501023 +0000 UTC m=+119.323805090 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5966b9c9-7dcb-4ede-8218-fc03464cf1a2-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-7jksn" (UID: "5966b9c9-7dcb-4ede-8218-fc03464cf1a2") : secret "samples-operator-tls" not found Sep 16 19:40:41.847322 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:41.847293 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-848vj"] Sep 16 19:40:41.850403 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:41.850386 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-848vj" Sep 16 19:40:41.860578 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:41.860563 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 16 19:40:41.860685 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:41.860631 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 16 19:40:41.861393 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:41.861374 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 16 19:40:41.861563 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:41.861380 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 16 19:40:41.864910 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:41.864891 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mddp9\"" Sep 16 19:40:41.884443 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:41.884416 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-848vj"] Sep 16 19:40:41.935038 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:41.935010 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-848vj\" (UID: \"9a005d2f-276b-4000-bd5d-5e1d7e7261b3\") " pod="openshift-insights/insights-runtime-extractor-848vj" Sep 16 19:40:41.935164 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:41.935071 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-data-volume\") pod \"insights-runtime-extractor-848vj\" (UID: \"9a005d2f-276b-4000-bd5d-5e1d7e7261b3\") " pod="openshift-insights/insights-runtime-extractor-848vj" Sep 16 19:40:41.935218 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:41.935166 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s4lv\" (UniqueName: \"kubernetes.io/projected/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-kube-api-access-6s4lv\") pod \"insights-runtime-extractor-848vj\" (UID: \"9a005d2f-276b-4000-bd5d-5e1d7e7261b3\") " pod="openshift-insights/insights-runtime-extractor-848vj" Sep 16 19:40:41.935218 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:41.935196 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-crio-socket\") pod \"insights-runtime-extractor-848vj\" (UID: \"9a005d2f-276b-4000-bd5d-5e1d7e7261b3\") " pod="openshift-insights/insights-runtime-extractor-848vj" Sep 16 19:40:41.935218 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:41.935217 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-848vj\" (UID: \"9a005d2f-276b-4000-bd5d-5e1d7e7261b3\") " pod="openshift-insights/insights-runtime-extractor-848vj" Sep 16 19:40:42.036442 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:42.036416 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-848vj\" (UID: \"9a005d2f-276b-4000-bd5d-5e1d7e7261b3\") " pod="openshift-insights/insights-runtime-extractor-848vj" Sep 16 19:40:42.036557 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:42.036474 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-848vj\" (UID: \"9a005d2f-276b-4000-bd5d-5e1d7e7261b3\") " pod="openshift-insights/insights-runtime-extractor-848vj" Sep 16 19:40:42.036557 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:42.036550 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 19:40:42.036634 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:42.036572 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 19:40:42.036634 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:42.036608 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-data-volume\") pod \"insights-runtime-extractor-848vj\" (UID: \"9a005d2f-276b-4000-bd5d-5e1d7e7261b3\") " pod="openshift-insights/insights-runtime-extractor-848vj" Sep 16 19:40:42.036708 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:42.036637 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-kube-rbac-proxy-cm podName:9a005d2f-276b-4000-bd5d-5e1d7e7261b3 nodeName:}" failed. No retries permitted until 2026-09-16 19:40:42.536616858 +0000 UTC m=+117.636920912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-848vj" (UID: "9a005d2f-276b-4000-bd5d-5e1d7e7261b3") : configmap "kube-rbac-proxy" not found Sep 16 19:40:42.036764 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:42.036706 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-insights-runtime-extractor-tls podName:9a005d2f-276b-4000-bd5d-5e1d7e7261b3 nodeName:}" failed. No retries permitted until 2026-09-16 19:40:42.536690438 +0000 UTC m=+117.636994505 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-848vj" (UID: "9a005d2f-276b-4000-bd5d-5e1d7e7261b3") : secret "insights-runtime-extractor-tls" not found Sep 16 19:40:42.036817 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:42.036764 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s4lv\" (UniqueName: \"kubernetes.io/projected/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-kube-api-access-6s4lv\") pod \"insights-runtime-extractor-848vj\" (UID: \"9a005d2f-276b-4000-bd5d-5e1d7e7261b3\") " pod="openshift-insights/insights-runtime-extractor-848vj" Sep 16 19:40:42.036859 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:42.036821 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-crio-socket\") pod \"insights-runtime-extractor-848vj\" (UID: \"9a005d2f-276b-4000-bd5d-5e1d7e7261b3\") " pod="openshift-insights/insights-runtime-extractor-848vj" Sep 16 19:40:42.036925 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:42.036910 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-crio-socket\") pod \"insights-runtime-extractor-848vj\" (UID: \"9a005d2f-276b-4000-bd5d-5e1d7e7261b3\") " pod="openshift-insights/insights-runtime-extractor-848vj" Sep 16 19:40:42.036964 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:42.036910 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-data-volume\") pod \"insights-runtime-extractor-848vj\" (UID: \"9a005d2f-276b-4000-bd5d-5e1d7e7261b3\") " pod="openshift-insights/insights-runtime-extractor-848vj" Sep 16 19:40:42.053379 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:42.053357 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s4lv\" (UniqueName: \"kubernetes.io/projected/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-kube-api-access-6s4lv\") pod \"insights-runtime-extractor-848vj\" (UID: \"9a005d2f-276b-4000-bd5d-5e1d7e7261b3\") " pod="openshift-insights/insights-runtime-extractor-848vj" Sep 16 19:40:42.541365 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:42.541333 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-848vj\" (UID: \"9a005d2f-276b-4000-bd5d-5e1d7e7261b3\") " pod="openshift-insights/insights-runtime-extractor-848vj" Sep 16 19:40:42.541587 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:42.541378 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-848vj\" (UID: \"9a005d2f-276b-4000-bd5d-5e1d7e7261b3\") " pod="openshift-insights/insights-runtime-extractor-848vj" Sep 16 19:40:42.541587 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:42.541454 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 19:40:42.541587 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:42.541515 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-kube-rbac-proxy-cm podName:9a005d2f-276b-4000-bd5d-5e1d7e7261b3 nodeName:}" failed. No retries permitted until 2026-09-16 19:40:43.5415018 +0000 UTC m=+118.641805853 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-848vj" (UID: "9a005d2f-276b-4000-bd5d-5e1d7e7261b3") : configmap "kube-rbac-proxy" not found Sep 16 19:40:42.541587 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:42.541542 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 19:40:42.541729 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:42.541597 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-insights-runtime-extractor-tls podName:9a005d2f-276b-4000-bd5d-5e1d7e7261b3 nodeName:}" failed. No retries permitted until 2026-09-16 19:40:43.541584757 +0000 UTC m=+118.641888810 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-848vj" (UID: "9a005d2f-276b-4000-bd5d-5e1d7e7261b3") : secret "insights-runtime-extractor-tls" not found Sep 16 19:40:43.549203 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:43.549171 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-848vj\" (UID: \"9a005d2f-276b-4000-bd5d-5e1d7e7261b3\") " pod="openshift-insights/insights-runtime-extractor-848vj" Sep 16 19:40:43.549572 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:43.549261 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-848vj\" (UID: \"9a005d2f-276b-4000-bd5d-5e1d7e7261b3\") " pod="openshift-insights/insights-runtime-extractor-848vj" Sep 16 19:40:43.549572 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:43.549326 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 19:40:43.549572 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:43.549327 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 19:40:43.549572 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:43.549377 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-kube-rbac-proxy-cm podName:9a005d2f-276b-4000-bd5d-5e1d7e7261b3 nodeName:}" failed. No retries permitted until 2026-09-16 19:40:45.549363938 +0000 UTC m=+120.649667991 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-848vj" (UID: "9a005d2f-276b-4000-bd5d-5e1d7e7261b3") : configmap "kube-rbac-proxy" not found Sep 16 19:40:43.549572 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:43.549391 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-insights-runtime-extractor-tls podName:9a005d2f-276b-4000-bd5d-5e1d7e7261b3 nodeName:}" failed. No retries permitted until 2026-09-16 19:40:45.549383123 +0000 UTC m=+120.649687175 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-848vj" (UID: "9a005d2f-276b-4000-bd5d-5e1d7e7261b3") : secret "insights-runtime-extractor-tls" not found Sep 16 19:40:43.966761 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:43.966689 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wf7dr_536a4230-7582-4958-9653-31c99fd62796/dns-node-resolver/0.log" Sep 16 19:40:44.256529 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:44.256432 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5966b9c9-7dcb-4ede-8218-fc03464cf1a2-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-7jksn\" (UID: \"5966b9c9-7dcb-4ede-8218-fc03464cf1a2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7jksn" Sep 16 19:40:44.256682 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:44.256581 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 16 19:40:44.256682 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:44.256654 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5966b9c9-7dcb-4ede-8218-fc03464cf1a2-samples-operator-tls podName:5966b9c9-7dcb-4ede-8218-fc03464cf1a2 nodeName:}" failed. No retries permitted until 2026-09-16 19:40:52.256638119 +0000 UTC m=+127.356942172 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5966b9c9-7dcb-4ede-8218-fc03464cf1a2-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-7jksn" (UID: "5966b9c9-7dcb-4ede-8218-fc03464cf1a2") : secret "samples-operator-tls" not found Sep 16 19:40:44.971718 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:44.971689 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s6r7f_ec497417-cb80-4876-9c6a-c922f1a9a1bc/node-ca/0.log" Sep 16 19:40:45.565014 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:45.564983 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-848vj\" (UID: \"9a005d2f-276b-4000-bd5d-5e1d7e7261b3\") " pod="openshift-insights/insights-runtime-extractor-848vj" Sep 16 19:40:45.565208 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:45.565023 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-848vj\" (UID: \"9a005d2f-276b-4000-bd5d-5e1d7e7261b3\") " pod="openshift-insights/insights-runtime-extractor-848vj" Sep 16 19:40:45.565208 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:45.565103 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 19:40:45.565208 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:45.565139 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 19:40:45.565208 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:45.565181 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-kube-rbac-proxy-cm podName:9a005d2f-276b-4000-bd5d-5e1d7e7261b3 nodeName:}" failed. No retries permitted until 2026-09-16 19:40:49.565164813 +0000 UTC m=+124.665468867 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-848vj" (UID: "9a005d2f-276b-4000-bd5d-5e1d7e7261b3") : configmap "kube-rbac-proxy" not found Sep 16 19:40:45.565208 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:45.565196 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-insights-runtime-extractor-tls podName:9a005d2f-276b-4000-bd5d-5e1d7e7261b3 nodeName:}" failed. No retries permitted until 2026-09-16 19:40:49.565188278 +0000 UTC m=+124.665492331 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-848vj" (UID: "9a005d2f-276b-4000-bd5d-5e1d7e7261b3") : secret "insights-runtime-extractor-tls" not found Sep 16 19:40:45.771622 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:45.771595 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qpvrx_215ea051-bb2b-41c6-b1a0-8984507e2d1c/serve-healthcheck-canary/0.log" Sep 16 19:40:49.596510 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:49.596478 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-848vj\" (UID: \"9a005d2f-276b-4000-bd5d-5e1d7e7261b3\") " pod="openshift-insights/insights-runtime-extractor-848vj" Sep 16 19:40:49.596929 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:49.596519 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-848vj\" (UID: \"9a005d2f-276b-4000-bd5d-5e1d7e7261b3\") " pod="openshift-insights/insights-runtime-extractor-848vj" Sep 16 19:40:49.596929 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:49.596602 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 19:40:49.596929 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:49.596651 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 19:40:49.596929 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:49.596673 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-kube-rbac-proxy-cm podName:9a005d2f-276b-4000-bd5d-5e1d7e7261b3 nodeName:}" failed. No retries permitted until 2026-09-16 19:40:57.596652807 +0000 UTC m=+132.696956875 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-848vj" (UID: "9a005d2f-276b-4000-bd5d-5e1d7e7261b3") : configmap "kube-rbac-proxy" not found Sep 16 19:40:49.596929 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:40:49.596690 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-insights-runtime-extractor-tls podName:9a005d2f-276b-4000-bd5d-5e1d7e7261b3 nodeName:}" failed. No retries permitted until 2026-09-16 19:40:57.596680133 +0000 UTC m=+132.696984203 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-848vj" (UID: "9a005d2f-276b-4000-bd5d-5e1d7e7261b3") : secret "insights-runtime-extractor-tls" not found Sep 16 19:40:52.315269 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:52.315239 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5966b9c9-7dcb-4ede-8218-fc03464cf1a2-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-7jksn\" (UID: \"5966b9c9-7dcb-4ede-8218-fc03464cf1a2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7jksn" Sep 16 19:40:52.317894 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:52.317858 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5966b9c9-7dcb-4ede-8218-fc03464cf1a2-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-7jksn\" (UID: \"5966b9c9-7dcb-4ede-8218-fc03464cf1a2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7jksn" Sep 16 19:40:52.474187 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:52.474161 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-44rsp\"" Sep 16 19:40:52.481062 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:52.481045 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7jksn" Sep 16 19:40:52.755603 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:52.755481 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7jksn"] Sep 16 19:40:52.876068 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:52.876030 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7jksn" event={"ID":"5966b9c9-7dcb-4ede-8218-fc03464cf1a2","Type":"ContainerStarted","Data":"233b22d6b0df532c182865c0b99fbecacc8d5d0e3f8b2e0f7a188fa46063c2f6"} Sep 16 19:40:54.884701 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:54.884666 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7jksn" event={"ID":"5966b9c9-7dcb-4ede-8218-fc03464cf1a2","Type":"ContainerStarted","Data":"18222f80042396e376397a77bdb8d6ab0ed987a63beb633b726cf457cd52ccbc"} Sep 16 19:40:54.885133 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:54.884727 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7jksn" event={"ID":"5966b9c9-7dcb-4ede-8218-fc03464cf1a2","Type":"ContainerStarted","Data":"aa0e18339812f06046277dbab7cac6361421cafa5e3fa576b0a172dc714064dd"} Sep 16 19:40:54.925538 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:54.925490 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-7jksn" podStartSLOduration=17.409418926 podStartE2EDuration="18.925475751s" totalImagesPullingTime="1.516056825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:40:54.925238347 +0000 UTC m=+130.025542421" watchObservedRunningTime="2026-09-16 19:40:54.925475751 +0000 UTC m=+130.025779826" Sep 16 19:40:55.139051 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:55.138985 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aafe6dc2-78c4-4a74-bea1-8b7221c9f467-metrics-certs\") pod \"network-metrics-daemon-cgqxj\" (UID: \"aafe6dc2-78c4-4a74-bea1-8b7221c9f467\") " pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:40:55.141427 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:55.141407 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aafe6dc2-78c4-4a74-bea1-8b7221c9f467-metrics-certs\") pod \"network-metrics-daemon-cgqxj\" (UID: \"aafe6dc2-78c4-4a74-bea1-8b7221c9f467\") " pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:40:55.345214 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:55.345191 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xlhjh\"" Sep 16 19:40:55.352763 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:55.352747 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cgqxj" Sep 16 19:40:55.625659 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:55.625630 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cgqxj"] Sep 16 19:40:55.629483 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:40:55.629461 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaafe6dc2_78c4_4a74_bea1_8b7221c9f467.slice/crio-8ec750b8ba0cddd595a2f4c2a93083dbc478dabeb3cfa6a5e7a52c9353bde8b5 WatchSource:0}: Error finding container 8ec750b8ba0cddd595a2f4c2a93083dbc478dabeb3cfa6a5e7a52c9353bde8b5: Status 404 returned error can't find the container with id 8ec750b8ba0cddd595a2f4c2a93083dbc478dabeb3cfa6a5e7a52c9353bde8b5 Sep 16 19:40:55.889614 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:55.889582 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cgqxj" event={"ID":"aafe6dc2-78c4-4a74-bea1-8b7221c9f467","Type":"ContainerStarted","Data":"8ec750b8ba0cddd595a2f4c2a93083dbc478dabeb3cfa6a5e7a52c9353bde8b5"} Sep 16 19:40:56.897773 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:56.897736 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cgqxj" event={"ID":"aafe6dc2-78c4-4a74-bea1-8b7221c9f467","Type":"ContainerStarted","Data":"0799fbf8d53a48169684455e727ede5bc6a058aa9665f45ec0b27e42f5c086a9"} Sep 16 19:40:56.898267 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:56.897811 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cgqxj" event={"ID":"aafe6dc2-78c4-4a74-bea1-8b7221c9f467","Type":"ContainerStarted","Data":"9938a5a26fe17ccf842ea2e307ff16a037ef209326b78adaafc51a75ceed0fbc"} Sep 16 19:40:56.919989 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:56.919937 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cgqxj" podStartSLOduration=130.13468155 podStartE2EDuration="2m10.919920356s" totalImagesPullingTime="785.238806ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:38:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:40:56.919037592 +0000 UTC m=+132.019341668" watchObservedRunningTime="2026-09-16 19:40:56.919920356 +0000 UTC m=+132.020224433" Sep 16 19:40:57.660616 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:57.660585 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-848vj\" (UID: \"9a005d2f-276b-4000-bd5d-5e1d7e7261b3\") " pod="openshift-insights/insights-runtime-extractor-848vj" Sep 16 19:40:57.660761 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:57.660628 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-848vj\" (UID: \"9a005d2f-276b-4000-bd5d-5e1d7e7261b3\") " pod="openshift-insights/insights-runtime-extractor-848vj" Sep 16 19:40:57.661246 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:57.661227 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-848vj\" (UID: \"9a005d2f-276b-4000-bd5d-5e1d7e7261b3\") " pod="openshift-insights/insights-runtime-extractor-848vj" Sep 16 19:40:57.663014 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:57.662993 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a005d2f-276b-4000-bd5d-5e1d7e7261b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-848vj\" (UID: \"9a005d2f-276b-4000-bd5d-5e1d7e7261b3\") " pod="openshift-insights/insights-runtime-extractor-848vj" Sep 16 19:40:57.763040 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:57.763013 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mddp9\"" Sep 16 19:40:57.770742 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:57.770727 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-848vj" Sep 16 19:40:58.049433 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:58.049408 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-848vj"] Sep 16 19:40:58.052468 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:40:58.052444 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a005d2f_276b_4000_bd5d_5e1d7e7261b3.slice/crio-3f12ddbe5f14e9d42c60c0e63c1d59c692239823465ec11368d4a4bdb90909cd WatchSource:0}: Error finding container 3f12ddbe5f14e9d42c60c0e63c1d59c692239823465ec11368d4a4bdb90909cd: Status 404 returned error can't find the container with id 3f12ddbe5f14e9d42c60c0e63c1d59c692239823465ec11368d4a4bdb90909cd Sep 16 19:40:58.906436 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:58.906407 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-848vj" event={"ID":"9a005d2f-276b-4000-bd5d-5e1d7e7261b3","Type":"ContainerStarted","Data":"473da14014417121e80a121424754153b8a021c584af6f3b6f40713b261f28c9"} Sep 16 19:40:58.906609 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:58.906463 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-848vj" event={"ID":"9a005d2f-276b-4000-bd5d-5e1d7e7261b3","Type":"ContainerStarted","Data":"52273aa9fa4a2d0630b217f7cf8f34133fa24497753806ba173f25b025d11e84"} Sep 16 19:40:58.906609 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:40:58.906484 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-848vj" event={"ID":"9a005d2f-276b-4000-bd5d-5e1d7e7261b3","Type":"ContainerStarted","Data":"3f12ddbe5f14e9d42c60c0e63c1d59c692239823465ec11368d4a4bdb90909cd"} Sep 16 19:41:00.914496 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:00.914461 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-848vj" event={"ID":"9a005d2f-276b-4000-bd5d-5e1d7e7261b3","Type":"ContainerStarted","Data":"cedb5806bae3ce008a72aa4de288de7719bd3d039658c07466a262025ee111aa"} Sep 16 19:41:00.943830 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:00.943783 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-848vj" podStartSLOduration=17.842045524 podStartE2EDuration="19.943767823s" totalImagesPullingTime="2.101722299s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 19:40:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:41:00.942001022 +0000 UTC m=+136.042305097" watchObservedRunningTime="2026-09-16 19:41:00.943767823 +0000 UTC m=+136.044071898" Sep 16 19:41:07.700928 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:07.700896 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c4b7c4694-5n7gz"] Sep 16 19:41:07.703883 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:07.703866 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c4b7c4694-5n7gz" Sep 16 19:41:07.708555 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:07.708526 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-ttp8r\"" Sep 16 19:41:07.708555 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:07.708541 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 16 19:41:07.708776 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:07.708606 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 16 19:41:07.708776 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:07.708540 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 16 19:41:07.708776 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:07.708526 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 16 19:41:07.718211 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:07.718194 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c4b7c4694-5n7gz"] Sep 16 19:41:07.833907 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:07.833875 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2c568778-6bbd-4061-96a3-825631298f73-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c4b7c4694-5n7gz\" (UID: \"2c568778-6bbd-4061-96a3-825631298f73\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c4b7c4694-5n7gz" Sep 16 19:41:07.834139 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:07.833944 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xb4m\" (UniqueName: \"kubernetes.io/projected/2c568778-6bbd-4061-96a3-825631298f73-kube-api-access-2xb4m\") pod \"managed-serviceaccount-addon-agent-6c4b7c4694-5n7gz\" (UID: \"2c568778-6bbd-4061-96a3-825631298f73\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c4b7c4694-5n7gz" Sep 16 19:41:07.934986 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:07.934959 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2c568778-6bbd-4061-96a3-825631298f73-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c4b7c4694-5n7gz\" (UID: \"2c568778-6bbd-4061-96a3-825631298f73\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c4b7c4694-5n7gz" Sep 16 19:41:07.935147 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:07.935010 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xb4m\" (UniqueName: \"kubernetes.io/projected/2c568778-6bbd-4061-96a3-825631298f73-kube-api-access-2xb4m\") pod \"managed-serviceaccount-addon-agent-6c4b7c4694-5n7gz\" (UID: \"2c568778-6bbd-4061-96a3-825631298f73\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c4b7c4694-5n7gz" Sep 16 19:41:07.938065 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:07.938042 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2c568778-6bbd-4061-96a3-825631298f73-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c4b7c4694-5n7gz\" (UID: \"2c568778-6bbd-4061-96a3-825631298f73\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c4b7c4694-5n7gz" Sep 16 19:41:07.953285 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:07.953224 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xb4m\" (UniqueName: \"kubernetes.io/projected/2c568778-6bbd-4061-96a3-825631298f73-kube-api-access-2xb4m\") pod \"managed-serviceaccount-addon-agent-6c4b7c4694-5n7gz\" (UID: \"2c568778-6bbd-4061-96a3-825631298f73\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c4b7c4694-5n7gz" Sep 16 19:41:08.023944 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:08.023920 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c4b7c4694-5n7gz" Sep 16 19:41:08.295887 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:08.295858 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c4b7c4694-5n7gz"] Sep 16 19:41:08.299549 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:41:08.299522 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c568778_6bbd_4061_96a3_825631298f73.slice/crio-b4626ba66a05e624b0437af055f0c120862982b4ea77d554650d262590912d2f WatchSource:0}: Error finding container b4626ba66a05e624b0437af055f0c120862982b4ea77d554650d262590912d2f: Status 404 returned error can't find the container with id b4626ba66a05e624b0437af055f0c120862982b4ea77d554650d262590912d2f Sep 16 19:41:08.945640 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:08.945604 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c4b7c4694-5n7gz" event={"ID":"2c568778-6bbd-4061-96a3-825631298f73","Type":"ContainerStarted","Data":"b4626ba66a05e624b0437af055f0c120862982b4ea77d554650d262590912d2f"} Sep 16 19:41:10.954367 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:10.954291 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c4b7c4694-5n7gz" event={"ID":"2c568778-6bbd-4061-96a3-825631298f73","Type":"ContainerStarted","Data":"726605ffad6ccfbbaf372675cf58285e03c909d15e1010a197081865519ccb3a"} Sep 16 19:41:10.975234 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:10.975181 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c4b7c4694-5n7gz" podStartSLOduration=1.68500801 podStartE2EDuration="3.975166786s" totalImagesPullingTime="2.290158776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:41:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:41:10.974367971 +0000 UTC m=+146.074672110" watchObservedRunningTime="2026-09-16 19:41:10.975166786 +0000 UTC m=+146.075470861" Sep 16 19:41:12.917601 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:12.917569 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bvjnl"] Sep 16 19:41:12.921861 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:12.921845 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bvjnl" Sep 16 19:41:12.925462 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:12.925443 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-z2cnl\"" Sep 16 19:41:12.925577 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:12.925523 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 16 19:41:12.945912 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:12.945888 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bvjnl"] Sep 16 19:41:13.071570 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:13.071545 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0b982aa5-5449-4f34-8663-b3f0f3ce8837-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-bvjnl\" (UID: \"0b982aa5-5449-4f34-8663-b3f0f3ce8837\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bvjnl" Sep 16 19:41:13.172461 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:13.172407 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0b982aa5-5449-4f34-8663-b3f0f3ce8837-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-bvjnl\" (UID: \"0b982aa5-5449-4f34-8663-b3f0f3ce8837\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bvjnl" Sep 16 19:41:13.172543 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:13.172507 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 16 19:41:13.172580 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:13.172557 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b982aa5-5449-4f34-8663-b3f0f3ce8837-tls-certificates podName:0b982aa5-5449-4f34-8663-b3f0f3ce8837 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:13.6725443 +0000 UTC m=+148.772848353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/0b982aa5-5449-4f34-8663-b3f0f3ce8837-tls-certificates") pod "prometheus-operator-admission-webhook-5864cd99d7-bvjnl" (UID: "0b982aa5-5449-4f34-8663-b3f0f3ce8837") : secret "prometheus-operator-admission-webhook-tls" not found Sep 16 19:41:13.676279 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:13.676248 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0b982aa5-5449-4f34-8663-b3f0f3ce8837-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-bvjnl\" (UID: \"0b982aa5-5449-4f34-8663-b3f0f3ce8837\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bvjnl" Sep 16 19:41:13.678933 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:13.678899 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0b982aa5-5449-4f34-8663-b3f0f3ce8837-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-bvjnl\" (UID: \"0b982aa5-5449-4f34-8663-b3f0f3ce8837\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bvjnl" Sep 16 19:41:13.830427 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:13.830402 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bvjnl" Sep 16 19:41:14.103566 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:14.103546 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bvjnl"] Sep 16 19:41:14.105697 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:41:14.105675 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b982aa5_5449_4f34_8663_b3f0f3ce8837.slice/crio-19e18e93e1be1bb6fa9b23fabbb00721393826ea6b21e6072d2ea6fafda80c6b WatchSource:0}: Error finding container 19e18e93e1be1bb6fa9b23fabbb00721393826ea6b21e6072d2ea6fafda80c6b: Status 404 returned error can't find the container with id 19e18e93e1be1bb6fa9b23fabbb00721393826ea6b21e6072d2ea6fafda80c6b Sep 16 19:41:14.969181 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:14.969138 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bvjnl" event={"ID":"0b982aa5-5449-4f34-8663-b3f0f3ce8837","Type":"ContainerStarted","Data":"19e18e93e1be1bb6fa9b23fabbb00721393826ea6b21e6072d2ea6fafda80c6b"} Sep 16 19:41:15.973591 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:15.973552 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bvjnl" event={"ID":"0b982aa5-5449-4f34-8663-b3f0f3ce8837","Type":"ContainerStarted","Data":"54e07d83ddb34a1a70cb8f74eea678d2ca5e68c2b84e9370a64cd15ccbededec"} Sep 16 19:41:15.974008 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:15.973709 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bvjnl" Sep 16 19:41:15.978400 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:15.978379 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bvjnl" Sep 16 19:41:15.991423 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:15.991380 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-bvjnl" podStartSLOduration=3.054252876 podStartE2EDuration="3.991366589s" totalImagesPullingTime="937.113713ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:41:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:41:15.990509849 +0000 UTC m=+151.090813925" watchObservedRunningTime="2026-09-16 19:41:15.991366589 +0000 UTC m=+151.091670691" Sep 16 19:41:16.067232 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.067209 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5494bd74d7-9w24z"] Sep 16 19:41:16.070200 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.070174 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5494bd74d7-9w24z" Sep 16 19:41:16.074175 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.074159 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 16 19:41:16.074274 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.074201 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 16 19:41:16.074470 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.074454 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 16 19:41:16.074748 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.074732 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 16 19:41:16.074795 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.074757 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 16 19:41:16.074795 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.074767 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 16 19:41:16.074872 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.074799 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 16 19:41:16.075097 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.075085 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vtbm4\"" Sep 16 19:41:16.082980 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.082958 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5494bd74d7-9w24z"] Sep 16 19:41:16.195236 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.195207 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9301ece6-9bd1-4c5a-a8da-a3332da1a287-service-ca\") pod \"console-5494bd74d7-9w24z\" (UID: \"9301ece6-9bd1-4c5a-a8da-a3332da1a287\") " pod="openshift-console/console-5494bd74d7-9w24z" Sep 16 19:41:16.195360 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.195269 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9301ece6-9bd1-4c5a-a8da-a3332da1a287-oauth-serving-cert\") pod \"console-5494bd74d7-9w24z\" (UID: \"9301ece6-9bd1-4c5a-a8da-a3332da1a287\") " pod="openshift-console/console-5494bd74d7-9w24z" Sep 16 19:41:16.195360 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.195288 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5tj5\" (UniqueName: \"kubernetes.io/projected/9301ece6-9bd1-4c5a-a8da-a3332da1a287-kube-api-access-b5tj5\") pod \"console-5494bd74d7-9w24z\" (UID: \"9301ece6-9bd1-4c5a-a8da-a3332da1a287\") " pod="openshift-console/console-5494bd74d7-9w24z" Sep 16 19:41:16.195360 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.195351 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9301ece6-9bd1-4c5a-a8da-a3332da1a287-console-serving-cert\") pod \"console-5494bd74d7-9w24z\" (UID: \"9301ece6-9bd1-4c5a-a8da-a3332da1a287\") " pod="openshift-console/console-5494bd74d7-9w24z" Sep 16 19:41:16.195461 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.195376 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9301ece6-9bd1-4c5a-a8da-a3332da1a287-console-oauth-config\") pod \"console-5494bd74d7-9w24z\" (UID: \"9301ece6-9bd1-4c5a-a8da-a3332da1a287\") " pod="openshift-console/console-5494bd74d7-9w24z" Sep 16 19:41:16.195461 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.195401 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9301ece6-9bd1-4c5a-a8da-a3332da1a287-console-config\") pod \"console-5494bd74d7-9w24z\" (UID: \"9301ece6-9bd1-4c5a-a8da-a3332da1a287\") " pod="openshift-console/console-5494bd74d7-9w24z" Sep 16 19:41:16.296178 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.296149 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9301ece6-9bd1-4c5a-a8da-a3332da1a287-service-ca\") pod \"console-5494bd74d7-9w24z\" (UID: \"9301ece6-9bd1-4c5a-a8da-a3332da1a287\") " pod="openshift-console/console-5494bd74d7-9w24z" Sep 16 19:41:16.296312 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.296210 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9301ece6-9bd1-4c5a-a8da-a3332da1a287-oauth-serving-cert\") pod \"console-5494bd74d7-9w24z\" (UID: \"9301ece6-9bd1-4c5a-a8da-a3332da1a287\") " pod="openshift-console/console-5494bd74d7-9w24z" Sep 16 19:41:16.296312 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.296236 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5tj5\" (UniqueName: \"kubernetes.io/projected/9301ece6-9bd1-4c5a-a8da-a3332da1a287-kube-api-access-b5tj5\") pod \"console-5494bd74d7-9w24z\" (UID: \"9301ece6-9bd1-4c5a-a8da-a3332da1a287\") " pod="openshift-console/console-5494bd74d7-9w24z" Sep 16 19:41:16.296312 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.296269 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9301ece6-9bd1-4c5a-a8da-a3332da1a287-console-serving-cert\") pod \"console-5494bd74d7-9w24z\" (UID: \"9301ece6-9bd1-4c5a-a8da-a3332da1a287\") " pod="openshift-console/console-5494bd74d7-9w24z" Sep 16 19:41:16.296312 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.296293 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9301ece6-9bd1-4c5a-a8da-a3332da1a287-console-oauth-config\") pod \"console-5494bd74d7-9w24z\" (UID: \"9301ece6-9bd1-4c5a-a8da-a3332da1a287\") " pod="openshift-console/console-5494bd74d7-9w24z" Sep 16 19:41:16.296498 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.296327 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9301ece6-9bd1-4c5a-a8da-a3332da1a287-console-config\") pod \"console-5494bd74d7-9w24z\" (UID: \"9301ece6-9bd1-4c5a-a8da-a3332da1a287\") " pod="openshift-console/console-5494bd74d7-9w24z" Sep 16 19:41:16.296847 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.296820 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9301ece6-9bd1-4c5a-a8da-a3332da1a287-service-ca\") pod \"console-5494bd74d7-9w24z\" (UID: \"9301ece6-9bd1-4c5a-a8da-a3332da1a287\") " pod="openshift-console/console-5494bd74d7-9w24z" Sep 16 19:41:16.297137 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.296948 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9301ece6-9bd1-4c5a-a8da-a3332da1a287-oauth-serving-cert\") pod \"console-5494bd74d7-9w24z\" (UID: \"9301ece6-9bd1-4c5a-a8da-a3332da1a287\") " pod="openshift-console/console-5494bd74d7-9w24z" Sep 16 19:41:16.297137 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.296973 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9301ece6-9bd1-4c5a-a8da-a3332da1a287-console-config\") pod \"console-5494bd74d7-9w24z\" (UID: \"9301ece6-9bd1-4c5a-a8da-a3332da1a287\") " pod="openshift-console/console-5494bd74d7-9w24z" Sep 16 19:41:16.298852 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.298834 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9301ece6-9bd1-4c5a-a8da-a3332da1a287-console-oauth-config\") pod \"console-5494bd74d7-9w24z\" (UID: \"9301ece6-9bd1-4c5a-a8da-a3332da1a287\") " pod="openshift-console/console-5494bd74d7-9w24z" Sep 16 19:41:16.298933 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.298911 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9301ece6-9bd1-4c5a-a8da-a3332da1a287-console-serving-cert\") pod \"console-5494bd74d7-9w24z\" (UID: \"9301ece6-9bd1-4c5a-a8da-a3332da1a287\") " pod="openshift-console/console-5494bd74d7-9w24z" Sep 16 19:41:16.305910 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.305890 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5tj5\" (UniqueName: \"kubernetes.io/projected/9301ece6-9bd1-4c5a-a8da-a3332da1a287-kube-api-access-b5tj5\") pod \"console-5494bd74d7-9w24z\" (UID: \"9301ece6-9bd1-4c5a-a8da-a3332da1a287\") " pod="openshift-console/console-5494bd74d7-9w24z" Sep 16 19:41:16.379867 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.379842 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5494bd74d7-9w24z" Sep 16 19:41:16.654930 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.654904 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5494bd74d7-9w24z"] Sep 16 19:41:16.657053 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:41:16.657031 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9301ece6_9bd1_4c5a_a8da_a3332da1a287.slice/crio-93a57e0500f3adc1a078a2ba8b7d1dbd10f911e3011790b60b3bebb5366979ed WatchSource:0}: Error finding container 93a57e0500f3adc1a078a2ba8b7d1dbd10f911e3011790b60b3bebb5366979ed: Status 404 returned error can't find the container with id 93a57e0500f3adc1a078a2ba8b7d1dbd10f911e3011790b60b3bebb5366979ed Sep 16 19:41:16.978194 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.977950 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5494bd74d7-9w24z" event={"ID":"9301ece6-9bd1-4c5a-a8da-a3332da1a287","Type":"ContainerStarted","Data":"93a57e0500f3adc1a078a2ba8b7d1dbd10f911e3011790b60b3bebb5366979ed"} Sep 16 19:41:16.979205 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.979185 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-t2xps"] Sep 16 19:41:16.983342 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.983329 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-t2xps" Sep 16 19:41:16.986305 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.986285 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 16 19:41:16.986435 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.986338 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 16 19:41:16.988035 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.988011 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-4m2tj\"" Sep 16 19:41:16.988035 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.988025 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 16 19:41:16.988035 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.988036 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 16 19:41:16.988297 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.988058 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 16 19:41:16.992754 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:16.992735 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-t2xps"] Sep 16 19:41:17.102844 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:17.102816 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dfe3ea2e-7826-4b9b-8089-e9786d5b23bb-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-t2xps\" (UID: \"dfe3ea2e-7826-4b9b-8089-e9786d5b23bb\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-t2xps" Sep 16 19:41:17.102969 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:17.102866 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k525q\" (UniqueName: \"kubernetes.io/projected/dfe3ea2e-7826-4b9b-8089-e9786d5b23bb-kube-api-access-k525q\") pod \"prometheus-operator-68bcd7f987-t2xps\" (UID: \"dfe3ea2e-7826-4b9b-8089-e9786d5b23bb\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-t2xps" Sep 16 19:41:17.102969 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:17.102896 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfe3ea2e-7826-4b9b-8089-e9786d5b23bb-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-t2xps\" (UID: \"dfe3ea2e-7826-4b9b-8089-e9786d5b23bb\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-t2xps" Sep 16 19:41:17.103052 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:17.102995 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dfe3ea2e-7826-4b9b-8089-e9786d5b23bb-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-t2xps\" (UID: \"dfe3ea2e-7826-4b9b-8089-e9786d5b23bb\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-t2xps" Sep 16 19:41:17.204317 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:17.204283 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k525q\" (UniqueName: \"kubernetes.io/projected/dfe3ea2e-7826-4b9b-8089-e9786d5b23bb-kube-api-access-k525q\") pod \"prometheus-operator-68bcd7f987-t2xps\" (UID: \"dfe3ea2e-7826-4b9b-8089-e9786d5b23bb\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-t2xps" Sep 16 19:41:17.204487 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:17.204338 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfe3ea2e-7826-4b9b-8089-e9786d5b23bb-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-t2xps\" (UID: \"dfe3ea2e-7826-4b9b-8089-e9786d5b23bb\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-t2xps" Sep 16 19:41:17.204487 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:17.204396 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dfe3ea2e-7826-4b9b-8089-e9786d5b23bb-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-t2xps\" (UID: \"dfe3ea2e-7826-4b9b-8089-e9786d5b23bb\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-t2xps" Sep 16 19:41:17.204487 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:17.204432 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dfe3ea2e-7826-4b9b-8089-e9786d5b23bb-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-t2xps\" (UID: \"dfe3ea2e-7826-4b9b-8089-e9786d5b23bb\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-t2xps" Sep 16 19:41:17.205120 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:17.205071 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfe3ea2e-7826-4b9b-8089-e9786d5b23bb-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-t2xps\" (UID: \"dfe3ea2e-7826-4b9b-8089-e9786d5b23bb\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-t2xps" Sep 16 19:41:17.207553 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:17.207530 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dfe3ea2e-7826-4b9b-8089-e9786d5b23bb-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-t2xps\" (UID: \"dfe3ea2e-7826-4b9b-8089-e9786d5b23bb\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-t2xps" Sep 16 19:41:17.207646 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:17.207565 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dfe3ea2e-7826-4b9b-8089-e9786d5b23bb-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-t2xps\" (UID: \"dfe3ea2e-7826-4b9b-8089-e9786d5b23bb\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-t2xps" Sep 16 19:41:17.214881 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:17.214859 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k525q\" (UniqueName: \"kubernetes.io/projected/dfe3ea2e-7826-4b9b-8089-e9786d5b23bb-kube-api-access-k525q\") pod \"prometheus-operator-68bcd7f987-t2xps\" (UID: \"dfe3ea2e-7826-4b9b-8089-e9786d5b23bb\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-t2xps" Sep 16 19:41:17.292906 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:17.292887 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-t2xps" Sep 16 19:41:17.583763 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:17.583687 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-t2xps"] Sep 16 19:41:17.586912 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:41:17.586876 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe3ea2e_7826_4b9b_8089_e9786d5b23bb.slice/crio-8310de7fae6ef08ffeaa124309454ca2de422d54aed9d5c760d12f0eca53606b WatchSource:0}: Error finding container 8310de7fae6ef08ffeaa124309454ca2de422d54aed9d5c760d12f0eca53606b: Status 404 returned error can't find the container with id 8310de7fae6ef08ffeaa124309454ca2de422d54aed9d5c760d12f0eca53606b Sep 16 19:41:17.983427 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:17.983307 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-t2xps" event={"ID":"dfe3ea2e-7826-4b9b-8089-e9786d5b23bb","Type":"ContainerStarted","Data":"8310de7fae6ef08ffeaa124309454ca2de422d54aed9d5c760d12f0eca53606b"} Sep 16 19:41:19.992160 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:19.992052 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5494bd74d7-9w24z" event={"ID":"9301ece6-9bd1-4c5a-a8da-a3332da1a287","Type":"ContainerStarted","Data":"01111ada4b851b248c28a95010381a5b7114df5ab928c80bf7a5cde306fd93f1"} Sep 16 19:41:19.994053 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:19.994030 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-t2xps" event={"ID":"dfe3ea2e-7826-4b9b-8089-e9786d5b23bb","Type":"ContainerStarted","Data":"93c92201adb9d1b449f5cf26657ba161d25d1926e7dff3f0e2cb7e279a3a165a"} Sep 16 19:41:19.994150 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:19.994073 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-t2xps" event={"ID":"dfe3ea2e-7826-4b9b-8089-e9786d5b23bb","Type":"ContainerStarted","Data":"2cb3806909e5618472e526b13960d6b33852917ea3080d3e131fb39dba2319e6"} Sep 16 19:41:20.012038 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:20.011994 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5494bd74d7-9w24z" podStartSLOduration=1.01236232 podStartE2EDuration="4.011977381s" totalImagesPullingTime="2.999615061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:41:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:41:20.010972648 +0000 UTC m=+155.111276724" watchObservedRunningTime="2026-09-16 19:41:20.011977381 +0000 UTC m=+155.112281455" Sep 16 19:41:20.029634 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:20.029587 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-t2xps" podStartSLOduration=1.961241596 podStartE2EDuration="4.029575485s" totalImagesPullingTime="2.068333889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:41:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:41:20.028694674 +0000 UTC m=+155.128998752" watchObservedRunningTime="2026-09-16 19:41:20.029575485 +0000 UTC m=+155.129879559" Sep 16 19:41:22.878709 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:22.878676 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-8k8wn"] Sep 16 19:41:22.881972 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:22.881953 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8k8wn" Sep 16 19:41:22.885148 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:22.885127 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-424vx\"" Sep 16 19:41:22.886093 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:22.886078 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 16 19:41:22.888468 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:22.888445 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 16 19:41:22.890188 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:22.890173 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 16 19:41:22.899563 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:22.899542 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-8k8wn"] Sep 16 19:41:22.902745 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:22.902723 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rmmz2"] Sep 16 19:41:22.905816 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:22.905800 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rmmz2" Sep 16 19:41:22.908872 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:22.908857 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 16 19:41:22.909913 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:22.909896 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 16 19:41:22.909996 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:22.909898 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 16 19:41:22.910084 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:22.910072 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c5p7b\"" Sep 16 19:41:23.050382 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.050336 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/18fa5c09-f633-4382-8931-1df7d2dbcaaa-node-exporter-accelerators-collector-config\") pod \"node-exporter-rmmz2\" (UID: \"18fa5c09-f633-4382-8931-1df7d2dbcaaa\") " pod="openshift-monitoring/node-exporter-rmmz2" Sep 16 19:41:23.050382 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.050389 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18fa5c09-f633-4382-8931-1df7d2dbcaaa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rmmz2\" (UID: \"18fa5c09-f633-4382-8931-1df7d2dbcaaa\") " pod="openshift-monitoring/node-exporter-rmmz2" Sep 16 19:41:23.050588 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.050430 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/18fa5c09-f633-4382-8931-1df7d2dbcaaa-node-exporter-wtmp\") pod \"node-exporter-rmmz2\" (UID: \"18fa5c09-f633-4382-8931-1df7d2dbcaaa\") " pod="openshift-monitoring/node-exporter-rmmz2" Sep 16 19:41:23.050588 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.050455 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72c5d77b-e909-447f-9ad6-dccf8ec09ab5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-8k8wn\" (UID: \"72c5d77b-e909-447f-9ad6-dccf8ec09ab5\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8k8wn" Sep 16 19:41:23.050588 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.050474 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/18fa5c09-f633-4382-8931-1df7d2dbcaaa-node-exporter-textfile\") pod \"node-exporter-rmmz2\" (UID: \"18fa5c09-f633-4382-8931-1df7d2dbcaaa\") " pod="openshift-monitoring/node-exporter-rmmz2" Sep 16 19:41:23.050588 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.050490 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18fa5c09-f633-4382-8931-1df7d2dbcaaa-sys\") pod \"node-exporter-rmmz2\" (UID: \"18fa5c09-f633-4382-8931-1df7d2dbcaaa\") " pod="openshift-monitoring/node-exporter-rmmz2" Sep 16 19:41:23.050588 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.050517 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18fa5c09-f633-4382-8931-1df7d2dbcaaa-metrics-client-ca\") pod \"node-exporter-rmmz2\" (UID: \"18fa5c09-f633-4382-8931-1df7d2dbcaaa\") " pod="openshift-monitoring/node-exporter-rmmz2" Sep 16 19:41:23.050588 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.050544 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/18fa5c09-f633-4382-8931-1df7d2dbcaaa-node-exporter-tls\") pod \"node-exporter-rmmz2\" (UID: \"18fa5c09-f633-4382-8931-1df7d2dbcaaa\") " pod="openshift-monitoring/node-exporter-rmmz2" Sep 16 19:41:23.050588 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.050563 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/72c5d77b-e909-447f-9ad6-dccf8ec09ab5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-8k8wn\" (UID: \"72c5d77b-e909-447f-9ad6-dccf8ec09ab5\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8k8wn" Sep 16 19:41:23.050862 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.050601 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/72c5d77b-e909-447f-9ad6-dccf8ec09ab5-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-8k8wn\" (UID: \"72c5d77b-e909-447f-9ad6-dccf8ec09ab5\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8k8wn" Sep 16 19:41:23.050862 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.050675 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72c5d77b-e909-447f-9ad6-dccf8ec09ab5-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-8k8wn\" (UID: \"72c5d77b-e909-447f-9ad6-dccf8ec09ab5\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8k8wn" Sep 16 19:41:23.050862 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.050715 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/18fa5c09-f633-4382-8931-1df7d2dbcaaa-root\") pod \"node-exporter-rmmz2\" (UID: \"18fa5c09-f633-4382-8931-1df7d2dbcaaa\") " pod="openshift-monitoring/node-exporter-rmmz2" Sep 16 19:41:23.050862 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.050746 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/72c5d77b-e909-447f-9ad6-dccf8ec09ab5-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-8k8wn\" (UID: \"72c5d77b-e909-447f-9ad6-dccf8ec09ab5\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8k8wn" Sep 16 19:41:23.050862 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.050772 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnmft\" (UniqueName: \"kubernetes.io/projected/18fa5c09-f633-4382-8931-1df7d2dbcaaa-kube-api-access-lnmft\") pod \"node-exporter-rmmz2\" (UID: \"18fa5c09-f633-4382-8931-1df7d2dbcaaa\") " pod="openshift-monitoring/node-exporter-rmmz2" Sep 16 19:41:23.050862 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.050794 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8gng\" (UniqueName: \"kubernetes.io/projected/72c5d77b-e909-447f-9ad6-dccf8ec09ab5-kube-api-access-m8gng\") pod \"kube-state-metrics-59fbdd77d-8k8wn\" (UID: \"72c5d77b-e909-447f-9ad6-dccf8ec09ab5\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8k8wn" Sep 16 19:41:23.152087 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.151989 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72c5d77b-e909-447f-9ad6-dccf8ec09ab5-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-8k8wn\" (UID: \"72c5d77b-e909-447f-9ad6-dccf8ec09ab5\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8k8wn" Sep 16 19:41:23.152087 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.152054 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/18fa5c09-f633-4382-8931-1df7d2dbcaaa-root\") pod \"node-exporter-rmmz2\" (UID: \"18fa5c09-f633-4382-8931-1df7d2dbcaaa\") " pod="openshift-monitoring/node-exporter-rmmz2" Sep 16 19:41:23.152345 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.152095 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/72c5d77b-e909-447f-9ad6-dccf8ec09ab5-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-8k8wn\" (UID: \"72c5d77b-e909-447f-9ad6-dccf8ec09ab5\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8k8wn" Sep 16 19:41:23.152345 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.152143 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnmft\" (UniqueName: \"kubernetes.io/projected/18fa5c09-f633-4382-8931-1df7d2dbcaaa-kube-api-access-lnmft\") pod \"node-exporter-rmmz2\" (UID: \"18fa5c09-f633-4382-8931-1df7d2dbcaaa\") " pod="openshift-monitoring/node-exporter-rmmz2" Sep 16 19:41:23.152345 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.152195 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/18fa5c09-f633-4382-8931-1df7d2dbcaaa-root\") pod \"node-exporter-rmmz2\" (UID: \"18fa5c09-f633-4382-8931-1df7d2dbcaaa\") " pod="openshift-monitoring/node-exporter-rmmz2" Sep 16 19:41:23.152345 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.152261 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8gng\" (UniqueName: \"kubernetes.io/projected/72c5d77b-e909-447f-9ad6-dccf8ec09ab5-kube-api-access-m8gng\") pod \"kube-state-metrics-59fbdd77d-8k8wn\" (UID: \"72c5d77b-e909-447f-9ad6-dccf8ec09ab5\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8k8wn" Sep 16 19:41:23.152345 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.152320 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/18fa5c09-f633-4382-8931-1df7d2dbcaaa-node-exporter-accelerators-collector-config\") pod \"node-exporter-rmmz2\" (UID: \"18fa5c09-f633-4382-8931-1df7d2dbcaaa\") " pod="openshift-monitoring/node-exporter-rmmz2" Sep 16 19:41:23.152607 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.152359 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18fa5c09-f633-4382-8931-1df7d2dbcaaa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rmmz2\" (UID: \"18fa5c09-f633-4382-8931-1df7d2dbcaaa\") " pod="openshift-monitoring/node-exporter-rmmz2" Sep 16 19:41:23.152607 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.152412 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/18fa5c09-f633-4382-8931-1df7d2dbcaaa-node-exporter-wtmp\") pod \"node-exporter-rmmz2\" (UID: \"18fa5c09-f633-4382-8931-1df7d2dbcaaa\") " pod="openshift-monitoring/node-exporter-rmmz2" Sep 16 19:41:23.152607 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.152455 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72c5d77b-e909-447f-9ad6-dccf8ec09ab5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-8k8wn\" (UID: \"72c5d77b-e909-447f-9ad6-dccf8ec09ab5\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8k8wn" Sep 16 19:41:23.152607 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.152487 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/18fa5c09-f633-4382-8931-1df7d2dbcaaa-node-exporter-textfile\") pod \"node-exporter-rmmz2\" (UID: \"18fa5c09-f633-4382-8931-1df7d2dbcaaa\") " pod="openshift-monitoring/node-exporter-rmmz2" Sep 16 19:41:23.152607 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.152520 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18fa5c09-f633-4382-8931-1df7d2dbcaaa-sys\") pod \"node-exporter-rmmz2\" (UID: \"18fa5c09-f633-4382-8931-1df7d2dbcaaa\") " pod="openshift-monitoring/node-exporter-rmmz2" Sep 16 19:41:23.152607 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.152539 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/72c5d77b-e909-447f-9ad6-dccf8ec09ab5-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-8k8wn\" (UID: \"72c5d77b-e909-447f-9ad6-dccf8ec09ab5\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8k8wn" Sep 16 19:41:23.152607 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.152545 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18fa5c09-f633-4382-8931-1df7d2dbcaaa-metrics-client-ca\") pod \"node-exporter-rmmz2\" (UID: \"18fa5c09-f633-4382-8931-1df7d2dbcaaa\") " pod="openshift-monitoring/node-exporter-rmmz2" Sep 16 19:41:23.152607 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.152584 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/18fa5c09-f633-4382-8931-1df7d2dbcaaa-node-exporter-tls\") pod \"node-exporter-rmmz2\" (UID: \"18fa5c09-f633-4382-8931-1df7d2dbcaaa\") " pod="openshift-monitoring/node-exporter-rmmz2" Sep 16 19:41:23.152607 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.152607 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/72c5d77b-e909-447f-9ad6-dccf8ec09ab5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-8k8wn\" (UID: \"72c5d77b-e909-447f-9ad6-dccf8ec09ab5\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8k8wn" Sep 16 19:41:23.153027 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.152634 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/72c5d77b-e909-447f-9ad6-dccf8ec09ab5-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-8k8wn\" (UID: \"72c5d77b-e909-447f-9ad6-dccf8ec09ab5\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8k8wn" Sep 16 19:41:23.153027 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.152746 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72c5d77b-e909-447f-9ad6-dccf8ec09ab5-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-8k8wn\" (UID: \"72c5d77b-e909-447f-9ad6-dccf8ec09ab5\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8k8wn" Sep 16 19:41:23.153027 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.152782 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/18fa5c09-f633-4382-8931-1df7d2dbcaaa-node-exporter-wtmp\") pod \"node-exporter-rmmz2\" (UID: \"18fa5c09-f633-4382-8931-1df7d2dbcaaa\") " pod="openshift-monitoring/node-exporter-rmmz2" Sep 16 19:41:23.153027 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.153021 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/18fa5c09-f633-4382-8931-1df7d2dbcaaa-node-exporter-textfile\") pod \"node-exporter-rmmz2\" (UID: \"18fa5c09-f633-4382-8931-1df7d2dbcaaa\") " pod="openshift-monitoring/node-exporter-rmmz2" Sep 16 19:41:23.153407 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.153090 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18fa5c09-f633-4382-8931-1df7d2dbcaaa-sys\") pod \"node-exporter-rmmz2\" (UID: \"18fa5c09-f633-4382-8931-1df7d2dbcaaa\") " pod="openshift-monitoring/node-exporter-rmmz2" Sep 16 19:41:23.153407 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.153184 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18fa5c09-f633-4382-8931-1df7d2dbcaaa-metrics-client-ca\") pod \"node-exporter-rmmz2\" (UID: \"18fa5c09-f633-4382-8931-1df7d2dbcaaa\") " pod="openshift-monitoring/node-exporter-rmmz2" Sep 16 19:41:23.153621 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.153590 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/72c5d77b-e909-447f-9ad6-dccf8ec09ab5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-8k8wn\" (UID: \"72c5d77b-e909-447f-9ad6-dccf8ec09ab5\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8k8wn" Sep 16 19:41:23.153810 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.153787 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/18fa5c09-f633-4382-8931-1df7d2dbcaaa-node-exporter-accelerators-collector-config\") pod \"node-exporter-rmmz2\" (UID: \"18fa5c09-f633-4382-8931-1df7d2dbcaaa\") " pod="openshift-monitoring/node-exporter-rmmz2" Sep 16 19:41:23.155197 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.155178 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/72c5d77b-e909-447f-9ad6-dccf8ec09ab5-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-8k8wn\" (UID: \"72c5d77b-e909-447f-9ad6-dccf8ec09ab5\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8k8wn" Sep 16 19:41:23.155291 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.155249 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18fa5c09-f633-4382-8931-1df7d2dbcaaa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rmmz2\" (UID: \"18fa5c09-f633-4382-8931-1df7d2dbcaaa\") " pod="openshift-monitoring/node-exporter-rmmz2" Sep 16 19:41:23.155291 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.155249 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/18fa5c09-f633-4382-8931-1df7d2dbcaaa-node-exporter-tls\") pod \"node-exporter-rmmz2\" (UID: \"18fa5c09-f633-4382-8931-1df7d2dbcaaa\") " pod="openshift-monitoring/node-exporter-rmmz2" Sep 16 19:41:23.155441 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.155419 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72c5d77b-e909-447f-9ad6-dccf8ec09ab5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-8k8wn\" (UID: \"72c5d77b-e909-447f-9ad6-dccf8ec09ab5\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8k8wn" Sep 16 19:41:23.180931 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.180910 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnmft\" (UniqueName: \"kubernetes.io/projected/18fa5c09-f633-4382-8931-1df7d2dbcaaa-kube-api-access-lnmft\") pod \"node-exporter-rmmz2\" (UID: \"18fa5c09-f633-4382-8931-1df7d2dbcaaa\") " pod="openshift-monitoring/node-exporter-rmmz2" Sep 16 19:41:23.184286 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.184267 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8gng\" (UniqueName: \"kubernetes.io/projected/72c5d77b-e909-447f-9ad6-dccf8ec09ab5-kube-api-access-m8gng\") pod \"kube-state-metrics-59fbdd77d-8k8wn\" (UID: \"72c5d77b-e909-447f-9ad6-dccf8ec09ab5\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8k8wn" Sep 16 19:41:23.191009 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.190990 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8k8wn" Sep 16 19:41:23.214339 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.214308 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rmmz2" Sep 16 19:41:23.225733 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:41:23.225704 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18fa5c09_f633_4382_8931_1df7d2dbcaaa.slice/crio-356de625c1b8b3818f7f0397307fcc705c4c8f87defda85235064860132f2731 WatchSource:0}: Error finding container 356de625c1b8b3818f7f0397307fcc705c4c8f87defda85235064860132f2731: Status 404 returned error can't find the container with id 356de625c1b8b3818f7f0397307fcc705c4c8f87defda85235064860132f2731 Sep 16 19:41:23.326273 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:23.326234 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" podUID="7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05" Sep 16 19:41:23.381223 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:23.381186 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-w2xzs" podUID="6d003067-b82c-413a-90fc-aa57066de4ae" Sep 16 19:41:23.492955 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:23.492931 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-8k8wn"] Sep 16 19:41:23.493839 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:41:23.493816 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72c5d77b_e909_447f_9ad6_dccf8ec09ab5.slice/crio-bcc6445e7fc75e9c6dce607d5e0f24f0faa9fd91612266e1ad2286fde1a0684a WatchSource:0}: Error finding container bcc6445e7fc75e9c6dce607d5e0f24f0faa9fd91612266e1ad2286fde1a0684a: Status 404 returned error can't find the container with id bcc6445e7fc75e9c6dce607d5e0f24f0faa9fd91612266e1ad2286fde1a0684a Sep 16 19:41:24.010427 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:24.010387 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8k8wn" event={"ID":"72c5d77b-e909-447f-9ad6-dccf8ec09ab5","Type":"ContainerStarted","Data":"bcc6445e7fc75e9c6dce607d5e0f24f0faa9fd91612266e1ad2286fde1a0684a"} Sep 16 19:41:24.012081 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:24.011994 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w2xzs" Sep 16 19:41:24.012081 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:24.012005 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rmmz2" event={"ID":"18fa5c09-f633-4382-8931-1df7d2dbcaaa","Type":"ContainerStarted","Data":"356de625c1b8b3818f7f0397307fcc705c4c8f87defda85235064860132f2731"} Sep 16 19:41:24.012288 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:24.012233 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:41:25.016791 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:25.016760 2577 generic.go:356] "Generic (PLEG): container finished" podID="18fa5c09-f633-4382-8931-1df7d2dbcaaa" containerID="5bd365181de6428bacdf0ff0ebe4395a4047c3f05063b4ec7a69ae9392512fc1" exitCode=0 Sep 16 19:41:25.017243 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:25.016826 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rmmz2" event={"ID":"18fa5c09-f633-4382-8931-1df7d2dbcaaa","Type":"ContainerDied","Data":"5bd365181de6428bacdf0ff0ebe4395a4047c3f05063b4ec7a69ae9392512fc1"} Sep 16 19:41:26.022836 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:26.022799 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8k8wn" event={"ID":"72c5d77b-e909-447f-9ad6-dccf8ec09ab5","Type":"ContainerStarted","Data":"927a786a71df911c7489ed1c9a0349859a6d58b2caad92b7717c74fc7613eae1"} Sep 16 19:41:26.023322 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:26.022894 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8k8wn" event={"ID":"72c5d77b-e909-447f-9ad6-dccf8ec09ab5","Type":"ContainerStarted","Data":"d2a7a351e8110bc8716f2cabfc16ecb4e405fc248e5ebf0cdafd3f8a878ee440"} Sep 16 19:41:26.023322 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:26.022925 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8k8wn" event={"ID":"72c5d77b-e909-447f-9ad6-dccf8ec09ab5","Type":"ContainerStarted","Data":"cc90844f12c117cb19e68e5e7000f37b6cfcdd96bc2007926c63c4f870ea38d3"} Sep 16 19:41:26.025062 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:26.025035 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rmmz2" event={"ID":"18fa5c09-f633-4382-8931-1df7d2dbcaaa","Type":"ContainerStarted","Data":"f979d610b894de355acf0821d22572bd863141e1dc3772a98eaabf9eaa77f7f6"} Sep 16 19:41:26.025196 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:26.025083 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rmmz2" event={"ID":"18fa5c09-f633-4382-8931-1df7d2dbcaaa","Type":"ContainerStarted","Data":"22b735d1d9b3e1f7f14122d29103dcf3607b33af0c2d030b33848e552c5a9619"} Sep 16 19:41:26.049239 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:26.049196 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8k8wn" podStartSLOduration=2.515026628 podStartE2EDuration="4.049180024s" totalImagesPullingTime="1.534153396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:41:26.04680686 +0000 UTC m=+161.147110935" watchObservedRunningTime="2026-09-16 19:41:26.049180024 +0000 UTC m=+161.149484099" Sep 16 19:41:26.070578 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:26.070532 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rmmz2" podStartSLOduration=3.04528217 podStartE2EDuration="4.070518047s" totalImagesPullingTime="954.845336ms" totalInitContainerRuntime="70.390541ms" isStatefulPod=true podCreationTimestamp="2026-09-16 19:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:41:26.069166801 +0000 UTC m=+161.169470876" watchObservedRunningTime="2026-09-16 19:41:26.070518047 +0000 UTC m=+161.170822122" Sep 16 19:41:26.380336 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:26.380263 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5494bd74d7-9w24z" Sep 16 19:41:26.380336 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:26.380311 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5494bd74d7-9w24z" Sep 16 19:41:26.385488 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:26.385462 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5494bd74d7-9w24z" Sep 16 19:41:27.035550 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:27.035520 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5494bd74d7-9w24z" Sep 16 19:41:27.305246 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:27.305161 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-fr2tr"] Sep 16 19:41:27.308883 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:27.308859 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-fr2tr" Sep 16 19:41:27.315515 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:27.315495 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hghz4\"" Sep 16 19:41:27.315792 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:27.315775 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 16 19:41:27.333406 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:27.333384 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-fr2tr"] Sep 16 19:41:27.392458 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:27.392434 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbsn5\" (UniqueName: \"kubernetes.io/projected/6ef36704-de3b-4565-b9ff-e7cd63f8ce2c-kube-api-access-pbsn5\") pod \"monitoring-plugin-5d85778b9d-fr2tr\" (UID: \"6ef36704-de3b-4565-b9ff-e7cd63f8ce2c\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-fr2tr" Sep 16 19:41:27.392563 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:27.392472 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6ef36704-de3b-4565-b9ff-e7cd63f8ce2c-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-fr2tr\" (UID: \"6ef36704-de3b-4565-b9ff-e7cd63f8ce2c\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-fr2tr" Sep 16 19:41:27.493451 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:27.493425 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbsn5\" (UniqueName: \"kubernetes.io/projected/6ef36704-de3b-4565-b9ff-e7cd63f8ce2c-kube-api-access-pbsn5\") pod \"monitoring-plugin-5d85778b9d-fr2tr\" (UID: \"6ef36704-de3b-4565-b9ff-e7cd63f8ce2c\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-fr2tr" Sep 16 19:41:27.493594 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:27.493464 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6ef36704-de3b-4565-b9ff-e7cd63f8ce2c-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-fr2tr\" (UID: \"6ef36704-de3b-4565-b9ff-e7cd63f8ce2c\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-fr2tr" Sep 16 19:41:27.493594 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:27.493556 2577 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 16 19:41:27.493668 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:27.493624 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ef36704-de3b-4565-b9ff-e7cd63f8ce2c-monitoring-plugin-cert podName:6ef36704-de3b-4565-b9ff-e7cd63f8ce2c nodeName:}" failed. No retries permitted until 2026-09-16 19:41:27.993607245 +0000 UTC m=+163.093911305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/6ef36704-de3b-4565-b9ff-e7cd63f8ce2c-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-fr2tr" (UID: "6ef36704-de3b-4565-b9ff-e7cd63f8ce2c") : secret "monitoring-plugin-cert" not found Sep 16 19:41:27.526476 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:27.526447 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbsn5\" (UniqueName: \"kubernetes.io/projected/6ef36704-de3b-4565-b9ff-e7cd63f8ce2c-kube-api-access-pbsn5\") pod \"monitoring-plugin-5d85778b9d-fr2tr\" (UID: \"6ef36704-de3b-4565-b9ff-e7cd63f8ce2c\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-fr2tr" Sep 16 19:41:27.984063 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:27.984031 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6f46c67568-d5s5m"] Sep 16 19:41:27.987453 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:27.987436 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6f46c67568-d5s5m" Sep 16 19:41:27.992689 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:27.992658 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 16 19:41:27.992800 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:27.992692 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 16 19:41:27.992800 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:27.992721 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 16 19:41:27.992920 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:27.992822 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 16 19:41:27.992920 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:27.992865 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 16 19:41:27.993025 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:27.992936 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-f6fwv\"" Sep 16 19:41:27.997387 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:27.997362 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5772a8ec-894b-4d0f-961d-56411c66b503-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f46c67568-d5s5m\" (UID: \"5772a8ec-894b-4d0f-961d-56411c66b503\") " pod="openshift-monitoring/telemeter-client-6f46c67568-d5s5m" Sep 16 19:41:27.997490 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:27.997409 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6ef36704-de3b-4565-b9ff-e7cd63f8ce2c-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-fr2tr\" (UID: \"6ef36704-de3b-4565-b9ff-e7cd63f8ce2c\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-fr2tr" Sep 16 19:41:27.997490 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:27.997478 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5772a8ec-894b-4d0f-961d-56411c66b503-federate-client-tls\") pod \"telemeter-client-6f46c67568-d5s5m\" (UID: \"5772a8ec-894b-4d0f-961d-56411c66b503\") " pod="openshift-monitoring/telemeter-client-6f46c67568-d5s5m" Sep 16 19:41:27.997564 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:27.997544 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5772a8ec-894b-4d0f-961d-56411c66b503-metrics-client-ca\") pod \"telemeter-client-6f46c67568-d5s5m\" (UID: \"5772a8ec-894b-4d0f-961d-56411c66b503\") " pod="openshift-monitoring/telemeter-client-6f46c67568-d5s5m" Sep 16 19:41:27.997598 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:27.997580 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5772a8ec-894b-4d0f-961d-56411c66b503-secret-telemeter-client\") pod \"telemeter-client-6f46c67568-d5s5m\" (UID: \"5772a8ec-894b-4d0f-961d-56411c66b503\") " pod="openshift-monitoring/telemeter-client-6f46c67568-d5s5m" Sep 16 19:41:27.997634 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:27.997624 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5772a8ec-894b-4d0f-961d-56411c66b503-telemeter-client-tls\") pod \"telemeter-client-6f46c67568-d5s5m\" (UID: \"5772a8ec-894b-4d0f-961d-56411c66b503\") " pod="openshift-monitoring/telemeter-client-6f46c67568-d5s5m" Sep 16 19:41:27.997689 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:27.997671 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5772a8ec-894b-4d0f-961d-56411c66b503-serving-certs-ca-bundle\") pod \"telemeter-client-6f46c67568-d5s5m\" (UID: \"5772a8ec-894b-4d0f-961d-56411c66b503\") " pod="openshift-monitoring/telemeter-client-6f46c67568-d5s5m" Sep 16 19:41:27.997726 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:27.997712 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdc48\" (UniqueName: \"kubernetes.io/projected/5772a8ec-894b-4d0f-961d-56411c66b503-kube-api-access-tdc48\") pod \"telemeter-client-6f46c67568-d5s5m\" (UID: \"5772a8ec-894b-4d0f-961d-56411c66b503\") " pod="openshift-monitoring/telemeter-client-6f46c67568-d5s5m" Sep 16 19:41:27.997762 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:27.997748 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5772a8ec-894b-4d0f-961d-56411c66b503-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f46c67568-d5s5m\" (UID: \"5772a8ec-894b-4d0f-961d-56411c66b503\") " pod="openshift-monitoring/telemeter-client-6f46c67568-d5s5m" Sep 16 19:41:27.999948 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:27.999927 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6ef36704-de3b-4565-b9ff-e7cd63f8ce2c-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-fr2tr\" (UID: \"6ef36704-de3b-4565-b9ff-e7cd63f8ce2c\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-fr2tr" Sep 16 19:41:28.003228 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.003206 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6f46c67568-d5s5m"] Sep 16 19:41:28.006270 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.006252 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 16 19:41:28.098817 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.098789 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdc48\" (UniqueName: \"kubernetes.io/projected/5772a8ec-894b-4d0f-961d-56411c66b503-kube-api-access-tdc48\") pod \"telemeter-client-6f46c67568-d5s5m\" (UID: \"5772a8ec-894b-4d0f-961d-56411c66b503\") " pod="openshift-monitoring/telemeter-client-6f46c67568-d5s5m" Sep 16 19:41:28.099268 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.098832 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5772a8ec-894b-4d0f-961d-56411c66b503-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f46c67568-d5s5m\" (UID: \"5772a8ec-894b-4d0f-961d-56411c66b503\") " pod="openshift-monitoring/telemeter-client-6f46c67568-d5s5m" Sep 16 19:41:28.099268 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.098877 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5772a8ec-894b-4d0f-961d-56411c66b503-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f46c67568-d5s5m\" (UID: \"5772a8ec-894b-4d0f-961d-56411c66b503\") " pod="openshift-monitoring/telemeter-client-6f46c67568-d5s5m" Sep 16 19:41:28.099268 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.098935 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5772a8ec-894b-4d0f-961d-56411c66b503-federate-client-tls\") pod \"telemeter-client-6f46c67568-d5s5m\" (UID: \"5772a8ec-894b-4d0f-961d-56411c66b503\") " pod="openshift-monitoring/telemeter-client-6f46c67568-d5s5m" Sep 16 19:41:28.099268 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.099170 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5772a8ec-894b-4d0f-961d-56411c66b503-metrics-client-ca\") pod \"telemeter-client-6f46c67568-d5s5m\" (UID: \"5772a8ec-894b-4d0f-961d-56411c66b503\") " pod="openshift-monitoring/telemeter-client-6f46c67568-d5s5m" Sep 16 19:41:28.099268 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.099222 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5772a8ec-894b-4d0f-961d-56411c66b503-secret-telemeter-client\") pod \"telemeter-client-6f46c67568-d5s5m\" (UID: \"5772a8ec-894b-4d0f-961d-56411c66b503\") " pod="openshift-monitoring/telemeter-client-6f46c67568-d5s5m" Sep 16 19:41:28.099529 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.099287 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5772a8ec-894b-4d0f-961d-56411c66b503-telemeter-client-tls\") pod \"telemeter-client-6f46c67568-d5s5m\" (UID: \"5772a8ec-894b-4d0f-961d-56411c66b503\") " pod="openshift-monitoring/telemeter-client-6f46c67568-d5s5m" Sep 16 19:41:28.099644 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.099605 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5772a8ec-894b-4d0f-961d-56411c66b503-serving-certs-ca-bundle\") pod \"telemeter-client-6f46c67568-d5s5m\" (UID: \"5772a8ec-894b-4d0f-961d-56411c66b503\") " pod="openshift-monitoring/telemeter-client-6f46c67568-d5s5m" Sep 16 19:41:28.099873 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.099802 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5772a8ec-894b-4d0f-961d-56411c66b503-metrics-client-ca\") pod \"telemeter-client-6f46c67568-d5s5m\" (UID: \"5772a8ec-894b-4d0f-961d-56411c66b503\") " pod="openshift-monitoring/telemeter-client-6f46c67568-d5s5m" Sep 16 19:41:28.100024 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.100000 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5772a8ec-894b-4d0f-961d-56411c66b503-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f46c67568-d5s5m\" (UID: \"5772a8ec-894b-4d0f-961d-56411c66b503\") " pod="openshift-monitoring/telemeter-client-6f46c67568-d5s5m" Sep 16 19:41:28.100398 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.100380 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5772a8ec-894b-4d0f-961d-56411c66b503-serving-certs-ca-bundle\") pod \"telemeter-client-6f46c67568-d5s5m\" (UID: \"5772a8ec-894b-4d0f-961d-56411c66b503\") " pod="openshift-monitoring/telemeter-client-6f46c67568-d5s5m" Sep 16 19:41:28.101687 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.101663 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5772a8ec-894b-4d0f-961d-56411c66b503-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f46c67568-d5s5m\" (UID: \"5772a8ec-894b-4d0f-961d-56411c66b503\") " pod="openshift-monitoring/telemeter-client-6f46c67568-d5s5m" Sep 16 19:41:28.101921 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.101900 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5772a8ec-894b-4d0f-961d-56411c66b503-secret-telemeter-client\") pod \"telemeter-client-6f46c67568-d5s5m\" (UID: \"5772a8ec-894b-4d0f-961d-56411c66b503\") " pod="openshift-monitoring/telemeter-client-6f46c67568-d5s5m" Sep 16 19:41:28.102422 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.102400 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5772a8ec-894b-4d0f-961d-56411c66b503-telemeter-client-tls\") pod \"telemeter-client-6f46c67568-d5s5m\" (UID: \"5772a8ec-894b-4d0f-961d-56411c66b503\") " pod="openshift-monitoring/telemeter-client-6f46c67568-d5s5m" Sep 16 19:41:28.102693 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.102675 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5772a8ec-894b-4d0f-961d-56411c66b503-federate-client-tls\") pod \"telemeter-client-6f46c67568-d5s5m\" (UID: \"5772a8ec-894b-4d0f-961d-56411c66b503\") " pod="openshift-monitoring/telemeter-client-6f46c67568-d5s5m" Sep 16 19:41:28.109168 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.109147 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdc48\" (UniqueName: \"kubernetes.io/projected/5772a8ec-894b-4d0f-961d-56411c66b503-kube-api-access-tdc48\") pod \"telemeter-client-6f46c67568-d5s5m\" (UID: \"5772a8ec-894b-4d0f-961d-56411c66b503\") " pod="openshift-monitoring/telemeter-client-6f46c67568-d5s5m" Sep 16 19:41:28.200845 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.200814 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-tls\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:41:28.203448 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.203426 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-tls\") pod \"image-registry-5658b974c6-rr4r4\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:41:28.216261 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.216242 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kxldl\"" Sep 16 19:41:28.217315 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.217296 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-fr2tr" Sep 16 19:41:28.223562 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.223545 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:41:28.296517 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.296494 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6f46c67568-d5s5m" Sep 16 19:41:28.301350 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.301287 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d003067-b82c-413a-90fc-aa57066de4ae-metrics-tls\") pod \"dns-default-w2xzs\" (UID: \"6d003067-b82c-413a-90fc-aa57066de4ae\") " pod="openshift-dns/dns-default-w2xzs" Sep 16 19:41:28.303534 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.303501 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d003067-b82c-413a-90fc-aa57066de4ae-metrics-tls\") pod \"dns-default-w2xzs\" (UID: \"6d003067-b82c-413a-90fc-aa57066de4ae\") " pod="openshift-dns/dns-default-w2xzs" Sep 16 19:41:28.514928 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.514780 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-fr2tr"] Sep 16 19:41:28.516931 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:41:28.516903 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ef36704_de3b_4565_b9ff_e7cd63f8ce2c.slice/crio-ad288cb594be8f94df8b55b7c1cb99fbd7efa0e6943a2eadd04873034cceb350 WatchSource:0}: Error finding container ad288cb594be8f94df8b55b7c1cb99fbd7efa0e6943a2eadd04873034cceb350: Status 404 returned error can't find the container with id ad288cb594be8f94df8b55b7c1cb99fbd7efa0e6943a2eadd04873034cceb350 Sep 16 19:41:28.517821 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.517801 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cl76f\"" Sep 16 19:41:28.522745 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.522729 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w2xzs" Sep 16 19:41:28.526689 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.526648 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5658b974c6-rr4r4"] Sep 16 19:41:28.528814 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:41:28.528793 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d7a5ce1_6f50_47ea_9148_a9eddd0bcb05.slice/crio-df030e65bca721a8f500e2c39e444f8eb539d2dfaa83945098f8ccedd2ca6a24 WatchSource:0}: Error finding container df030e65bca721a8f500e2c39e444f8eb539d2dfaa83945098f8ccedd2ca6a24: Status 404 returned error can't find the container with id df030e65bca721a8f500e2c39e444f8eb539d2dfaa83945098f8ccedd2ca6a24 Sep 16 19:41:28.581229 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.580849 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6f46c67568-d5s5m"] Sep 16 19:41:28.586695 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:41:28.586662 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5772a8ec_894b_4d0f_961d_56411c66b503.slice/crio-68da44627c2127ac6dfe7be0c5a83778fafeb96242825b080b1cbcb26809d093 WatchSource:0}: Error finding container 68da44627c2127ac6dfe7be0c5a83778fafeb96242825b080b1cbcb26809d093: Status 404 returned error can't find the container with id 68da44627c2127ac6dfe7be0c5a83778fafeb96242825b080b1cbcb26809d093 Sep 16 19:41:28.810472 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:28.810439 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w2xzs"] Sep 16 19:41:28.816249 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:41:28.816222 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d003067_b82c_413a_90fc_aa57066de4ae.slice/crio-2757fc895f7a2f99e2f2ece6e35745b79a264ad04d8cfefea9485238ad1162a3 WatchSource:0}: Error finding container 2757fc895f7a2f99e2f2ece6e35745b79a264ad04d8cfefea9485238ad1162a3: Status 404 returned error can't find the container with id 2757fc895f7a2f99e2f2ece6e35745b79a264ad04d8cfefea9485238ad1162a3 Sep 16 19:41:29.044306 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.044250 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" event={"ID":"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05","Type":"ContainerStarted","Data":"9b1b85a2eb2355960c4d5f60be7120c389f2ed09166ce56d003f31030cf0051a"} Sep 16 19:41:29.044306 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.044311 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" event={"ID":"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05","Type":"ContainerStarted","Data":"df030e65bca721a8f500e2c39e444f8eb539d2dfaa83945098f8ccedd2ca6a24"} Sep 16 19:41:29.045258 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.044479 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:41:29.046061 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.046025 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w2xzs" event={"ID":"6d003067-b82c-413a-90fc-aa57066de4ae","Type":"ContainerStarted","Data":"2757fc895f7a2f99e2f2ece6e35745b79a264ad04d8cfefea9485238ad1162a3"} Sep 16 19:41:29.047527 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.047503 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f46c67568-d5s5m" event={"ID":"5772a8ec-894b-4d0f-961d-56411c66b503","Type":"ContainerStarted","Data":"68da44627c2127ac6dfe7be0c5a83778fafeb96242825b080b1cbcb26809d093"} Sep 16 19:41:29.048779 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.048753 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-fr2tr" event={"ID":"6ef36704-de3b-4565-b9ff-e7cd63f8ce2c","Type":"ContainerStarted","Data":"ad288cb594be8f94df8b55b7c1cb99fbd7efa0e6943a2eadd04873034cceb350"} Sep 16 19:41:29.068560 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.068487 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 16 19:41:29.076302 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.073940 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.096815 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:29.096770 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"prometheus-k8s-thanos-sidecar-tls\" is forbidden: User \"system:node:ip-10-0-128-18.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-128-18.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" type="*v1.Secret" Sep 16 19:41:29.097787 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:29.097620 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"prometheus-k8s-dockercfg-v4ppr\" is forbidden: User \"system:node:ip-10-0-128-18.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-128-18.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-v4ppr\"" type="*v1.Secret" Sep 16 19:41:29.097787 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:29.097696 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"prometheus-k8s-kube-rbac-proxy-web\" is forbidden: User \"system:node:ip-10-0-128-18.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-128-18.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" type="*v1.Secret" Sep 16 19:41:29.097787 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:29.097707 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"metrics-client-certs\" is forbidden: User \"system:node:ip-10-0-128-18.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-128-18.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" type="*v1.Secret" Sep 16 19:41:29.097787 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:29.097757 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"prometheus-k8s-thanos-prometheus-http-client-file\" is forbidden: User \"system:node:ip-10-0-128-18.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-128-18.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" type="*v1.Secret" Sep 16 19:41:29.104364 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:29.104327 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-rbac-proxy\" is forbidden: User \"system:node:ip-10-0-128-18.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-128-18.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" type="*v1.Secret" Sep 16 19:41:29.104980 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:29.104941 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"prometheus-k8s-web-config\" is forbidden: User \"system:node:ip-10-0-128-18.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-128-18.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" type="*v1.Secret" Sep 16 19:41:29.105720 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:29.105574 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"prometheus-k8s-rulefiles-2\" is forbidden: User \"system:node:ip-10-0-128-18.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-128-18.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" type="*v1.ConfigMap" Sep 16 19:41:29.106159 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:29.106048 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"prometheus-k8s-grpc-tls-4ept3i49o5gqc\" is forbidden: User \"system:node:ip-10-0-128-18.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-128-18.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4ept3i49o5gqc\"" type="*v1.Secret" Sep 16 19:41:29.106410 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:29.106387 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"serving-certs-ca-bundle\" is forbidden: User \"system:node:ip-10-0-128-18.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-128-18.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" type="*v1.ConfigMap" Sep 16 19:41:29.106643 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.106622 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.106737 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.106656 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.106737 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.106682 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-web-config\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.106737 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.106709 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.106901 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.106737 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.106901 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.106761 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.106901 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:29.106778 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kubelet-serving-ca-bundle\" is forbidden: User \"system:node:ip-10-0-128-18.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-128-18.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" type="*v1.ConfigMap" Sep 16 19:41:29.106901 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.106792 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.106901 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.106820 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.106901 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.106848 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.106901 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.106877 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.107259 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.106913 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-config\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.107259 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.106947 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.107259 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.106982 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.107259 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.107007 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.107259 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.107040 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-config-out\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.107259 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.107147 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.107259 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.107188 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.107259 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.107218 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.107682 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.107281 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.107682 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.107312 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7knq\" (UniqueName: \"kubernetes.io/projected/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-kube-api-access-m7knq\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.107836 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:29.107748 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"prometheus-trusted-ca-bundle\" is forbidden: User \"system:node:ip-10-0-128-18.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-128-18.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" type="*v1.ConfigMap" Sep 16 19:41:29.107836 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:29.107802 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"prometheus-k8s-rulefiles-0\" is forbidden: User \"system:node:ip-10-0-128-18.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-128-18.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" type="*v1.ConfigMap" Sep 16 19:41:29.107836 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:29.107816 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"prometheus-k8s\" is forbidden: User \"system:node:ip-10-0-128-18.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-128-18.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" type="*v1.Secret" Sep 16 19:41:29.110102 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:29.110076 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"prometheus-k8s-rulefiles-1\" is forbidden: User \"system:node:ip-10-0-128-18.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-128-18.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" type="*v1.ConfigMap" Sep 16 19:41:29.110220 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:29.110185 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"prometheus-k8s-tls\" is forbidden: User \"system:node:ip-10-0-128-18.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-128-18.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" type="*v1.Secret" Sep 16 19:41:29.112350 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:29.112299 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"prometheus-k8s-tls-assets-0\" is forbidden: User \"system:node:ip-10-0-128-18.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-128-18.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" type="*v1.Secret" Sep 16 19:41:29.173227 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.173174 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" podStartSLOduration=163.173158073 podStartE2EDuration="2m43.173158073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:38:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:41:29.172795796 +0000 UTC m=+164.273099869" watchObservedRunningTime="2026-09-16 19:41:29.173158073 +0000 UTC m=+164.273462148" Sep 16 19:41:29.201901 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.201867 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 16 19:41:29.209852 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.208823 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.209852 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.208891 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.209852 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.208945 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.209852 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.208985 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.209852 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.209012 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7knq\" (UniqueName: \"kubernetes.io/projected/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-kube-api-access-m7knq\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.209852 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.209049 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.209852 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.209071 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.209852 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.209130 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-web-config\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.209852 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.209170 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.209852 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.209203 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.209852 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.209229 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.209852 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.209262 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.209852 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.209291 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.209852 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.209318 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.209852 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.209349 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.209852 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.209377 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-config\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.209852 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.209398 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.210774 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.209433 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.210774 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.209457 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.210774 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.209486 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-config-out\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.210774 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.209722 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.210774 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.210385 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.212355 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.212331 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-config-out\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.229788 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.229766 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7knq\" (UniqueName: \"kubernetes.io/projected/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-kube-api-access-m7knq\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:29.867965 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.867937 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5658b974c6-rr4r4"] Sep 16 19:41:29.987126 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.987080 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 16 19:41:29.990661 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:29.990635 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:30.060835 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.060794 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-fr2tr" event={"ID":"6ef36704-de3b-4565-b9ff-e7cd63f8ce2c","Type":"ContainerStarted","Data":"fe41a6c4d94bf48ce2f3a6a092edd757cf220ff849c638e5290ac4b1363128e5"} Sep 16 19:41:30.061039 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.061019 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-fr2tr" Sep 16 19:41:30.066809 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.066748 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-fr2tr" Sep 16 19:41:30.092181 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.092138 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-fr2tr" podStartSLOduration=1.796233008 podStartE2EDuration="3.092124835s" totalImagesPullingTime="1.295891827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:41:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:41:30.091396575 +0000 UTC m=+165.191700652" watchObservedRunningTime="2026-09-16 19:41:30.092124835 +0000 UTC m=+165.192428902" Sep 16 19:41:30.101751 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.101732 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 16 19:41:30.110251 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.110225 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:30.161478 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.161454 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4ept3i49o5gqc\"" Sep 16 19:41:30.172845 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.172823 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:30.189070 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.189051 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 16 19:41:30.192617 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.192596 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:30.209713 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:30.209689 2577 configmap.go:193] Couldn't get configMap openshift-monitoring/prometheus-k8s-rulefiles-0: failed to sync configmap cache: timed out waiting for the condition Sep 16 19:41:30.209713 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:30.209701 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-k8s: failed to sync secret cache: timed out waiting for the condition Sep 16 19:41:30.209872 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:30.209713 2577 secret.go:189] Couldn't get secret openshift-monitoring/kube-rbac-proxy: failed to sync secret cache: timed out waiting for the condition Sep 16 19:41:30.209872 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:30.209724 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-k8s-kube-rbac-proxy-web: failed to sync secret cache: timed out waiting for the condition Sep 16 19:41:30.209872 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:30.209748 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-k8s-thanos-prometheus-http-client-file: failed to sync secret cache: timed out waiting for the condition Sep 16 19:41:30.209872 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:30.209763 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-rulefiles-0 podName:8ed9b4e9-63c7-4d6d-9342-3229a1a7b768 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:30.709743797 +0000 UTC m=+165.810047854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-k8s-rulefiles-0" (UniqueName: "kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-rulefiles-0") pod "prometheus-k8s-0" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768") : failed to sync configmap cache: timed out waiting for the condition Sep 16 19:41:30.209872 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:30.209766 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-k8s-thanos-sidecar-tls: failed to sync secret cache: timed out waiting for the condition Sep 16 19:41:30.209872 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:30.209776 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-k8s-tls: failed to sync secret cache: timed out waiting for the condition Sep 16 19:41:30.209872 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:30.209784 2577 configmap.go:193] Couldn't get configMap openshift-monitoring/prometheus-k8s-rulefiles-2: failed to sync configmap cache: timed out waiting for the condition Sep 16 19:41:30.209872 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:30.209800 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-prometheus-k8s-thanos-sidecar-tls podName:8ed9b4e9-63c7-4d6d-9342-3229a1a7b768 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:30.709786388 +0000 UTC m=+165.810090442 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-prometheus-k8s-thanos-sidecar-tls" (UniqueName: "kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-prometheus-k8s-thanos-sidecar-tls") pod "prometheus-k8s-0" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768") : failed to sync secret cache: timed out waiting for the condition Sep 16 19:41:30.209872 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:30.209811 2577 configmap.go:193] Couldn't get configMap openshift-monitoring/prometheus-k8s-rulefiles-1: failed to sync configmap cache: timed out waiting for the condition Sep 16 19:41:30.209872 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:30.209819 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-config podName:8ed9b4e9-63c7-4d6d-9342-3229a1a7b768 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:30.709805376 +0000 UTC m=+165.810109429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-config") pod "prometheus-k8s-0" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768") : failed to sync secret cache: timed out waiting for the condition Sep 16 19:41:30.209872 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:30.209825 2577 secret.go:189] Couldn't get secret openshift-monitoring/metrics-client-certs: failed to sync secret cache: timed out waiting for the condition Sep 16 19:41:30.209872 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:30.209831 2577 configmap.go:193] Couldn't get configMap openshift-monitoring/prometheus-trusted-ca-bundle: failed to sync configmap cache: timed out waiting for the condition Sep 16 19:41:30.209872 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:30.209836 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-thanos-prometheus-http-client-file podName:8ed9b4e9-63c7-4d6d-9342-3229a1a7b768 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:30.709827231 +0000 UTC m=+165.810131283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "thanos-prometheus-http-client-file" (UniqueName: "kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-thanos-prometheus-http-client-file") pod "prometheus-k8s-0" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768") : failed to sync secret cache: timed out waiting for the condition Sep 16 19:41:30.209872 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:30.209849 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-k8s-web-config: failed to sync secret cache: timed out waiting for the condition Sep 16 19:41:30.209872 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:30.209852 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-kube-rbac-proxy podName:8ed9b4e9-63c7-4d6d-9342-3229a1a7b768 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:30.709844359 +0000 UTC m=+165.810148417 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-kube-rbac-proxy" (UniqueName: "kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-kube-rbac-proxy") pod "prometheus-k8s-0" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768") : failed to sync secret cache: timed out waiting for the condition Sep 16 19:41:30.209872 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:30.209866 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-prometheus-k8s-kube-rbac-proxy-web podName:8ed9b4e9-63c7-4d6d-9342-3229a1a7b768 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:30.709859611 +0000 UTC m=+165.810163664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-prometheus-k8s-kube-rbac-proxy-web" (UniqueName: "kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-prometheus-k8s-kube-rbac-proxy-web") pod "prometheus-k8s-0" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768") : failed to sync secret cache: timed out waiting for the condition Sep 16 19:41:30.210579 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:30.209880 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-prometheus-k8s-tls podName:8ed9b4e9-63c7-4d6d-9342-3229a1a7b768 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:30.709873109 +0000 UTC m=+165.810177162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-prometheus-k8s-tls" (UniqueName: "kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-prometheus-k8s-tls") pod "prometheus-k8s-0" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768") : failed to sync secret cache: timed out waiting for the condition Sep 16 19:41:30.210579 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:30.209893 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-rulefiles-2 podName:8ed9b4e9-63c7-4d6d-9342-3229a1a7b768 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:30.709886412 +0000 UTC m=+165.810190471 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-k8s-rulefiles-2" (UniqueName: "kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-rulefiles-2") pod "prometheus-k8s-0" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768") : failed to sync configmap cache: timed out waiting for the condition Sep 16 19:41:30.210579 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:30.209906 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-rulefiles-1 podName:8ed9b4e9-63c7-4d6d-9342-3229a1a7b768 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:30.70989917 +0000 UTC m=+165.810203227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-k8s-rulefiles-1" (UniqueName: "kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-rulefiles-1") pod "prometheus-k8s-0" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768") : failed to sync configmap cache: timed out waiting for the condition Sep 16 19:41:30.210579 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:30.209920 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-metrics-client-certs podName:8ed9b4e9-63c7-4d6d-9342-3229a1a7b768 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:30.709912167 +0000 UTC m=+165.810216226 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-metrics-client-certs" (UniqueName: "kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-metrics-client-certs") pod "prometheus-k8s-0" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768") : failed to sync secret cache: timed out waiting for the condition Sep 16 19:41:30.210579 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:30.209940 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-trusted-ca-bundle podName:8ed9b4e9-63c7-4d6d-9342-3229a1a7b768 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:30.709933573 +0000 UTC m=+165.810237626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-trusted-ca-bundle") pod "prometheus-k8s-0" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768") : failed to sync configmap cache: timed out waiting for the condition Sep 16 19:41:30.210579 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:30.209957 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-web-config podName:8ed9b4e9-63c7-4d6d-9342-3229a1a7b768 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:30.709950783 +0000 UTC m=+165.810254852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "web-config" (UniqueName: "kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-web-config") pod "prometheus-k8s-0" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768") : failed to sync secret cache: timed out waiting for the condition Sep 16 19:41:30.216482 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.216461 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-v4ppr\"" Sep 16 19:41:30.300955 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.300928 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 16 19:41:30.348400 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.348334 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 16 19:41:30.352242 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.352051 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 16 19:41:30.516098 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.516067 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 16 19:41:30.554263 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.554236 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 16 19:41:30.556866 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.556845 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 16 19:41:30.575148 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.575123 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 16 19:41:30.601463 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.601400 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 16 19:41:30.676794 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.676772 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 16 19:41:30.682392 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.682373 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 16 19:41:30.696534 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.696514 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 16 19:41:30.700061 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.700047 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 16 19:41:30.724015 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.723990 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:30.724099 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.724025 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:30.724099 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.724063 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-web-config\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:30.724099 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.724093 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:30.724282 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.724148 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:30.724282 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.724195 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:30.724282 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.724225 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-config\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:30.724282 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.724249 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:30.724470 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.724286 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:30.724470 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.724312 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:30.724470 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.724362 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:30.724470 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.724387 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:30.727236 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.726049 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:30.727236 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.726585 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:30.727236 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.727093 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:30.727903 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.727877 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:30.728073 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.728018 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:30.728244 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.728200 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:30.728488 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.728452 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:30.728699 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.728665 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:30.729497 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.729476 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-config\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:30.729841 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.729776 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-web-config\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:30.730015 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.729994 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:30.730085 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.730066 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:30.890888 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:30.890864 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:31.067101 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:31.067070 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w2xzs" event={"ID":"6d003067-b82c-413a-90fc-aa57066de4ae","Type":"ContainerStarted","Data":"2e0c0f18cea907a007654bd96b6c48d2f61fa2bc5623101bbc4db70efba98da2"} Sep 16 19:41:31.067337 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:31.067156 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w2xzs" event={"ID":"6d003067-b82c-413a-90fc-aa57066de4ae","Type":"ContainerStarted","Data":"def4fbba894a1b36c2d16771bd499cd7897168c790b225aa31b7cac6905a5027"} Sep 16 19:41:31.067337 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:31.067187 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-w2xzs" Sep 16 19:41:31.068759 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:31.068734 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f46c67568-d5s5m" event={"ID":"5772a8ec-894b-4d0f-961d-56411c66b503","Type":"ContainerStarted","Data":"ccb044bcfd159df100722a6e554028d68e1bc822e7cafa93e349c654b18e29cf"} Sep 16 19:41:31.088466 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:31.088426 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-w2xzs" podStartSLOduration=129.030672227 podStartE2EDuration="2m11.088412137s" totalImagesPullingTime="2.05773991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:39:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:41:31.08757088 +0000 UTC m=+166.187874974" watchObservedRunningTime="2026-09-16 19:41:31.088412137 +0000 UTC m=+166.188716280" Sep 16 19:41:31.195267 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:31.195245 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 16 19:41:31.196520 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:41:31.196497 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ed9b4e9_63c7_4d6d_9342_3229a1a7b768.slice/crio-c3d9922eab123b2739a5cffb2fcb74e134814ae9813a93c6846441022a12e4bc WatchSource:0}: Error finding container c3d9922eab123b2739a5cffb2fcb74e134814ae9813a93c6846441022a12e4bc: Status 404 returned error can't find the container with id c3d9922eab123b2739a5cffb2fcb74e134814ae9813a93c6846441022a12e4bc Sep 16 19:41:32.074249 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:32.074215 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768","Type":"ContainerStarted","Data":"c3d9922eab123b2739a5cffb2fcb74e134814ae9813a93c6846441022a12e4bc"} Sep 16 19:41:33.086565 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:33.086529 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f46c67568-d5s5m" event={"ID":"5772a8ec-894b-4d0f-961d-56411c66b503","Type":"ContainerStarted","Data":"03ff52f544420decd08562ba97919a6c1844bb559aebdcd846fd7e0a6a783445"} Sep 16 19:41:33.086974 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:33.086635 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f46c67568-d5s5m" event={"ID":"5772a8ec-894b-4d0f-961d-56411c66b503","Type":"ContainerStarted","Data":"b1867aec00cf29b58817f31c7dd481e96b2b5c222844c125c3ef5c5518090408"} Sep 16 19:41:33.088173 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:33.088148 2577 generic.go:356] "Generic (PLEG): container finished" podID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerID="dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8" exitCode=0 Sep 16 19:41:33.088259 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:33.088232 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768","Type":"ContainerDied","Data":"dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8"} Sep 16 19:41:33.119147 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:33.119084 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6f46c67568-d5s5m" podStartSLOduration=2.704085907 podStartE2EDuration="6.119070138s" totalImagesPullingTime="3.414984231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:41:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:41:33.118073088 +0000 UTC m=+168.218377163" watchObservedRunningTime="2026-09-16 19:41:33.119070138 +0000 UTC m=+168.219374212" Sep 16 19:41:37.106618 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:37.106580 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768","Type":"ContainerStarted","Data":"04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423"} Sep 16 19:41:37.106970 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:37.106650 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768","Type":"ContainerStarted","Data":"29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e"} Sep 16 19:41:38.114938 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:38.114914 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768","Type":"ContainerStarted","Data":"d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f"} Sep 16 19:41:38.115237 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:38.114982 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768","Type":"ContainerStarted","Data":"fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a"} Sep 16 19:41:38.115237 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:38.115009 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768","Type":"ContainerStarted","Data":"9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1"} Sep 16 19:41:39.122843 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:39.122807 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768","Type":"ContainerStarted","Data":"15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c"} Sep 16 19:41:39.162743 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:39.162678 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.579714961 podStartE2EDuration="10.162658545s" totalImagesPullingTime="5.558892036s" totalInitContainerRuntime="24.051548ms" isStatefulPod=false podCreationTimestamp="2026-09-16 19:41:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:41:39.161188097 +0000 UTC m=+174.261492172" watchObservedRunningTime="2026-09-16 19:41:39.162658545 +0000 UTC m=+174.262962624" Sep 16 19:41:40.891126 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:40.891087 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:41:41.076810 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:41.076777 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-w2xzs" Sep 16 19:41:44.175803 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:44.175773 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5494bd74d7-9w24z"] Sep 16 19:41:51.074511 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:51.074479 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:41:55.189040 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:55.188964 2577 generic.go:356] "Generic (PLEG): container finished" podID="700069ae-01f3-4f93-b0df-1c60a7dadf04" containerID="9b5759009140eaf7eb66ef50792ec1db288dbbb1fd16c127d0602e94ff301071" exitCode=0 Sep 16 19:41:55.189040 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:55.189022 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4sf5n" event={"ID":"700069ae-01f3-4f93-b0df-1c60a7dadf04","Type":"ContainerDied","Data":"9b5759009140eaf7eb66ef50792ec1db288dbbb1fd16c127d0602e94ff301071"} Sep 16 19:41:55.189466 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:55.189354 2577 scope.go:117] "RemoveContainer" containerID="9b5759009140eaf7eb66ef50792ec1db288dbbb1fd16c127d0602e94ff301071" Sep 16 19:41:56.088804 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:56.088763 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" podUID="7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05" containerName="registry" containerID="cri-o://9b1b85a2eb2355960c4d5f60be7120c389f2ed09166ce56d003f31030cf0051a" gracePeriod=30 Sep 16 19:41:56.195229 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:56.195196 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4sf5n" event={"ID":"700069ae-01f3-4f93-b0df-1c60a7dadf04","Type":"ContainerStarted","Data":"99e205c66e103251a2548a2ace41afe93424ecc7149e3ec51b3010337b65b2b6"} Sep 16 19:41:56.352066 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:56.352011 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:41:56.429748 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:56.429726 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-installation-pull-secrets\") pod \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " Sep 16 19:41:56.429894 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:56.429757 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlnjr\" (UniqueName: \"kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-kube-api-access-xlnjr\") pod \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " Sep 16 19:41:56.429894 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:56.429779 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-certificates\") pod \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " Sep 16 19:41:56.429894 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:56.429810 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-ca-trust-extracted\") pod \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " Sep 16 19:41:56.430047 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:56.429942 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-bound-sa-token\") pod \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " Sep 16 19:41:56.430129 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:56.430054 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-image-registry-private-configuration\") pod \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " Sep 16 19:41:56.430129 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:56.430083 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-tls\") pod \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " Sep 16 19:41:56.430236 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:56.430131 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-trusted-ca\") pod \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\" (UID: \"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05\") " Sep 16 19:41:56.430236 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:56.430225 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05" (UID: "7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 19:41:56.430621 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:56.430422 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-certificates\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:41:56.430816 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:56.430792 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05" (UID: "7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 19:41:56.432371 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:56.432337 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05" (UID: "7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 19:41:56.432473 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:56.432435 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05" (UID: "7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 19:41:56.432631 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:56.432608 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05" (UID: "7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 19:41:56.432717 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:56.432694 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-kube-api-access-xlnjr" (OuterVolumeSpecName: "kube-api-access-xlnjr") pod "7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05" (UID: "7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05"). InnerVolumeSpecName "kube-api-access-xlnjr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 19:41:56.433079 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:56.433056 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05" (UID: "7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 19:41:56.438707 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:56.438687 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05" (UID: "7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 19:41:56.531470 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:56.531441 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-image-registry-private-configuration\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:41:56.531565 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:56.531472 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-registry-tls\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:41:56.531565 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:56.531487 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-trusted-ca\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:41:56.531565 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:56.531503 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-installation-pull-secrets\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:41:56.531565 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:56.531517 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlnjr\" (UniqueName: \"kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-kube-api-access-xlnjr\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:41:56.531565 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:56.531532 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-ca-trust-extracted\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:41:56.531565 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:56.531546 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05-bound-sa-token\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:41:57.200259 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:57.200227 2577 generic.go:356] "Generic (PLEG): container finished" podID="7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05" containerID="9b1b85a2eb2355960c4d5f60be7120c389f2ed09166ce56d003f31030cf0051a" exitCode=0 Sep 16 19:41:57.200737 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:57.200270 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" Sep 16 19:41:57.200737 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:57.200293 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" event={"ID":"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05","Type":"ContainerDied","Data":"9b1b85a2eb2355960c4d5f60be7120c389f2ed09166ce56d003f31030cf0051a"} Sep 16 19:41:57.200737 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:57.200344 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5658b974c6-rr4r4" event={"ID":"7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05","Type":"ContainerDied","Data":"df030e65bca721a8f500e2c39e444f8eb539d2dfaa83945098f8ccedd2ca6a24"} Sep 16 19:41:57.200737 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:57.200373 2577 scope.go:117] "RemoveContainer" containerID="9b1b85a2eb2355960c4d5f60be7120c389f2ed09166ce56d003f31030cf0051a" Sep 16 19:41:57.210377 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:57.210234 2577 scope.go:117] "RemoveContainer" containerID="9b1b85a2eb2355960c4d5f60be7120c389f2ed09166ce56d003f31030cf0051a" Sep 16 19:41:57.210522 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:41:57.210503 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b1b85a2eb2355960c4d5f60be7120c389f2ed09166ce56d003f31030cf0051a\": container with ID starting with 9b1b85a2eb2355960c4d5f60be7120c389f2ed09166ce56d003f31030cf0051a not found: ID does not exist" containerID="9b1b85a2eb2355960c4d5f60be7120c389f2ed09166ce56d003f31030cf0051a" Sep 16 19:41:57.210572 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:57.210531 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b1b85a2eb2355960c4d5f60be7120c389f2ed09166ce56d003f31030cf0051a"} err="failed to get container status \"9b1b85a2eb2355960c4d5f60be7120c389f2ed09166ce56d003f31030cf0051a\": rpc error: code = NotFound desc = could not find container \"9b1b85a2eb2355960c4d5f60be7120c389f2ed09166ce56d003f31030cf0051a\": container with ID starting with 9b1b85a2eb2355960c4d5f60be7120c389f2ed09166ce56d003f31030cf0051a not found: ID does not exist" Sep 16 19:41:57.223944 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:57.223923 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5658b974c6-rr4r4"] Sep 16 19:41:57.229184 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:57.229166 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5658b974c6-rr4r4"] Sep 16 19:41:57.431424 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:41:57.431395 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05" path="/var/lib/kubelet/pods/7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05/volumes" Sep 16 19:42:09.197470 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:09.197426 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5494bd74d7-9w24z" podUID="9301ece6-9bd1-4c5a-a8da-a3332da1a287" containerName="console" containerID="cri-o://01111ada4b851b248c28a95010381a5b7114df5ab928c80bf7a5cde306fd93f1" gracePeriod=15 Sep 16 19:42:09.447031 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:09.447011 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5494bd74d7-9w24z" Sep 16 19:42:09.531541 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:09.531516 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9301ece6-9bd1-4c5a-a8da-a3332da1a287-console-serving-cert\") pod \"9301ece6-9bd1-4c5a-a8da-a3332da1a287\" (UID: \"9301ece6-9bd1-4c5a-a8da-a3332da1a287\") " Sep 16 19:42:09.531683 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:09.531561 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9301ece6-9bd1-4c5a-a8da-a3332da1a287-console-config\") pod \"9301ece6-9bd1-4c5a-a8da-a3332da1a287\" (UID: \"9301ece6-9bd1-4c5a-a8da-a3332da1a287\") " Sep 16 19:42:09.531683 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:09.531595 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5tj5\" (UniqueName: \"kubernetes.io/projected/9301ece6-9bd1-4c5a-a8da-a3332da1a287-kube-api-access-b5tj5\") pod \"9301ece6-9bd1-4c5a-a8da-a3332da1a287\" (UID: \"9301ece6-9bd1-4c5a-a8da-a3332da1a287\") " Sep 16 19:42:09.531683 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:09.531631 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9301ece6-9bd1-4c5a-a8da-a3332da1a287-oauth-serving-cert\") pod \"9301ece6-9bd1-4c5a-a8da-a3332da1a287\" (UID: \"9301ece6-9bd1-4c5a-a8da-a3332da1a287\") " Sep 16 19:42:09.531683 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:09.531655 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9301ece6-9bd1-4c5a-a8da-a3332da1a287-service-ca\") pod \"9301ece6-9bd1-4c5a-a8da-a3332da1a287\" (UID: \"9301ece6-9bd1-4c5a-a8da-a3332da1a287\") " Sep 16 19:42:09.531683 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:09.531680 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9301ece6-9bd1-4c5a-a8da-a3332da1a287-console-oauth-config\") pod \"9301ece6-9bd1-4c5a-a8da-a3332da1a287\" (UID: \"9301ece6-9bd1-4c5a-a8da-a3332da1a287\") " Sep 16 19:42:09.532082 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:09.532045 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9301ece6-9bd1-4c5a-a8da-a3332da1a287-console-config" (OuterVolumeSpecName: "console-config") pod "9301ece6-9bd1-4c5a-a8da-a3332da1a287" (UID: "9301ece6-9bd1-4c5a-a8da-a3332da1a287"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 19:42:09.532191 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:09.532054 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9301ece6-9bd1-4c5a-a8da-a3332da1a287-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9301ece6-9bd1-4c5a-a8da-a3332da1a287" (UID: "9301ece6-9bd1-4c5a-a8da-a3332da1a287"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 19:42:09.532191 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:09.532056 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9301ece6-9bd1-4c5a-a8da-a3332da1a287-service-ca" (OuterVolumeSpecName: "service-ca") pod "9301ece6-9bd1-4c5a-a8da-a3332da1a287" (UID: "9301ece6-9bd1-4c5a-a8da-a3332da1a287"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 19:42:09.534010 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:09.533989 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9301ece6-9bd1-4c5a-a8da-a3332da1a287-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9301ece6-9bd1-4c5a-a8da-a3332da1a287" (UID: "9301ece6-9bd1-4c5a-a8da-a3332da1a287"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 19:42:09.534128 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:09.534091 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9301ece6-9bd1-4c5a-a8da-a3332da1a287-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9301ece6-9bd1-4c5a-a8da-a3332da1a287" (UID: "9301ece6-9bd1-4c5a-a8da-a3332da1a287"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 19:42:09.534178 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:09.534159 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9301ece6-9bd1-4c5a-a8da-a3332da1a287-kube-api-access-b5tj5" (OuterVolumeSpecName: "kube-api-access-b5tj5") pod "9301ece6-9bd1-4c5a-a8da-a3332da1a287" (UID: "9301ece6-9bd1-4c5a-a8da-a3332da1a287"). InnerVolumeSpecName "kube-api-access-b5tj5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 19:42:09.633217 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:09.633181 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9301ece6-9bd1-4c5a-a8da-a3332da1a287-console-serving-cert\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:42:09.633217 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:09.633212 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9301ece6-9bd1-4c5a-a8da-a3332da1a287-console-config\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:42:09.633217 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:09.633221 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5tj5\" (UniqueName: \"kubernetes.io/projected/9301ece6-9bd1-4c5a-a8da-a3332da1a287-kube-api-access-b5tj5\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:42:09.633394 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:09.633231 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9301ece6-9bd1-4c5a-a8da-a3332da1a287-oauth-serving-cert\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:42:09.633394 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:09.633240 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9301ece6-9bd1-4c5a-a8da-a3332da1a287-service-ca\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:42:09.633394 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:09.633248 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9301ece6-9bd1-4c5a-a8da-a3332da1a287-console-oauth-config\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:42:10.259276 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:10.259238 2577 generic.go:356] "Generic (PLEG): container finished" podID="9301ece6-9bd1-4c5a-a8da-a3332da1a287" containerID="01111ada4b851b248c28a95010381a5b7114df5ab928c80bf7a5cde306fd93f1" exitCode=0 Sep 16 19:42:10.259677 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:10.259289 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5494bd74d7-9w24z" Sep 16 19:42:10.259677 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:10.259319 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5494bd74d7-9w24z" event={"ID":"9301ece6-9bd1-4c5a-a8da-a3332da1a287","Type":"ContainerDied","Data":"01111ada4b851b248c28a95010381a5b7114df5ab928c80bf7a5cde306fd93f1"} Sep 16 19:42:10.259677 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:10.259372 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5494bd74d7-9w24z" event={"ID":"9301ece6-9bd1-4c5a-a8da-a3332da1a287","Type":"ContainerDied","Data":"93a57e0500f3adc1a078a2ba8b7d1dbd10f911e3011790b60b3bebb5366979ed"} Sep 16 19:42:10.259677 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:10.259393 2577 scope.go:117] "RemoveContainer" containerID="01111ada4b851b248c28a95010381a5b7114df5ab928c80bf7a5cde306fd93f1" Sep 16 19:42:10.268758 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:10.268742 2577 scope.go:117] "RemoveContainer" containerID="01111ada4b851b248c28a95010381a5b7114df5ab928c80bf7a5cde306fd93f1" Sep 16 19:42:10.269041 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:42:10.269024 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01111ada4b851b248c28a95010381a5b7114df5ab928c80bf7a5cde306fd93f1\": container with ID starting with 01111ada4b851b248c28a95010381a5b7114df5ab928c80bf7a5cde306fd93f1 not found: ID does not exist" containerID="01111ada4b851b248c28a95010381a5b7114df5ab928c80bf7a5cde306fd93f1" Sep 16 19:42:10.269090 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:10.269050 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01111ada4b851b248c28a95010381a5b7114df5ab928c80bf7a5cde306fd93f1"} err="failed to get container status \"01111ada4b851b248c28a95010381a5b7114df5ab928c80bf7a5cde306fd93f1\": rpc error: code = NotFound desc = could not find container \"01111ada4b851b248c28a95010381a5b7114df5ab928c80bf7a5cde306fd93f1\": container with ID starting with 01111ada4b851b248c28a95010381a5b7114df5ab928c80bf7a5cde306fd93f1 not found: ID does not exist" Sep 16 19:42:10.284889 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:10.284865 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5494bd74d7-9w24z"] Sep 16 19:42:10.289716 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:10.289693 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5494bd74d7-9w24z"] Sep 16 19:42:11.430838 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:11.430806 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9301ece6-9bd1-4c5a-a8da-a3332da1a287" path="/var/lib/kubelet/pods/9301ece6-9bd1-4c5a-a8da-a3332da1a287/volumes" Sep 16 19:42:30.891455 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:30.891423 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:30.910917 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:30.910893 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:31.359446 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:31.359423 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:47.397079 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.397046 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 16 19:42:47.398043 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.398010 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerName="prometheus" containerID="cri-o://29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e" gracePeriod=600 Sep 16 19:42:47.398796 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.398561 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerName="kube-rbac-proxy-thanos" containerID="cri-o://15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c" gracePeriod=600 Sep 16 19:42:47.398907 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.398584 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerName="kube-rbac-proxy" containerID="cri-o://d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f" gracePeriod=600 Sep 16 19:42:47.398970 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.398603 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerName="kube-rbac-proxy-web" containerID="cri-o://fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a" gracePeriod=600 Sep 16 19:42:47.399070 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.398620 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerName="thanos-sidecar" containerID="cri-o://9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1" gracePeriod=600 Sep 16 19:42:47.399207 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.398634 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerName="config-reloader" containerID="cri-o://04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423" gracePeriod=600 Sep 16 19:42:47.761803 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.761773 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:47.826785 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.826756 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-kube-rbac-proxy\") pod \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " Sep 16 19:42:47.826946 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.826808 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-web-config\") pod \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " Sep 16 19:42:47.826946 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.826840 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7knq\" (UniqueName: \"kubernetes.io/projected/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-kube-api-access-m7knq\") pod \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " Sep 16 19:42:47.826946 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.826859 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-configmap-serving-certs-ca-bundle\") pod \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " Sep 16 19:42:47.826946 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.826876 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-config-out\") pod \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " Sep 16 19:42:47.826946 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.826902 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-trusted-ca-bundle\") pod \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " Sep 16 19:42:47.826946 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.826918 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-prometheus-k8s-tls\") pod \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " Sep 16 19:42:47.826946 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.826945 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-configmap-metrics-client-ca\") pod \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " Sep 16 19:42:47.827317 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.827277 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 19:42:47.827414 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.827384 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 19:42:47.827655 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.827621 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 19:42:47.827814 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.827798 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-tls-assets\") pod \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " Sep 16 19:42:47.828413 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.828395 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-config\") pod \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " Sep 16 19:42:47.828572 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.828556 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-rulefiles-1\") pod \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " Sep 16 19:42:47.828717 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.828701 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-thanos-prometheus-http-client-file\") pod \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " Sep 16 19:42:47.828842 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.828828 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-configmap-kubelet-serving-ca-bundle\") pod \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " Sep 16 19:42:47.828943 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.828928 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-metrics-client-certs\") pod \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " Sep 16 19:42:47.829042 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.829029 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-grpc-tls\") pod \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " Sep 16 19:42:47.829197 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.829182 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-rulefiles-2\") pod \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " Sep 16 19:42:47.829320 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.829307 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-db\") pod \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " Sep 16 19:42:47.829436 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.829412 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " Sep 16 19:42:47.829542 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.829448 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " Sep 16 19:42:47.829542 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.829474 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-rulefiles-0\") pod \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\" (UID: \"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768\") " Sep 16 19:42:47.829741 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.829726 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-configmap-metrics-client-ca\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:42:47.829853 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.829833 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:42:47.829940 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.829856 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:42:47.829997 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.829943 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-kube-api-access-m7knq" (OuterVolumeSpecName: "kube-api-access-m7knq") pod "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768"). InnerVolumeSpecName "kube-api-access-m7knq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 19:42:47.830150 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.830015 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 19:42:47.830496 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.830461 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-config-out" (OuterVolumeSpecName: "config-out") pod "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 19:42:47.831014 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.830722 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 19:42:47.831014 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.830718 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 19:42:47.831176 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.831065 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 19:42:47.831711 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.831451 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 19:42:47.831711 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.831599 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 19:42:47.831944 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.831744 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-config" (OuterVolumeSpecName: "config") pod "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 19:42:47.831944 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.831915 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 19:42:47.832238 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.832216 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 19:42:47.832460 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.832431 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 19:42:47.833483 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.833445 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 19:42:47.834159 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.834129 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 19:42:47.834311 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.834293 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 19:42:47.834848 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.834833 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 19:42:47.843469 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.843432 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-web-config" (OuterVolumeSpecName: "web-config") pod "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" (UID: "8ed9b4e9-63c7-4d6d-9342-3229a1a7b768"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 19:42:47.931034 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.930955 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:42:47.931034 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.930984 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-tls-assets\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:42:47.931034 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.930994 2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-config\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:42:47.931034 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.931002 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:42:47.931034 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.931012 2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:42:47.931034 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.931022 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:42:47.931034 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.931030 2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-metrics-client-certs\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:42:47.931034 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.931038 2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-grpc-tls\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:42:47.931401 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.931046 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:42:47.931401 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.931054 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-db\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:42:47.931401 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.931062 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:42:47.931401 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.931071 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:42:47.931401 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.931079 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:42:47.931401 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.931087 2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-secret-kube-rbac-proxy\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:42:47.931401 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.931095 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-web-config\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:42:47.931401 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.931104 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7knq\" (UniqueName: \"kubernetes.io/projected/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-kube-api-access-m7knq\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:42:47.931401 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:47.931140 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768-config-out\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:42:48.418177 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.418145 2577 generic.go:356] "Generic (PLEG): container finished" podID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerID="15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c" exitCode=0 Sep 16 19:42:48.418177 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.418176 2577 generic.go:356] "Generic (PLEG): container finished" podID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerID="d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f" exitCode=0 Sep 16 19:42:48.418585 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.418185 2577 generic.go:356] "Generic (PLEG): container finished" podID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerID="fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a" exitCode=0 Sep 16 19:42:48.418585 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.418196 2577 generic.go:356] "Generic (PLEG): container finished" podID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerID="9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1" exitCode=0 Sep 16 19:42:48.418585 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.418208 2577 generic.go:356] "Generic (PLEG): container finished" podID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerID="04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423" exitCode=0 Sep 16 19:42:48.418585 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.418216 2577 generic.go:356] "Generic (PLEG): container finished" podID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerID="29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e" exitCode=0 Sep 16 19:42:48.418585 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.418252 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768","Type":"ContainerDied","Data":"15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c"} Sep 16 19:42:48.418585 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.418279 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.418585 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.418388 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768","Type":"ContainerDied","Data":"d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f"} Sep 16 19:42:48.418585 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.418437 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768","Type":"ContainerDied","Data":"fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a"} Sep 16 19:42:48.418585 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.418474 2577 scope.go:117] "RemoveContainer" containerID="15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c" Sep 16 19:42:48.418585 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.418478 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768","Type":"ContainerDied","Data":"9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1"} Sep 16 19:42:48.419026 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.418625 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768","Type":"ContainerDied","Data":"04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423"} Sep 16 19:42:48.419026 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.418670 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768","Type":"ContainerDied","Data":"29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e"} Sep 16 19:42:48.419026 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.418710 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8ed9b4e9-63c7-4d6d-9342-3229a1a7b768","Type":"ContainerDied","Data":"c3d9922eab123b2739a5cffb2fcb74e134814ae9813a93c6846441022a12e4bc"} Sep 16 19:42:48.431427 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.431412 2577 scope.go:117] "RemoveContainer" containerID="d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f" Sep 16 19:42:48.438211 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.438194 2577 scope.go:117] "RemoveContainer" containerID="fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a" Sep 16 19:42:48.444713 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.444695 2577 scope.go:117] "RemoveContainer" containerID="9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1" Sep 16 19:42:48.448188 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.448169 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 16 19:42:48.451805 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.451771 2577 scope.go:117] "RemoveContainer" containerID="04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423" Sep 16 19:42:48.455440 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.455423 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 16 19:42:48.458708 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.458692 2577 scope.go:117] "RemoveContainer" containerID="29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e" Sep 16 19:42:48.465948 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.465932 2577 scope.go:117] "RemoveContainer" containerID="dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8" Sep 16 19:42:48.472501 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.472486 2577 scope.go:117] "RemoveContainer" containerID="15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c" Sep 16 19:42:48.472753 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:42:48.472736 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c\": container with ID starting with 15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c not found: ID does not exist" containerID="15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c" Sep 16 19:42:48.472798 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.472761 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c"} err="failed to get container status \"15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c\": rpc error: code = NotFound desc = could not find container \"15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c\": container with ID starting with 15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c not found: ID does not exist" Sep 16 19:42:48.472798 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.472777 2577 scope.go:117] "RemoveContainer" containerID="d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f" Sep 16 19:42:48.473044 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:42:48.473002 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f\": container with ID starting with d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f not found: ID does not exist" containerID="d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f" Sep 16 19:42:48.473087 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.473051 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f"} err="failed to get container status \"d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f\": rpc error: code = NotFound desc = could not find container \"d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f\": container with ID starting with d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f not found: ID does not exist" Sep 16 19:42:48.473087 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.473067 2577 scope.go:117] "RemoveContainer" containerID="fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a" Sep 16 19:42:48.473332 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:42:48.473315 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a\": container with ID starting with fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a not found: ID does not exist" containerID="fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a" Sep 16 19:42:48.473369 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.473337 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a"} err="failed to get container status \"fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a\": rpc error: code = NotFound desc = could not find container \"fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a\": container with ID starting with fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a not found: ID does not exist" Sep 16 19:42:48.473369 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.473352 2577 scope.go:117] "RemoveContainer" containerID="9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1" Sep 16 19:42:48.473570 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:42:48.473550 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1\": container with ID starting with 9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1 not found: ID does not exist" containerID="9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1" Sep 16 19:42:48.473652 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.473574 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1"} err="failed to get container status \"9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1\": rpc error: code = NotFound desc = could not find container \"9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1\": container with ID starting with 9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1 not found: ID does not exist" Sep 16 19:42:48.473652 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.473590 2577 scope.go:117] "RemoveContainer" containerID="04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423" Sep 16 19:42:48.473791 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:42:48.473777 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423\": container with ID starting with 04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423 not found: ID does not exist" containerID="04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423" Sep 16 19:42:48.473832 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.473793 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423"} err="failed to get container status \"04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423\": rpc error: code = NotFound desc = could not find container \"04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423\": container with ID starting with 04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423 not found: ID does not exist" Sep 16 19:42:48.473832 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.473804 2577 scope.go:117] "RemoveContainer" containerID="29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e" Sep 16 19:42:48.474003 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:42:48.473989 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e\": container with ID starting with 29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e not found: ID does not exist" containerID="29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e" Sep 16 19:42:48.474043 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.474006 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e"} err="failed to get container status \"29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e\": rpc error: code = NotFound desc = could not find container \"29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e\": container with ID starting with 29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e not found: ID does not exist" Sep 16 19:42:48.474043 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.474017 2577 scope.go:117] "RemoveContainer" containerID="dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8" Sep 16 19:42:48.474358 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:42:48.474342 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8\": container with ID starting with dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8 not found: ID does not exist" containerID="dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8" Sep 16 19:42:48.474419 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.474361 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8"} err="failed to get container status \"dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8\": rpc error: code = NotFound desc = could not find container \"dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8\": container with ID starting with dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8 not found: ID does not exist" Sep 16 19:42:48.474419 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.474375 2577 scope.go:117] "RemoveContainer" containerID="15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c" Sep 16 19:42:48.474588 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.474573 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c"} err="failed to get container status \"15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c\": rpc error: code = NotFound desc = could not find container \"15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c\": container with ID starting with 15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c not found: ID does not exist" Sep 16 19:42:48.474630 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.474589 2577 scope.go:117] "RemoveContainer" containerID="d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f" Sep 16 19:42:48.474810 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.474794 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f"} err="failed to get container status \"d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f\": rpc error: code = NotFound desc = could not find container \"d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f\": container with ID starting with d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f not found: ID does not exist" Sep 16 19:42:48.474866 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.474810 2577 scope.go:117] "RemoveContainer" containerID="fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a" Sep 16 19:42:48.474996 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.474981 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a"} err="failed to get container status \"fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a\": rpc error: code = NotFound desc = could not find container \"fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a\": container with ID starting with fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a not found: ID does not exist" Sep 16 19:42:48.475043 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.474996 2577 scope.go:117] "RemoveContainer" containerID="9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1" Sep 16 19:42:48.475264 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.475246 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1"} err="failed to get container status \"9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1\": rpc error: code = NotFound desc = could not find container \"9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1\": container with ID starting with 9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1 not found: ID does not exist" Sep 16 19:42:48.475350 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.475265 2577 scope.go:117] "RemoveContainer" containerID="04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423" Sep 16 19:42:48.475470 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.475454 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423"} err="failed to get container status \"04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423\": rpc error: code = NotFound desc = could not find container \"04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423\": container with ID starting with 04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423 not found: ID does not exist" Sep 16 19:42:48.475518 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.475470 2577 scope.go:117] "RemoveContainer" containerID="29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e" Sep 16 19:42:48.475692 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.475678 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e"} err="failed to get container status \"29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e\": rpc error: code = NotFound desc = could not find container \"29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e\": container with ID starting with 29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e not found: ID does not exist" Sep 16 19:42:48.475736 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.475693 2577 scope.go:117] "RemoveContainer" containerID="dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8" Sep 16 19:42:48.475949 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.475930 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8"} err="failed to get container status \"dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8\": rpc error: code = NotFound desc = could not find container \"dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8\": container with ID starting with dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8 not found: ID does not exist" Sep 16 19:42:48.475992 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.475951 2577 scope.go:117] "RemoveContainer" containerID="15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c" Sep 16 19:42:48.476168 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.476153 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c"} err="failed to get container status \"15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c\": rpc error: code = NotFound desc = could not find container \"15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c\": container with ID starting with 15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c not found: ID does not exist" Sep 16 19:42:48.476206 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.476168 2577 scope.go:117] "RemoveContainer" containerID="d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f" Sep 16 19:42:48.476393 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.476376 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f"} err="failed to get container status \"d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f\": rpc error: code = NotFound desc = could not find container \"d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f\": container with ID starting with d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f not found: ID does not exist" Sep 16 19:42:48.476437 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.476394 2577 scope.go:117] "RemoveContainer" containerID="fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a" Sep 16 19:42:48.476589 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.476573 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a"} err="failed to get container status \"fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a\": rpc error: code = NotFound desc = could not find container \"fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a\": container with ID starting with fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a not found: ID does not exist" Sep 16 19:42:48.476632 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.476590 2577 scope.go:117] "RemoveContainer" containerID="9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1" Sep 16 19:42:48.476784 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.476766 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1"} err="failed to get container status \"9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1\": rpc error: code = NotFound desc = could not find container \"9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1\": container with ID starting with 9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1 not found: ID does not exist" Sep 16 19:42:48.476838 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.476784 2577 scope.go:117] "RemoveContainer" containerID="04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423" Sep 16 19:42:48.476987 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.476968 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423"} err="failed to get container status \"04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423\": rpc error: code = NotFound desc = could not find container \"04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423\": container with ID starting with 04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423 not found: ID does not exist" Sep 16 19:42:48.477026 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.476988 2577 scope.go:117] "RemoveContainer" containerID="29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e" Sep 16 19:42:48.477241 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.477222 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e"} err="failed to get container status \"29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e\": rpc error: code = NotFound desc = could not find container \"29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e\": container with ID starting with 29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e not found: ID does not exist" Sep 16 19:42:48.477300 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.477241 2577 scope.go:117] "RemoveContainer" containerID="dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8" Sep 16 19:42:48.477446 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.477426 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8"} err="failed to get container status \"dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8\": rpc error: code = NotFound desc = could not find container \"dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8\": container with ID starting with dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8 not found: ID does not exist" Sep 16 19:42:48.477491 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.477446 2577 scope.go:117] "RemoveContainer" containerID="15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c" Sep 16 19:42:48.477653 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.477635 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c"} err="failed to get container status \"15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c\": rpc error: code = NotFound desc = could not find container \"15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c\": container with ID starting with 15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c not found: ID does not exist" Sep 16 19:42:48.477694 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.477653 2577 scope.go:117] "RemoveContainer" containerID="d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f" Sep 16 19:42:48.477864 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.477850 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f"} err="failed to get container status \"d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f\": rpc error: code = NotFound desc = could not find container \"d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f\": container with ID starting with d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f not found: ID does not exist" Sep 16 19:42:48.477904 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.477863 2577 scope.go:117] "RemoveContainer" containerID="fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a" Sep 16 19:42:48.478059 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.478042 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a"} err="failed to get container status \"fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a\": rpc error: code = NotFound desc = could not find container \"fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a\": container with ID starting with fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a not found: ID does not exist" Sep 16 19:42:48.478102 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.478060 2577 scope.go:117] "RemoveContainer" containerID="9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1" Sep 16 19:42:48.478336 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.478320 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1"} err="failed to get container status \"9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1\": rpc error: code = NotFound desc = could not find container \"9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1\": container with ID starting with 9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1 not found: ID does not exist" Sep 16 19:42:48.478379 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.478336 2577 scope.go:117] "RemoveContainer" containerID="04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423" Sep 16 19:42:48.478564 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.478549 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423"} err="failed to get container status \"04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423\": rpc error: code = NotFound desc = could not find container \"04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423\": container with ID starting with 04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423 not found: ID does not exist" Sep 16 19:42:48.478564 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.478564 2577 scope.go:117] "RemoveContainer" containerID="29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e" Sep 16 19:42:48.478766 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.478750 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e"} err="failed to get container status \"29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e\": rpc error: code = NotFound desc = could not find container \"29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e\": container with ID starting with 29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e not found: ID does not exist" Sep 16 19:42:48.478811 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.478766 2577 scope.go:117] "RemoveContainer" containerID="dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8" Sep 16 19:42:48.478951 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.478933 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8"} err="failed to get container status \"dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8\": rpc error: code = NotFound desc = could not find container \"dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8\": container with ID starting with dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8 not found: ID does not exist" Sep 16 19:42:48.478951 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.478950 2577 scope.go:117] "RemoveContainer" containerID="15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c" Sep 16 19:42:48.479170 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.479155 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c"} err="failed to get container status \"15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c\": rpc error: code = NotFound desc = could not find container \"15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c\": container with ID starting with 15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c not found: ID does not exist" Sep 16 19:42:48.479229 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.479170 2577 scope.go:117] "RemoveContainer" containerID="d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f" Sep 16 19:42:48.479360 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.479344 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f"} err="failed to get container status \"d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f\": rpc error: code = NotFound desc = could not find container \"d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f\": container with ID starting with d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f not found: ID does not exist" Sep 16 19:42:48.479402 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.479361 2577 scope.go:117] "RemoveContainer" containerID="fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a" Sep 16 19:42:48.479590 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.479575 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a"} err="failed to get container status \"fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a\": rpc error: code = NotFound desc = could not find container \"fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a\": container with ID starting with fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a not found: ID does not exist" Sep 16 19:42:48.479590 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.479589 2577 scope.go:117] "RemoveContainer" containerID="9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1" Sep 16 19:42:48.479780 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.479765 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1"} err="failed to get container status \"9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1\": rpc error: code = NotFound desc = could not find container \"9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1\": container with ID starting with 9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1 not found: ID does not exist" Sep 16 19:42:48.479818 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.479779 2577 scope.go:117] "RemoveContainer" containerID="04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423" Sep 16 19:42:48.479973 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.479959 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423"} err="failed to get container status \"04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423\": rpc error: code = NotFound desc = could not find container \"04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423\": container with ID starting with 04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423 not found: ID does not exist" Sep 16 19:42:48.480015 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.479973 2577 scope.go:117] "RemoveContainer" containerID="29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e" Sep 16 19:42:48.480193 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.480176 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e"} err="failed to get container status \"29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e\": rpc error: code = NotFound desc = could not find container \"29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e\": container with ID starting with 29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e not found: ID does not exist" Sep 16 19:42:48.480240 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.480192 2577 scope.go:117] "RemoveContainer" containerID="dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8" Sep 16 19:42:48.480369 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.480355 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8"} err="failed to get container status \"dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8\": rpc error: code = NotFound desc = could not find container \"dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8\": container with ID starting with dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8 not found: ID does not exist" Sep 16 19:42:48.480422 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.480369 2577 scope.go:117] "RemoveContainer" containerID="15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c" Sep 16 19:42:48.480559 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.480545 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c"} err="failed to get container status \"15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c\": rpc error: code = NotFound desc = could not find container \"15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c\": container with ID starting with 15e171c317bca38ef4c93f7f5427ed047515f26a3a45ffe00d1e50422b7cb35c not found: ID does not exist" Sep 16 19:42:48.480559 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.480558 2577 scope.go:117] "RemoveContainer" containerID="d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f" Sep 16 19:42:48.480804 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.480786 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f"} err="failed to get container status \"d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f\": rpc error: code = NotFound desc = could not find container \"d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f\": container with ID starting with d8b4b756b8cdbe6f23b76a00b041a22fea50819d9eabfa7351a9a2f8377ce19f not found: ID does not exist" Sep 16 19:42:48.480863 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.480804 2577 scope.go:117] "RemoveContainer" containerID="fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a" Sep 16 19:42:48.481028 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.481013 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a"} err="failed to get container status \"fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a\": rpc error: code = NotFound desc = could not find container \"fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a\": container with ID starting with fafd15201081099f0c72dce0d05eb20756afeb862f8a21ab0a891d88ff00da1a not found: ID does not exist" Sep 16 19:42:48.481028 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.481027 2577 scope.go:117] "RemoveContainer" containerID="9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1" Sep 16 19:42:48.481291 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.481276 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1"} err="failed to get container status \"9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1\": rpc error: code = NotFound desc = could not find container \"9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1\": container with ID starting with 9ed6d92fdaaa7eb26afd1df8dbc2ea5faabd8403643e2a2a9205bddb5ca153a1 not found: ID does not exist" Sep 16 19:42:48.481331 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.481291 2577 scope.go:117] "RemoveContainer" containerID="04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423" Sep 16 19:42:48.481506 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.481490 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423"} err="failed to get container status \"04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423\": rpc error: code = NotFound desc = could not find container \"04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423\": container with ID starting with 04ef516d0a9733047165ca3d97dae5aafd5209e9bd8f514b636b3710df61f423 not found: ID does not exist" Sep 16 19:42:48.481556 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.481508 2577 scope.go:117] "RemoveContainer" containerID="29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e" Sep 16 19:42:48.481724 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.481709 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e"} err="failed to get container status \"29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e\": rpc error: code = NotFound desc = could not find container \"29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e\": container with ID starting with 29a8898d159ce3fe1d23f9e9f3505f045a93821bfeae8848214c5099f9319d5e not found: ID does not exist" Sep 16 19:42:48.481770 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.481724 2577 scope.go:117] "RemoveContainer" containerID="dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8" Sep 16 19:42:48.481952 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.481924 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8"} err="failed to get container status \"dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8\": rpc error: code = NotFound desc = could not find container \"dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8\": container with ID starting with dcdcde40d77eac14045573c0a0e43afbe019ba0f8f0087ca3fa896c5eb96bef8 not found: ID does not exist" Sep 16 19:42:48.499688 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.499665 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 16 19:42:48.500706 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.500222 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerName="init-config-reloader" Sep 16 19:42:48.500836 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.500816 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerName="init-config-reloader" Sep 16 19:42:48.500887 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.500841 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerName="kube-rbac-proxy" Sep 16 19:42:48.500887 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.500848 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerName="kube-rbac-proxy" Sep 16 19:42:48.500887 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.500861 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerName="kube-rbac-proxy-web" Sep 16 19:42:48.500887 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.500867 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerName="kube-rbac-proxy-web" Sep 16 19:42:48.500887 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.500877 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9301ece6-9bd1-4c5a-a8da-a3332da1a287" containerName="console" Sep 16 19:42:48.500887 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.500882 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9301ece6-9bd1-4c5a-a8da-a3332da1a287" containerName="console" Sep 16 19:42:48.501208 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.500891 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerName="kube-rbac-proxy-thanos" Sep 16 19:42:48.501208 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.500900 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerName="kube-rbac-proxy-thanos" Sep 16 19:42:48.501208 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.500910 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerName="thanos-sidecar" Sep 16 19:42:48.501208 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.500915 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerName="thanos-sidecar" Sep 16 19:42:48.501208 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.500922 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerName="config-reloader" Sep 16 19:42:48.501208 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.500927 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerName="config-reloader" Sep 16 19:42:48.501208 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.500937 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerName="prometheus" Sep 16 19:42:48.501208 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.500949 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerName="prometheus" Sep 16 19:42:48.501208 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.500963 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05" containerName="registry" Sep 16 19:42:48.501208 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.500967 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05" containerName="registry" Sep 16 19:42:48.501208 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.501042 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerName="kube-rbac-proxy-thanos" Sep 16 19:42:48.501208 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.501052 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d7a5ce1-6f50-47ea-9148-a9eddd0bcb05" containerName="registry" Sep 16 19:42:48.501208 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.501060 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerName="kube-rbac-proxy" Sep 16 19:42:48.501208 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.501071 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerName="thanos-sidecar" Sep 16 19:42:48.501208 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.501077 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerName="config-reloader" Sep 16 19:42:48.501208 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.501083 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9301ece6-9bd1-4c5a-a8da-a3332da1a287" containerName="console" Sep 16 19:42:48.501208 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.501088 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerName="prometheus" Sep 16 19:42:48.501208 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.501094 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" containerName="kube-rbac-proxy-web" Sep 16 19:42:48.506352 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.506339 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.519235 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.519213 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 16 19:42:48.519235 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.519233 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 16 19:42:48.519401 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.519344 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 16 19:42:48.519888 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.519872 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 16 19:42:48.519937 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.519912 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 16 19:42:48.520282 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.520269 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 16 19:42:48.520832 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.520819 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 16 19:42:48.522494 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.522479 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 16 19:42:48.522625 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.522507 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-v4ppr\"" Sep 16 19:42:48.522625 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.522576 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4ept3i49o5gqc\"" Sep 16 19:42:48.522625 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.522510 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 16 19:42:48.522625 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.522510 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 16 19:42:48.523597 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.523574 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 16 19:42:48.523688 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.523651 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 16 19:42:48.523863 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.523848 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 16 19:42:48.526727 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.526712 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 16 19:42:48.534417 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.534397 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-config-out\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.534483 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.534420 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-web-config\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.534483 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.534436 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.534483 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.534451 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.534483 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.534466 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.534610 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.534534 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.534610 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.534555 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.534610 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.534585 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.534610 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.534601 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.534725 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.534616 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.534725 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.534645 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.534725 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.534666 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.534725 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.534707 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.534877 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.534739 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.534877 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.534763 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.534877 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.534782 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.534877 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.534802 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.534877 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.534817 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.534877 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.534846 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-config\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.534877 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.534871 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxqzx\" (UniqueName: \"kubernetes.io/projected/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-kube-api-access-vxqzx\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.548076 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.548054 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 16 19:42:48.548579 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.548557 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 16 19:42:48.635207 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.635179 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-config-out\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.635303 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.635210 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-web-config\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.635303 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.635232 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.635303 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.635255 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.635303 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.635279 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.635546 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.635312 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.635546 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.635337 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.635546 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.635465 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.635546 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.635499 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.635546 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.635516 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.635795 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.635538 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.635795 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.635594 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.635795 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.635627 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.635795 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.635665 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.635795 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.635699 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.635795 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.635728 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.635795 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.635752 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.635795 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.635775 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.636386 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.635803 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-config\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.636386 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.635852 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxqzx\" (UniqueName: \"kubernetes.io/projected/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-kube-api-access-vxqzx\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.636386 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.636039 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.636386 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.636311 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.636587 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.636420 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.636587 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.636576 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.637913 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.637882 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.638015 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.637939 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.638497 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.638470 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.639397 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.639173 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.639397 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.639364 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-config-out\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.640062 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.639923 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.640062 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.640023 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.640318 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.640290 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.640617 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.640527 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.640885 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.640863 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.641066 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.641050 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.641242 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.641219 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-web-config\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.641300 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.641236 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.642214 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.642194 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-config\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.642340 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.642323 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.645006 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.644982 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxqzx\" (UniqueName: \"kubernetes.io/projected/2b1fd7a6-3314-41e7-b9ab-26ae61fc238e-kube-api-access-vxqzx\") pod \"prometheus-k8s-0\" (UID: \"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:48.814666 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:48.814634 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:49.102923 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:49.102899 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 16 19:42:49.104089 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:42:49.104062 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b1fd7a6_3314_41e7_b9ab_26ae61fc238e.slice/crio-1fbf03e616227c90be4a0ddb60e8b8af91690f95230fab2df2cc7a32ea6ac2fb WatchSource:0}: Error finding container 1fbf03e616227c90be4a0ddb60e8b8af91690f95230fab2df2cc7a32ea6ac2fb: Status 404 returned error can't find the container with id 1fbf03e616227c90be4a0ddb60e8b8af91690f95230fab2df2cc7a32ea6ac2fb Sep 16 19:42:49.424410 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:49.424330 2577 generic.go:356] "Generic (PLEG): container finished" podID="2b1fd7a6-3314-41e7-b9ab-26ae61fc238e" containerID="2b611b1f97abed8113fc31158348aa1cfe1155298e221a08886f3ee3b15a8812" exitCode=0 Sep 16 19:42:49.424410 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:49.424378 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e","Type":"ContainerDied","Data":"2b611b1f97abed8113fc31158348aa1cfe1155298e221a08886f3ee3b15a8812"} Sep 16 19:42:49.424757 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:49.424442 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e","Type":"ContainerStarted","Data":"1fbf03e616227c90be4a0ddb60e8b8af91690f95230fab2df2cc7a32ea6ac2fb"} Sep 16 19:42:49.431853 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:49.431818 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ed9b4e9-63c7-4d6d-9342-3229a1a7b768" path="/var/lib/kubelet/pods/8ed9b4e9-63c7-4d6d-9342-3229a1a7b768/volumes" Sep 16 19:42:50.433322 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:50.433291 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e","Type":"ContainerStarted","Data":"e25b5b41e0aa96b45906d07bd7b58662b8293269f8137ad0bdbca86f219155b0"} Sep 16 19:42:50.433712 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:50.433348 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e","Type":"ContainerStarted","Data":"3533f1c507961a40e9ef3abc2fda0c15a5abfe60ddab237c58e202066cb8c1c5"} Sep 16 19:42:50.433712 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:50.433374 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e","Type":"ContainerStarted","Data":"f9d482057889e0efa58345dd0c096d6947502d97b6d4ca7c53d8e524f21b00a2"} Sep 16 19:42:50.433712 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:50.433398 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e","Type":"ContainerStarted","Data":"4cdde41b424abc754b0f9a9163417b2281e662908473d9d762e81d815dde7fc6"} Sep 16 19:42:50.433712 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:50.433421 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e","Type":"ContainerStarted","Data":"19aec74df670ad1f377b4efccbff3c15dd9e09aa53b40b5d48e8864308001b1d"} Sep 16 19:42:50.433712 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:50.433444 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b1fd7a6-3314-41e7-b9ab-26ae61fc238e","Type":"ContainerStarted","Data":"1c00cfa493a5c63aab07168fdb8708c9686577dbc24bbccdada000d417c5168f"} Sep 16 19:42:50.472052 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:50.472003 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.451871573 podStartE2EDuration="2.471986081s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.114508ms" isStatefulPod=false podCreationTimestamp="2026-09-16 19:42:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:42:50.469503322 +0000 UTC m=+245.569807389" watchObservedRunningTime="2026-09-16 19:42:50.471986081 +0000 UTC m=+245.572290186" Sep 16 19:42:53.815051 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:42:53.815017 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:45.347231 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:43:45.347201 2577 kubelet.go:1648] "Image garbage collection succeeded" Sep 16 19:43:48.815195 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:43:48.815159 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:48.831478 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:43:48.831452 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:49.668413 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:43:49.668389 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:45:27.202051 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:45:27.202021 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-phk7w"] Sep 16 19:45:27.205376 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:45:27.205359 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-phk7w" Sep 16 19:45:27.210429 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:45:27.210399 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Sep 16 19:45:27.212026 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:45:27.212006 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Sep 16 19:45:27.212154 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:45:27.212007 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-qr4dr\"" Sep 16 19:45:27.212154 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:45:27.212032 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Sep 16 19:45:27.219261 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:45:27.219242 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-phk7w"] Sep 16 19:45:27.314245 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:45:27.314213 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5a1ba345-157d-4028-9c85-8cff2cc2bf06-data\") pod \"seaweedfs-64568bcd49-phk7w\" (UID: \"5a1ba345-157d-4028-9c85-8cff2cc2bf06\") " pod="kserve/seaweedfs-64568bcd49-phk7w" Sep 16 19:45:27.314373 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:45:27.314281 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p5wj\" (UniqueName: \"kubernetes.io/projected/5a1ba345-157d-4028-9c85-8cff2cc2bf06-kube-api-access-6p5wj\") pod \"seaweedfs-64568bcd49-phk7w\" (UID: \"5a1ba345-157d-4028-9c85-8cff2cc2bf06\") " pod="kserve/seaweedfs-64568bcd49-phk7w" Sep 16 19:45:27.414863 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:45:27.414840 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5a1ba345-157d-4028-9c85-8cff2cc2bf06-data\") pod \"seaweedfs-64568bcd49-phk7w\" (UID: \"5a1ba345-157d-4028-9c85-8cff2cc2bf06\") " pod="kserve/seaweedfs-64568bcd49-phk7w" Sep 16 19:45:27.414991 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:45:27.414907 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p5wj\" (UniqueName: \"kubernetes.io/projected/5a1ba345-157d-4028-9c85-8cff2cc2bf06-kube-api-access-6p5wj\") pod \"seaweedfs-64568bcd49-phk7w\" (UID: \"5a1ba345-157d-4028-9c85-8cff2cc2bf06\") " pod="kserve/seaweedfs-64568bcd49-phk7w" Sep 16 19:45:27.415264 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:45:27.415240 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5a1ba345-157d-4028-9c85-8cff2cc2bf06-data\") pod \"seaweedfs-64568bcd49-phk7w\" (UID: \"5a1ba345-157d-4028-9c85-8cff2cc2bf06\") " pod="kserve/seaweedfs-64568bcd49-phk7w" Sep 16 19:45:27.425055 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:45:27.425028 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p5wj\" (UniqueName: \"kubernetes.io/projected/5a1ba345-157d-4028-9c85-8cff2cc2bf06-kube-api-access-6p5wj\") pod \"seaweedfs-64568bcd49-phk7w\" (UID: \"5a1ba345-157d-4028-9c85-8cff2cc2bf06\") " pod="kserve/seaweedfs-64568bcd49-phk7w" Sep 16 19:45:27.513925 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:45:27.513863 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-phk7w" Sep 16 19:45:27.788153 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:45:27.788125 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-phk7w"] Sep 16 19:45:27.792916 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:45:27.792889 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a1ba345_157d_4028_9c85_8cff2cc2bf06.slice/crio-3693835b2d018f4a12bef01827c909a26de691bae2ad19fe498d4eae91f43e5c WatchSource:0}: Error finding container 3693835b2d018f4a12bef01827c909a26de691bae2ad19fe498d4eae91f43e5c: Status 404 returned error can't find the container with id 3693835b2d018f4a12bef01827c909a26de691bae2ad19fe498d4eae91f43e5c Sep 16 19:45:27.794582 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:45:27.794563 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 16 19:45:28.029480 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:45:28.029451 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-phk7w" event={"ID":"5a1ba345-157d-4028-9c85-8cff2cc2bf06","Type":"ContainerStarted","Data":"3693835b2d018f4a12bef01827c909a26de691bae2ad19fe498d4eae91f43e5c"} Sep 16 19:45:32.050363 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:45:32.050323 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-phk7w" event={"ID":"5a1ba345-157d-4028-9c85-8cff2cc2bf06","Type":"ContainerStarted","Data":"fde605aeb6a3bcfc3b809580580473a2a5bef5c5e37e45008497b45e6434ff3b"} Sep 16 19:45:32.050744 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:45:32.050565 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-phk7w" Sep 16 19:45:32.069190 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:45:32.069144 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-phk7w" podStartSLOduration=1.882200778 podStartE2EDuration="5.06912925s" totalImagesPullingTime="3.186928472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:45:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:45:32.068354504 +0000 UTC m=+407.168658579" watchObservedRunningTime="2026-09-16 19:45:32.06912925 +0000 UTC m=+407.169433316" Sep 16 19:45:38.057377 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:45:38.057349 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-phk7w" Sep 16 19:46:14.925899 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:14.925819 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tvhqz/must-gather-cqjr7"] Sep 16 19:46:14.929236 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:14.929221 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tvhqz/must-gather-cqjr7" Sep 16 19:46:14.933566 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:14.933540 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tvhqz\"/\"openshift-service-ca.crt\"" Sep 16 19:46:14.933695 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:14.933543 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tvhqz\"/\"kube-root-ca.crt\"" Sep 16 19:46:14.934492 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:14.934472 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tvhqz\"/\"default-dockercfg-96qn6\"" Sep 16 19:46:14.949719 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:14.949697 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tvhqz/must-gather-cqjr7"] Sep 16 19:46:15.061079 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:15.061057 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e9dd80d1-245f-49bc-850f-9966d81c7692-must-gather-output\") pod \"must-gather-cqjr7\" (UID: \"e9dd80d1-245f-49bc-850f-9966d81c7692\") " pod="openshift-must-gather-tvhqz/must-gather-cqjr7" Sep 16 19:46:15.061213 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:15.061091 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw7xj\" (UniqueName: \"kubernetes.io/projected/e9dd80d1-245f-49bc-850f-9966d81c7692-kube-api-access-fw7xj\") pod \"must-gather-cqjr7\" (UID: \"e9dd80d1-245f-49bc-850f-9966d81c7692\") " pod="openshift-must-gather-tvhqz/must-gather-cqjr7" Sep 16 19:46:15.161959 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:15.161932 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e9dd80d1-245f-49bc-850f-9966d81c7692-must-gather-output\") pod \"must-gather-cqjr7\" (UID: \"e9dd80d1-245f-49bc-850f-9966d81c7692\") " pod="openshift-must-gather-tvhqz/must-gather-cqjr7" Sep 16 19:46:15.162062 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:15.161967 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw7xj\" (UniqueName: \"kubernetes.io/projected/e9dd80d1-245f-49bc-850f-9966d81c7692-kube-api-access-fw7xj\") pod \"must-gather-cqjr7\" (UID: \"e9dd80d1-245f-49bc-850f-9966d81c7692\") " pod="openshift-must-gather-tvhqz/must-gather-cqjr7" Sep 16 19:46:15.162287 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:15.162269 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e9dd80d1-245f-49bc-850f-9966d81c7692-must-gather-output\") pod \"must-gather-cqjr7\" (UID: \"e9dd80d1-245f-49bc-850f-9966d81c7692\") " pod="openshift-must-gather-tvhqz/must-gather-cqjr7" Sep 16 19:46:15.174956 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:15.174933 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw7xj\" (UniqueName: \"kubernetes.io/projected/e9dd80d1-245f-49bc-850f-9966d81c7692-kube-api-access-fw7xj\") pod \"must-gather-cqjr7\" (UID: \"e9dd80d1-245f-49bc-850f-9966d81c7692\") " pod="openshift-must-gather-tvhqz/must-gather-cqjr7" Sep 16 19:46:15.238387 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:15.238327 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tvhqz/must-gather-cqjr7" Sep 16 19:46:15.517503 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:15.517334 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tvhqz/must-gather-cqjr7"] Sep 16 19:46:15.519579 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:46:15.519558 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9dd80d1_245f_49bc_850f_9966d81c7692.slice/crio-79a2c737035cbc05d518cf995017030887ae0da95ddcec749a5e12e5604f4de7 WatchSource:0}: Error finding container 79a2c737035cbc05d518cf995017030887ae0da95ddcec749a5e12e5604f4de7: Status 404 returned error can't find the container with id 79a2c737035cbc05d518cf995017030887ae0da95ddcec749a5e12e5604f4de7 Sep 16 19:46:16.222077 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:16.222014 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tvhqz/must-gather-cqjr7" event={"ID":"e9dd80d1-245f-49bc-850f-9966d81c7692","Type":"ContainerStarted","Data":"79a2c737035cbc05d518cf995017030887ae0da95ddcec749a5e12e5604f4de7"} Sep 16 19:46:22.251650 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:22.251610 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tvhqz/must-gather-cqjr7" event={"ID":"e9dd80d1-245f-49bc-850f-9966d81c7692","Type":"ContainerStarted","Data":"13f37feb96679ee6147f625d052dabf25c3406281c8b0da7e0636f6f8439cb2c"} Sep 16 19:46:22.252045 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:22.251664 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tvhqz/must-gather-cqjr7" event={"ID":"e9dd80d1-245f-49bc-850f-9966d81c7692","Type":"ContainerStarted","Data":"a646fe987627728f0c455adb24e3606ffd80b18c92e023e635e669d85fe1e28d"} Sep 16 19:46:22.281157 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:22.281084 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tvhqz/must-gather-cqjr7" podStartSLOduration=2.372731001 podStartE2EDuration="8.281067315s" totalImagesPullingTime="5.908336314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:46:22.278244789 +0000 UTC m=+457.378548864" watchObservedRunningTime="2026-09-16 19:46:22.281067315 +0000 UTC m=+457.381371389" Sep 16 19:46:34.303051 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:34.302970 2577 generic.go:356] "Generic (PLEG): container finished" podID="e9dd80d1-245f-49bc-850f-9966d81c7692" containerID="a646fe987627728f0c455adb24e3606ffd80b18c92e023e635e669d85fe1e28d" exitCode=0 Sep 16 19:46:34.303555 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:34.303041 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tvhqz/must-gather-cqjr7" event={"ID":"e9dd80d1-245f-49bc-850f-9966d81c7692","Type":"ContainerDied","Data":"a646fe987627728f0c455adb24e3606ffd80b18c92e023e635e669d85fe1e28d"} Sep 16 19:46:34.303555 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:34.303444 2577 scope.go:117] "RemoveContainer" containerID="a646fe987627728f0c455adb24e3606ffd80b18c92e023e635e669d85fe1e28d" Sep 16 19:46:35.063749 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:35.063722 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-tvhqz_must-gather-cqjr7_e9dd80d1-245f-49bc-850f-9966d81c7692/gather/0.log" Sep 16 19:46:38.228284 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:38.228227 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5cc8s_f11b5a57-9bb4-4b8c-be52-363ccdda5466/global-pull-secret-syncer/0.log" Sep 16 19:46:38.443735 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:38.443698 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qnnzz_12edd32e-5262-4839-b280-1decb30891ea/konnectivity-agent/0.log" Sep 16 19:46:38.468612 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:38.468574 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-18.ec2.internal_81eb68d3a2c532023a6d1abc2053e6b2/haproxy/0.log" Sep 16 19:46:40.381209 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:40.381174 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-tvhqz/must-gather-cqjr7"] Sep 16 19:46:40.381704 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:40.381350 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-tvhqz/must-gather-cqjr7" podUID="e9dd80d1-245f-49bc-850f-9966d81c7692" containerName="copy" containerID="cri-o://13f37feb96679ee6147f625d052dabf25c3406281c8b0da7e0636f6f8439cb2c" gracePeriod=2 Sep 16 19:46:40.384535 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:46:40.384493 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-cqjr7\" is forbidden: User \"system:node:ip-10-0-128-18.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-tvhqz\": no relationship found between node 'ip-10-0-128-18.ec2.internal' and this object" podUID="e9dd80d1-245f-49bc-850f-9966d81c7692" pod="openshift-must-gather-tvhqz/must-gather-cqjr7" Sep 16 19:46:40.385977 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:40.385674 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-tvhqz/must-gather-cqjr7"] Sep 16 19:46:40.608196 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:40.608175 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-tvhqz_must-gather-cqjr7_e9dd80d1-245f-49bc-850f-9966d81c7692/copy/0.log" Sep 16 19:46:40.610775 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:40.610759 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tvhqz/must-gather-cqjr7" Sep 16 19:46:40.613450 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:46:40.613425 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-cqjr7\" is forbidden: User \"system:node:ip-10-0-128-18.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-tvhqz\": no relationship found between node 'ip-10-0-128-18.ec2.internal' and this object" podUID="e9dd80d1-245f-49bc-850f-9966d81c7692" pod="openshift-must-gather-tvhqz/must-gather-cqjr7" Sep 16 19:46:40.671151 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:40.671064 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e9dd80d1-245f-49bc-850f-9966d81c7692-must-gather-output\") pod \"e9dd80d1-245f-49bc-850f-9966d81c7692\" (UID: \"e9dd80d1-245f-49bc-850f-9966d81c7692\") " Sep 16 19:46:40.671151 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:40.671144 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fw7xj\" (UniqueName: \"kubernetes.io/projected/e9dd80d1-245f-49bc-850f-9966d81c7692-kube-api-access-fw7xj\") pod \"e9dd80d1-245f-49bc-850f-9966d81c7692\" (UID: \"e9dd80d1-245f-49bc-850f-9966d81c7692\") " Sep 16 19:46:40.671427 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:40.671408 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9dd80d1-245f-49bc-850f-9966d81c7692-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "e9dd80d1-245f-49bc-850f-9966d81c7692" (UID: "e9dd80d1-245f-49bc-850f-9966d81c7692"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 19:46:40.673338 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:40.673319 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9dd80d1-245f-49bc-850f-9966d81c7692-kube-api-access-fw7xj" (OuterVolumeSpecName: "kube-api-access-fw7xj") pod "e9dd80d1-245f-49bc-850f-9966d81c7692" (UID: "e9dd80d1-245f-49bc-850f-9966d81c7692"). InnerVolumeSpecName "kube-api-access-fw7xj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 19:46:40.772470 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:40.772446 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fw7xj\" (UniqueName: \"kubernetes.io/projected/e9dd80d1-245f-49bc-850f-9966d81c7692-kube-api-access-fw7xj\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:46:40.772470 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:40.772467 2577 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e9dd80d1-245f-49bc-850f-9966d81c7692-must-gather-output\") on node \"ip-10-0-128-18.ec2.internal\" DevicePath \"\"" Sep 16 19:46:41.330423 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:41.330398 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-tvhqz_must-gather-cqjr7_e9dd80d1-245f-49bc-850f-9966d81c7692/copy/0.log" Sep 16 19:46:41.330770 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:41.330749 2577 generic.go:356] "Generic (PLEG): container finished" podID="e9dd80d1-245f-49bc-850f-9966d81c7692" containerID="13f37feb96679ee6147f625d052dabf25c3406281c8b0da7e0636f6f8439cb2c" exitCode=143 Sep 16 19:46:41.330836 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:41.330801 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tvhqz/must-gather-cqjr7" Sep 16 19:46:41.330872 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:41.330854 2577 scope.go:117] "RemoveContainer" containerID="13f37feb96679ee6147f625d052dabf25c3406281c8b0da7e0636f6f8439cb2c" Sep 16 19:46:41.333388 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:46:41.333361 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-cqjr7\" is forbidden: User \"system:node:ip-10-0-128-18.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-tvhqz\": no relationship found between node 'ip-10-0-128-18.ec2.internal' and this object" podUID="e9dd80d1-245f-49bc-850f-9966d81c7692" pod="openshift-must-gather-tvhqz/must-gather-cqjr7" Sep 16 19:46:41.339333 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:41.339315 2577 scope.go:117] "RemoveContainer" containerID="a646fe987627728f0c455adb24e3606ffd80b18c92e023e635e669d85fe1e28d" Sep 16 19:46:41.341567 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:46:41.341547 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-cqjr7\" is forbidden: User \"system:node:ip-10-0-128-18.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-tvhqz\": no relationship found between node 'ip-10-0-128-18.ec2.internal' and this object" podUID="e9dd80d1-245f-49bc-850f-9966d81c7692" pod="openshift-must-gather-tvhqz/must-gather-cqjr7" Sep 16 19:46:41.350339 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:41.350322 2577 scope.go:117] "RemoveContainer" containerID="13f37feb96679ee6147f625d052dabf25c3406281c8b0da7e0636f6f8439cb2c" Sep 16 19:46:41.350599 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:46:41.350583 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13f37feb96679ee6147f625d052dabf25c3406281c8b0da7e0636f6f8439cb2c\": container with ID starting with 13f37feb96679ee6147f625d052dabf25c3406281c8b0da7e0636f6f8439cb2c not found: ID does not exist" containerID="13f37feb96679ee6147f625d052dabf25c3406281c8b0da7e0636f6f8439cb2c" Sep 16 19:46:41.350641 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:41.350609 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13f37feb96679ee6147f625d052dabf25c3406281c8b0da7e0636f6f8439cb2c"} err="failed to get container status \"13f37feb96679ee6147f625d052dabf25c3406281c8b0da7e0636f6f8439cb2c\": rpc error: code = NotFound desc = could not find container \"13f37feb96679ee6147f625d052dabf25c3406281c8b0da7e0636f6f8439cb2c\": container with ID starting with 13f37feb96679ee6147f625d052dabf25c3406281c8b0da7e0636f6f8439cb2c not found: ID does not exist" Sep 16 19:46:41.350641 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:41.350634 2577 scope.go:117] "RemoveContainer" containerID="a646fe987627728f0c455adb24e3606ffd80b18c92e023e635e669d85fe1e28d" Sep 16 19:46:41.350865 ip-10-0-128-18 kubenswrapper[2577]: E0916 19:46:41.350846 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a646fe987627728f0c455adb24e3606ffd80b18c92e023e635e669d85fe1e28d\": container with ID starting with a646fe987627728f0c455adb24e3606ffd80b18c92e023e635e669d85fe1e28d not found: ID does not exist" containerID="a646fe987627728f0c455adb24e3606ffd80b18c92e023e635e669d85fe1e28d" Sep 16 19:46:41.350920 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:41.350873 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a646fe987627728f0c455adb24e3606ffd80b18c92e023e635e669d85fe1e28d"} err="failed to get container status \"a646fe987627728f0c455adb24e3606ffd80b18c92e023e635e669d85fe1e28d\": rpc error: code = NotFound desc = could not find container \"a646fe987627728f0c455adb24e3606ffd80b18c92e023e635e669d85fe1e28d\": container with ID starting with a646fe987627728f0c455adb24e3606ffd80b18c92e023e635e669d85fe1e28d not found: ID does not exist" Sep 16 19:46:41.430265 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:41.430245 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9dd80d1-245f-49bc-850f-9966d81c7692" path="/var/lib/kubelet/pods/e9dd80d1-245f-49bc-850f-9966d81c7692/volumes" Sep 16 19:46:42.831666 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:42.831640 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-8k8wn_72c5d77b-e909-447f-9ad6-dccf8ec09ab5/kube-state-metrics/0.log" Sep 16 19:46:42.857377 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:42.857336 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-8k8wn_72c5d77b-e909-447f-9ad6-dccf8ec09ab5/kube-rbac-proxy-main/0.log" Sep 16 19:46:42.885571 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:42.885548 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-8k8wn_72c5d77b-e909-447f-9ad6-dccf8ec09ab5/kube-rbac-proxy-self/0.log" Sep 16 19:46:42.956238 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:42.956214 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-fr2tr_6ef36704-de3b-4565-b9ff-e7cd63f8ce2c/monitoring-plugin/0.log" Sep 16 19:46:43.193951 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:43.193852 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rmmz2_18fa5c09-f633-4382-8931-1df7d2dbcaaa/node-exporter/0.log" Sep 16 19:46:43.221256 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:43.221232 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rmmz2_18fa5c09-f633-4382-8931-1df7d2dbcaaa/kube-rbac-proxy/0.log" Sep 16 19:46:43.248393 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:43.248374 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rmmz2_18fa5c09-f633-4382-8931-1df7d2dbcaaa/init-textfile/0.log" Sep 16 19:46:43.406555 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:43.406509 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2b1fd7a6-3314-41e7-b9ab-26ae61fc238e/prometheus/0.log" Sep 16 19:46:43.429593 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:43.429567 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2b1fd7a6-3314-41e7-b9ab-26ae61fc238e/config-reloader/0.log" Sep 16 19:46:43.452245 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:43.452029 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2b1fd7a6-3314-41e7-b9ab-26ae61fc238e/thanos-sidecar/0.log" Sep 16 19:46:43.476213 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:43.476183 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2b1fd7a6-3314-41e7-b9ab-26ae61fc238e/kube-rbac-proxy-web/0.log" Sep 16 19:46:43.498899 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:43.498863 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2b1fd7a6-3314-41e7-b9ab-26ae61fc238e/kube-rbac-proxy/0.log" Sep 16 19:46:43.520248 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:43.520219 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2b1fd7a6-3314-41e7-b9ab-26ae61fc238e/kube-rbac-proxy-thanos/0.log" Sep 16 19:46:43.546383 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:43.546365 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2b1fd7a6-3314-41e7-b9ab-26ae61fc238e/init-config-reloader/0.log" Sep 16 19:46:43.576404 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:43.576383 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-t2xps_dfe3ea2e-7826-4b9b-8089-e9786d5b23bb/prometheus-operator/0.log" Sep 16 19:46:43.596896 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:43.596846 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-t2xps_dfe3ea2e-7826-4b9b-8089-e9786d5b23bb/kube-rbac-proxy/0.log" Sep 16 19:46:43.626692 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:43.626674 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-bvjnl_0b982aa5-5449-4f34-8663-b3f0f3ce8837/prometheus-operator-admission-webhook/0.log" Sep 16 19:46:43.665459 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:43.665444 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f46c67568-d5s5m_5772a8ec-894b-4d0f-961d-56411c66b503/telemeter-client/0.log" Sep 16 19:46:43.690206 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:43.690187 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f46c67568-d5s5m_5772a8ec-894b-4d0f-961d-56411c66b503/reload/0.log" Sep 16 19:46:43.716699 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:43.716652 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f46c67568-d5s5m_5772a8ec-894b-4d0f-961d-56411c66b503/kube-rbac-proxy/0.log" Sep 16 19:46:46.559923 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:46.559890 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-c8fxt/perf-node-gather-daemonset-82nhd"] Sep 16 19:46:46.560337 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:46.560197 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9dd80d1-245f-49bc-850f-9966d81c7692" containerName="gather" Sep 16 19:46:46.560337 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:46.560209 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9dd80d1-245f-49bc-850f-9966d81c7692" containerName="gather" Sep 16 19:46:46.560337 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:46.560233 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9dd80d1-245f-49bc-850f-9966d81c7692" containerName="copy" Sep 16 19:46:46.560337 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:46.560238 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9dd80d1-245f-49bc-850f-9966d81c7692" containerName="copy" Sep 16 19:46:46.560337 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:46.560287 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9dd80d1-245f-49bc-850f-9966d81c7692" containerName="gather" Sep 16 19:46:46.560337 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:46.560296 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9dd80d1-245f-49bc-850f-9966d81c7692" containerName="copy" Sep 16 19:46:46.565194 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:46.565174 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c8fxt/perf-node-gather-daemonset-82nhd" Sep 16 19:46:46.568343 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:46.568319 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c8fxt\"/\"kube-root-ca.crt\"" Sep 16 19:46:46.568429 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:46.568372 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c8fxt\"/\"openshift-service-ca.crt\"" Sep 16 19:46:46.569902 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:46.569885 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-c8fxt\"/\"default-dockercfg-96sr7\"" Sep 16 19:46:46.578958 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:46.578937 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c8fxt/perf-node-gather-daemonset-82nhd"] Sep 16 19:46:46.619541 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:46.619513 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d650b3b9-c207-45a9-af40-009819ef46c0-sys\") pod \"perf-node-gather-daemonset-82nhd\" (UID: \"d650b3b9-c207-45a9-af40-009819ef46c0\") " pod="openshift-must-gather-c8fxt/perf-node-gather-daemonset-82nhd" Sep 16 19:46:46.619623 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:46.619550 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d650b3b9-c207-45a9-af40-009819ef46c0-proc\") pod \"perf-node-gather-daemonset-82nhd\" (UID: \"d650b3b9-c207-45a9-af40-009819ef46c0\") " pod="openshift-must-gather-c8fxt/perf-node-gather-daemonset-82nhd" Sep 16 19:46:46.619623 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:46.619577 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5jb7\" (UniqueName: \"kubernetes.io/projected/d650b3b9-c207-45a9-af40-009819ef46c0-kube-api-access-h5jb7\") pod \"perf-node-gather-daemonset-82nhd\" (UID: \"d650b3b9-c207-45a9-af40-009819ef46c0\") " pod="openshift-must-gather-c8fxt/perf-node-gather-daemonset-82nhd" Sep 16 19:46:46.619623 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:46.619599 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d650b3b9-c207-45a9-af40-009819ef46c0-lib-modules\") pod \"perf-node-gather-daemonset-82nhd\" (UID: \"d650b3b9-c207-45a9-af40-009819ef46c0\") " pod="openshift-must-gather-c8fxt/perf-node-gather-daemonset-82nhd" Sep 16 19:46:46.619623 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:46.619622 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d650b3b9-c207-45a9-af40-009819ef46c0-podres\") pod \"perf-node-gather-daemonset-82nhd\" (UID: \"d650b3b9-c207-45a9-af40-009819ef46c0\") " pod="openshift-must-gather-c8fxt/perf-node-gather-daemonset-82nhd" Sep 16 19:46:46.720743 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:46.720715 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d650b3b9-c207-45a9-af40-009819ef46c0-sys\") pod \"perf-node-gather-daemonset-82nhd\" (UID: \"d650b3b9-c207-45a9-af40-009819ef46c0\") " pod="openshift-must-gather-c8fxt/perf-node-gather-daemonset-82nhd" Sep 16 19:46:46.720743 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:46.720744 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d650b3b9-c207-45a9-af40-009819ef46c0-proc\") pod \"perf-node-gather-daemonset-82nhd\" (UID: \"d650b3b9-c207-45a9-af40-009819ef46c0\") " pod="openshift-must-gather-c8fxt/perf-node-gather-daemonset-82nhd" Sep 16 19:46:46.720884 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:46.720763 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5jb7\" (UniqueName: \"kubernetes.io/projected/d650b3b9-c207-45a9-af40-009819ef46c0-kube-api-access-h5jb7\") pod \"perf-node-gather-daemonset-82nhd\" (UID: \"d650b3b9-c207-45a9-af40-009819ef46c0\") " pod="openshift-must-gather-c8fxt/perf-node-gather-daemonset-82nhd" Sep 16 19:46:46.720884 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:46.720781 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d650b3b9-c207-45a9-af40-009819ef46c0-lib-modules\") pod \"perf-node-gather-daemonset-82nhd\" (UID: \"d650b3b9-c207-45a9-af40-009819ef46c0\") " pod="openshift-must-gather-c8fxt/perf-node-gather-daemonset-82nhd" Sep 16 19:46:46.720884 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:46.720829 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d650b3b9-c207-45a9-af40-009819ef46c0-sys\") pod \"perf-node-gather-daemonset-82nhd\" (UID: \"d650b3b9-c207-45a9-af40-009819ef46c0\") " pod="openshift-must-gather-c8fxt/perf-node-gather-daemonset-82nhd" Sep 16 19:46:46.720884 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:46.720838 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d650b3b9-c207-45a9-af40-009819ef46c0-proc\") pod \"perf-node-gather-daemonset-82nhd\" (UID: \"d650b3b9-c207-45a9-af40-009819ef46c0\") " pod="openshift-must-gather-c8fxt/perf-node-gather-daemonset-82nhd" Sep 16 19:46:46.721012 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:46.720885 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d650b3b9-c207-45a9-af40-009819ef46c0-podres\") pod \"perf-node-gather-daemonset-82nhd\" (UID: \"d650b3b9-c207-45a9-af40-009819ef46c0\") " pod="openshift-must-gather-c8fxt/perf-node-gather-daemonset-82nhd" Sep 16 19:46:46.721012 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:46.720994 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d650b3b9-c207-45a9-af40-009819ef46c0-lib-modules\") pod \"perf-node-gather-daemonset-82nhd\" (UID: \"d650b3b9-c207-45a9-af40-009819ef46c0\") " pod="openshift-must-gather-c8fxt/perf-node-gather-daemonset-82nhd" Sep 16 19:46:46.721012 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:46.720999 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d650b3b9-c207-45a9-af40-009819ef46c0-podres\") pod \"perf-node-gather-daemonset-82nhd\" (UID: \"d650b3b9-c207-45a9-af40-009819ef46c0\") " pod="openshift-must-gather-c8fxt/perf-node-gather-daemonset-82nhd" Sep 16 19:46:46.730629 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:46.730602 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5jb7\" (UniqueName: \"kubernetes.io/projected/d650b3b9-c207-45a9-af40-009819ef46c0-kube-api-access-h5jb7\") pod \"perf-node-gather-daemonset-82nhd\" (UID: \"d650b3b9-c207-45a9-af40-009819ef46c0\") " pod="openshift-must-gather-c8fxt/perf-node-gather-daemonset-82nhd" Sep 16 19:46:46.854305 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:46.854241 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-2pkpz_21cffa90-b1d0-4c97-ab6f-04de94a0eb32/volume-data-source-validator/0.log" Sep 16 19:46:46.874282 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:46.874261 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c8fxt/perf-node-gather-daemonset-82nhd" Sep 16 19:46:47.167465 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:47.167388 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c8fxt/perf-node-gather-daemonset-82nhd"] Sep 16 19:46:47.170578 ip-10-0-128-18 kubenswrapper[2577]: W0916 19:46:47.170546 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd650b3b9_c207_45a9_af40_009819ef46c0.slice/crio-4b8e33b5f9b46e313ad2278264f1b372a4480354f59ab5a2d4a834307155803a WatchSource:0}: Error finding container 4b8e33b5f9b46e313ad2278264f1b372a4480354f59ab5a2d4a834307155803a: Status 404 returned error can't find the container with id 4b8e33b5f9b46e313ad2278264f1b372a4480354f59ab5a2d4a834307155803a Sep 16 19:46:47.356575 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:47.356545 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c8fxt/perf-node-gather-daemonset-82nhd" event={"ID":"d650b3b9-c207-45a9-af40-009819ef46c0","Type":"ContainerStarted","Data":"973ee746c2e5af2393ec8624231b02ed094eae7bd6759ee7221642194a49d85b"} Sep 16 19:46:47.356708 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:47.356600 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c8fxt/perf-node-gather-daemonset-82nhd" event={"ID":"d650b3b9-c207-45a9-af40-009819ef46c0","Type":"ContainerStarted","Data":"4b8e33b5f9b46e313ad2278264f1b372a4480354f59ab5a2d4a834307155803a"} Sep 16 19:46:47.356708 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:47.356678 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-c8fxt/perf-node-gather-daemonset-82nhd" Sep 16 19:46:47.377048 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:47.377008 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-c8fxt/perf-node-gather-daemonset-82nhd" podStartSLOduration=1.376994561 podStartE2EDuration="1.376994561s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 19:46:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:46:47.376255228 +0000 UTC m=+482.476559304" watchObservedRunningTime="2026-09-16 19:46:47.376994561 +0000 UTC m=+482.477298648" Sep 16 19:46:48.074871 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:48.074844 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w2xzs_6d003067-b82c-413a-90fc-aa57066de4ae/dns/0.log" Sep 16 19:46:48.139776 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:48.139734 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w2xzs_6d003067-b82c-413a-90fc-aa57066de4ae/kube-rbac-proxy/0.log" Sep 16 19:46:48.254964 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:48.254938 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wf7dr_536a4230-7582-4958-9653-31c99fd62796/dns-node-resolver/0.log" Sep 16 19:46:48.795392 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:48.795363 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s6r7f_ec497417-cb80-4876-9c6a-c922f1a9a1bc/node-ca/0.log" Sep 16 19:46:50.097257 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:50.097228 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qpvrx_215ea051-bb2b-41c6-b1a0-8984507e2d1c/serve-healthcheck-canary/0.log" Sep 16 19:46:50.510596 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:50.510503 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-848vj_9a005d2f-276b-4000-bd5d-5e1d7e7261b3/kube-rbac-proxy/0.log" Sep 16 19:46:50.534924 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:50.534895 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-848vj_9a005d2f-276b-4000-bd5d-5e1d7e7261b3/exporter/0.log" Sep 16 19:46:50.560389 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:50.560364 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-848vj_9a005d2f-276b-4000-bd5d-5e1d7e7261b3/extractor/0.log" Sep 16 19:46:53.043031 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:53.043003 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-phk7w_5a1ba345-157d-4028-9c85-8cff2cc2bf06/seaweedfs/0.log" Sep 16 19:46:53.371506 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:46:53.371428 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-c8fxt/perf-node-gather-daemonset-82nhd" Sep 16 19:47:01.591623 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:47:01.591589 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cmmh9_27c7c9ec-2ec2-4fe5-878e-3ff97368cb96/kube-multus-additional-cni-plugins/0.log" Sep 16 19:47:01.655560 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:47:01.655535 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cmmh9_27c7c9ec-2ec2-4fe5-878e-3ff97368cb96/egress-router-binary-copy/0.log" Sep 16 19:47:01.701154 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:47:01.701103 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cmmh9_27c7c9ec-2ec2-4fe5-878e-3ff97368cb96/cni-plugins/0.log" Sep 16 19:47:01.754264 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:47:01.754232 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cmmh9_27c7c9ec-2ec2-4fe5-878e-3ff97368cb96/bond-cni-plugin/0.log" Sep 16 19:47:01.806939 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:47:01.806915 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cmmh9_27c7c9ec-2ec2-4fe5-878e-3ff97368cb96/routeoverride-cni/0.log" Sep 16 19:47:01.884181 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:47:01.884074 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cmmh9_27c7c9ec-2ec2-4fe5-878e-3ff97368cb96/whereabouts-cni-bincopy/0.log" Sep 16 19:47:01.949517 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:47:01.949487 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cmmh9_27c7c9ec-2ec2-4fe5-878e-3ff97368cb96/whereabouts-cni/0.log" Sep 16 19:47:02.527895 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:47:02.527857 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qcgh2_2e058c38-f126-4835-b2bf-050ea01fc7b5/kube-multus/0.log" Sep 16 19:47:02.684446 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:47:02.684402 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cgqxj_aafe6dc2-78c4-4a74-bea1-8b7221c9f467/network-metrics-daemon/0.log" Sep 16 19:47:02.748984 ip-10-0-128-18 kubenswrapper[2577]: I0916 19:47:02.748959 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cgqxj_aafe6dc2-78c4-4a74-bea1-8b7221c9f467/kube-rbac-proxy/0.log"