Sep 08 10:55:59.257489 ip-10-0-139-80 systemd[1]: Starting Kubernetes Kubelet... Sep 08 10:55:59.692554 ip-10-0-139-80 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 10:55:59.692554 ip-10-0-139-80 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 08 10:55:59.692554 ip-10-0-139-80 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 10:55:59.692554 ip-10-0-139-80 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 08 10:55:59.692554 ip-10-0-139-80 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 10:55:59.693275 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.692613 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 08 10:55:59.697654 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697636 2560 feature_gate.go:328] unrecognized feature gate: Example Sep 08 10:55:59.697654 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697655 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 10:55:59.697720 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697659 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 10:55:59.697720 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697664 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 10:55:59.697720 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697668 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 10:55:59.697720 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697671 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 10:55:59.697720 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697674 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 10:55:59.697720 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697677 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 10:55:59.697720 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697680 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 10:55:59.697720 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697683 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 10:55:59.697720 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697686 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 10:55:59.697720 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697689 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 10:55:59.697720 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697691 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 10:55:59.697720 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697694 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 10:55:59.697720 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697697 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 10:55:59.697720 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697700 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 10:55:59.697720 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697702 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 10:55:59.697720 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697707 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 10:55:59.697720 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697711 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 10:55:59.697720 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697714 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 10:55:59.697720 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697717 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 10:55:59.697720 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697720 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 10:55:59.698250 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697723 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 10:55:59.698250 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697726 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 10:55:59.698250 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697729 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 10:55:59.698250 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697732 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 10:55:59.698250 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697735 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 10:55:59.698250 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697738 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 10:55:59.698250 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697741 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 10:55:59.698250 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697743 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 10:55:59.698250 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697746 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 10:55:59.698250 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697749 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 10:55:59.698250 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697751 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 10:55:59.698250 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697757 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 10:55:59.698250 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697760 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 10:55:59.698250 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697763 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 10:55:59.698250 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697765 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 10:55:59.698250 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697767 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 10:55:59.698250 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697770 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 10:55:59.698250 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697772 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 10:55:59.698250 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697775 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 10:55:59.698719 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697777 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 10:55:59.698719 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697780 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 10:55:59.698719 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697783 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 10:55:59.698719 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697786 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 10:55:59.698719 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697789 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 10:55:59.698719 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697791 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 10:55:59.698719 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697793 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 10:55:59.698719 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697796 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 10:55:59.698719 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697798 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 10:55:59.698719 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697800 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 10:55:59.698719 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697803 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 10:55:59.698719 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697805 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 10:55:59.698719 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697808 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 10:55:59.698719 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697810 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 10:55:59.698719 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697814 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 10:55:59.698719 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697816 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 10:55:59.698719 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697819 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 10:55:59.698719 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697821 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 10:55:59.698719 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697824 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 10:55:59.698719 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697826 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 10:55:59.699230 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697829 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 10:55:59.699230 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697832 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 10:55:59.699230 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697834 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 10:55:59.699230 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697836 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 10:55:59.699230 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697839 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 10:55:59.699230 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697842 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 10:55:59.699230 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697844 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 10:55:59.699230 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697847 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 10:55:59.699230 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697849 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 10:55:59.699230 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697852 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 10:55:59.699230 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697854 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 10:55:59.699230 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697857 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 10:55:59.699230 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697859 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 10:55:59.699230 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697861 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 10:55:59.699230 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697864 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 10:55:59.699230 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697866 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 10:55:59.699230 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697869 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 10:55:59.699230 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697871 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 10:55:59.699230 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697874 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 10:55:59.699230 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697876 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 10:55:59.699714 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697878 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 10:55:59.699714 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697881 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 10:55:59.699714 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697883 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 10:55:59.699714 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697886 2560 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 10:55:59.699714 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697888 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 10:55:59.699714 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697892 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 10:55:59.699714 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697897 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 10:55:59.699714 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697900 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 10:55:59.699714 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697903 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 10:55:59.699714 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697905 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 10:55:59.699714 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697908 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 10:55:59.699714 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697911 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 10:55:59.699714 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697914 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 10:55:59.699714 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697916 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 10:55:59.699714 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697919 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 10:55:59.699714 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697923 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 10:55:59.699714 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697927 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 10:55:59.699714 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.697931 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 10:55:59.699714 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698659 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 10:55:59.700201 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698668 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 10:55:59.700201 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698672 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 10:55:59.700201 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698675 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 10:55:59.700201 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698679 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 10:55:59.700201 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698682 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 10:55:59.700201 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698685 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 10:55:59.700201 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698688 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 10:55:59.700201 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698691 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 10:55:59.700201 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698694 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 10:55:59.700201 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698696 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 10:55:59.700201 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698699 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 10:55:59.700201 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698701 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 10:55:59.700201 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698704 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 10:55:59.700201 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698708 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 10:55:59.700201 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698710 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 10:55:59.700201 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698714 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 10:55:59.700201 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698717 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 10:55:59.700201 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698720 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 10:55:59.700201 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698723 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 10:55:59.700201 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698727 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 10:55:59.700734 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698731 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 10:55:59.700734 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698733 2560 feature_gate.go:328] unrecognized feature gate: Example Sep 08 10:55:59.700734 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698736 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 10:55:59.700734 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698739 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 10:55:59.700734 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698742 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 10:55:59.700734 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698745 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 10:55:59.700734 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698748 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 10:55:59.700734 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698751 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 10:55:59.700734 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698753 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 10:55:59.700734 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698756 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 10:55:59.700734 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698758 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 10:55:59.700734 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698761 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 10:55:59.700734 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698764 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 10:55:59.700734 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698767 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 10:55:59.700734 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698769 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 10:55:59.700734 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698772 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 10:55:59.700734 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698774 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 10:55:59.700734 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698777 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 10:55:59.700734 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698779 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 10:55:59.700734 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698782 2560 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 10:55:59.701244 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698785 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 10:55:59.701244 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698789 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 10:55:59.701244 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698793 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 10:55:59.701244 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698795 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 10:55:59.701244 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698798 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 10:55:59.701244 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698801 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 10:55:59.701244 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698804 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 10:55:59.701244 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698807 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 10:55:59.701244 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698809 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 10:55:59.701244 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698812 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 10:55:59.701244 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698814 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 10:55:59.701244 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698817 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 10:55:59.701244 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698820 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 10:55:59.701244 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698822 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 10:55:59.701244 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698825 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 10:55:59.701244 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698827 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 10:55:59.701244 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698830 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 10:55:59.701244 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698832 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 10:55:59.701244 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698835 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 10:55:59.701702 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698837 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 10:55:59.701702 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698840 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 10:55:59.701702 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698842 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 10:55:59.701702 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698845 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 10:55:59.701702 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698847 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 10:55:59.701702 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698849 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 10:55:59.701702 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698852 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 10:55:59.701702 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698855 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 10:55:59.701702 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698857 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 10:55:59.701702 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698862 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 10:55:59.701702 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698865 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 10:55:59.701702 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698868 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 10:55:59.701702 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698870 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 10:55:59.701702 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698873 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 10:55:59.701702 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698877 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 10:55:59.701702 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698880 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 10:55:59.701702 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698883 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 10:55:59.701702 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698886 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 10:55:59.701702 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698889 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 10:55:59.702157 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698892 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 10:55:59.702157 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698895 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 10:55:59.702157 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698916 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 10:55:59.702157 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698919 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 10:55:59.702157 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698921 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 10:55:59.702157 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698924 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 10:55:59.702157 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698928 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 10:55:59.702157 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698931 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 10:55:59.702157 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698933 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 10:55:59.702157 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698936 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 10:55:59.702157 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698938 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 10:55:59.702157 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698941 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 10:55:59.702157 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698943 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 10:55:59.702157 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698946 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 10:55:59.702157 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698949 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 10:55:59.702157 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698951 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 10:55:59.702157 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698953 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 10:55:59.702157 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698956 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 10:55:59.702157 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698958 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 10:55:59.702157 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.698961 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 10:55:59.702664 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699354 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 10:55:59.702664 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699359 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 10:55:59.702664 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699364 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 10:55:59.702664 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699368 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 10:55:59.702664 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699372 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 10:55:59.702664 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699375 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 10:55:59.702664 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699378 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 10:55:59.702664 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699381 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 10:55:59.702664 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699384 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 10:55:59.702664 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699387 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 10:55:59.702664 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699390 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 10:55:59.702664 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699393 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 10:55:59.702664 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699395 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 10:55:59.702664 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699399 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 10:55:59.702664 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699401 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 10:55:59.702664 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699404 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 10:55:59.702664 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699407 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 10:55:59.702664 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699410 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 10:55:59.702664 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699413 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 10:55:59.703126 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699415 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 10:55:59.703126 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699418 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 10:55:59.703126 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699421 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 10:55:59.703126 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699424 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 10:55:59.703126 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699426 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 10:55:59.703126 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699429 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 10:55:59.703126 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699431 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 10:55:59.703126 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699434 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 10:55:59.703126 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699437 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 10:55:59.703126 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699439 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 10:55:59.703126 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699442 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 10:55:59.703126 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699444 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 10:55:59.703126 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699447 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 10:55:59.703126 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699450 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 10:55:59.703126 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699452 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 10:55:59.703126 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699457 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 10:55:59.703126 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699459 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 10:55:59.703126 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699462 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 10:55:59.703126 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699466 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 10:55:59.703616 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699469 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 10:55:59.703616 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699471 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 10:55:59.703616 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699474 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 10:55:59.703616 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699476 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 10:55:59.703616 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699479 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 10:55:59.703616 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699482 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 10:55:59.703616 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699484 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 10:55:59.703616 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699487 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 10:55:59.703616 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699489 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 10:55:59.703616 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699492 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 10:55:59.703616 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699494 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 10:55:59.703616 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699498 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 10:55:59.703616 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699501 2560 feature_gate.go:328] unrecognized feature gate: Example Sep 08 10:55:59.703616 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699503 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 10:55:59.703616 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699506 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 10:55:59.703616 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699508 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 10:55:59.703616 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699511 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 10:55:59.703616 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699513 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 10:55:59.703616 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699516 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 10:55:59.703616 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699518 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 10:55:59.704099 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699521 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 10:55:59.704099 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699523 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 10:55:59.704099 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699526 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 10:55:59.704099 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699529 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 10:55:59.704099 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699531 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 10:55:59.704099 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699534 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 10:55:59.704099 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699536 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 10:55:59.704099 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699539 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 10:55:59.704099 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699543 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 10:55:59.704099 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699546 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 10:55:59.704099 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699548 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 10:55:59.704099 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699551 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 10:55:59.704099 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699553 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 10:55:59.704099 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699555 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 10:55:59.704099 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699558 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 10:55:59.704099 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699560 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 10:55:59.704099 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699563 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 10:55:59.704099 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699565 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 10:55:59.704099 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699568 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 10:55:59.704099 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699570 2560 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 10:55:59.704703 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699573 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 10:55:59.704703 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699575 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 10:55:59.704703 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699578 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 10:55:59.704703 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699581 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 10:55:59.704703 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699584 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 10:55:59.704703 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699589 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 10:55:59.704703 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699592 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 10:55:59.704703 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699595 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 10:55:59.704703 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699598 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 10:55:59.704703 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699601 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 10:55:59.704703 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699604 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 10:55:59.704703 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699606 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 10:55:59.704703 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699609 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 10:55:59.704703 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699611 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 10:55:59.704703 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699613 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 10:55:59.704703 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699616 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 10:55:59.704703 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699618 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 10:55:59.704703 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699621 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 10:55:59.704703 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699623 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 10:55:59.704703 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699626 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 10:55:59.705241 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.699630 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 10:55:59.705241 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699705 2560 flags.go:64] FLAG: --address="0.0.0.0" Sep 08 10:55:59.705241 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699738 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 08 10:55:59.705241 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699744 2560 flags.go:64] FLAG: --anonymous-auth="true" Sep 08 10:55:59.705241 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699749 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 08 10:55:59.705241 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699753 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 08 10:55:59.705241 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699757 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 08 10:55:59.705241 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699764 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 08 10:55:59.705241 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699768 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 08 10:55:59.705241 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699771 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 08 10:55:59.705241 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699774 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 08 10:55:59.705241 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699778 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 08 10:55:59.705241 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699781 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 08 10:55:59.705241 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699784 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 08 10:55:59.705241 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699787 2560 flags.go:64] FLAG: --cgroup-root="" Sep 08 10:55:59.705241 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699791 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 08 10:55:59.705241 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699794 2560 flags.go:64] FLAG: --client-ca-file="" Sep 08 10:55:59.705241 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699797 2560 flags.go:64] FLAG: --cloud-provider="external" Sep 08 10:55:59.705241 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699800 2560 flags.go:64] FLAG: --cluster-dns="[]" Sep 08 10:55:59.705241 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699805 2560 flags.go:64] FLAG: --cluster-domain="" Sep 08 10:55:59.705241 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699808 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 08 10:55:59.705241 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699811 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 08 10:55:59.705241 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699814 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 08 10:55:59.705241 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699818 2560 flags.go:64] FLAG: --container-log-max-files="5" Sep 08 10:55:59.705860 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699821 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 08 10:55:59.705860 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699824 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 08 10:55:59.705860 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699827 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 08 10:55:59.705860 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699831 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 08 10:55:59.705860 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699834 2560 flags.go:64] FLAG: --contention-profiling="false" Sep 08 10:55:59.705860 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699837 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 08 10:55:59.705860 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699840 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 08 10:55:59.705860 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699843 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 08 10:55:59.705860 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699847 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 08 10:55:59.705860 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699852 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 08 10:55:59.705860 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699854 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 08 10:55:59.705860 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699857 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 08 10:55:59.705860 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699860 2560 flags.go:64] FLAG: --enable-load-reader="false" Sep 08 10:55:59.705860 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699863 2560 flags.go:64] FLAG: --enable-server="true" Sep 08 10:55:59.705860 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699866 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 08 10:55:59.705860 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699870 2560 flags.go:64] FLAG: --event-burst="100" Sep 08 10:55:59.705860 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699873 2560 flags.go:64] FLAG: --event-qps="50" Sep 08 10:55:59.705860 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699876 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 08 10:55:59.705860 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699879 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 08 10:55:59.705860 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699882 2560 flags.go:64] FLAG: --eviction-hard="" Sep 08 10:55:59.705860 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699886 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 08 10:55:59.705860 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699888 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 08 10:55:59.705860 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699891 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 08 10:55:59.705860 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699896 2560 flags.go:64] FLAG: --eviction-soft="" Sep 08 10:55:59.705860 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699898 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 08 10:55:59.706518 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699901 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 08 10:55:59.706518 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699904 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 08 10:55:59.706518 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699907 2560 flags.go:64] FLAG: --experimental-mounter-path="" Sep 08 10:55:59.706518 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699910 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 08 10:55:59.706518 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699913 2560 flags.go:64] FLAG: --fail-swap-on="true" Sep 08 10:55:59.706518 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699915 2560 flags.go:64] FLAG: --feature-gates="" Sep 08 10:55:59.706518 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699919 2560 flags.go:64] FLAG: --file-check-frequency="20s" Sep 08 10:55:59.706518 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699922 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 08 10:55:59.706518 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699925 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 08 10:55:59.706518 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699928 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 08 10:55:59.706518 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699931 2560 flags.go:64] FLAG: --healthz-port="10248" Sep 08 10:55:59.706518 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699934 2560 flags.go:64] FLAG: --help="false" Sep 08 10:55:59.706518 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699938 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-139-80.ec2.internal" Sep 08 10:55:59.706518 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699940 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 08 10:55:59.706518 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699943 2560 flags.go:64] FLAG: --http-check-frequency="20s" Sep 08 10:55:59.706518 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699946 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 08 10:55:59.706518 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699950 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 08 10:55:59.706518 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699953 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 08 10:55:59.706518 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699956 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 08 10:55:59.706518 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699959 2560 flags.go:64] FLAG: --image-service-endpoint="" Sep 08 10:55:59.706518 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699961 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 08 10:55:59.706518 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699964 2560 flags.go:64] FLAG: --kube-api-burst="100" Sep 08 10:55:59.706518 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699967 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 08 10:55:59.707098 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699970 2560 flags.go:64] FLAG: --kube-api-qps="50" Sep 08 10:55:59.707098 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699973 2560 flags.go:64] FLAG: --kube-reserved="" Sep 08 10:55:59.707098 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699976 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 08 10:55:59.707098 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699978 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 08 10:55:59.707098 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699981 2560 flags.go:64] FLAG: --kubelet-cgroups="" Sep 08 10:55:59.707098 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699984 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 08 10:55:59.707098 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699987 2560 flags.go:64] FLAG: --lock-file="" Sep 08 10:55:59.707098 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699991 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 08 10:55:59.707098 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699994 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 08 10:55:59.707098 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.699997 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 08 10:55:59.707098 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700002 2560 flags.go:64] FLAG: --log-json-split-stream="false" Sep 08 10:55:59.707098 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700005 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 08 10:55:59.707098 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700008 2560 flags.go:64] FLAG: --log-text-split-stream="false" Sep 08 10:55:59.707098 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700010 2560 flags.go:64] FLAG: --logging-format="text" Sep 08 10:55:59.707098 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700013 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 08 10:55:59.707098 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700017 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 08 10:55:59.707098 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700019 2560 flags.go:64] FLAG: --manifest-url="" Sep 08 10:55:59.707098 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700022 2560 flags.go:64] FLAG: --manifest-url-header="" Sep 08 10:55:59.707098 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700027 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 08 10:55:59.707098 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700030 2560 flags.go:64] FLAG: --max-open-files="1000000" Sep 08 10:55:59.707098 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700034 2560 flags.go:64] FLAG: --max-pods="110" Sep 08 10:55:59.707098 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700037 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 08 10:55:59.707098 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700040 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 08 10:55:59.707098 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700043 2560 flags.go:64] FLAG: --memory-manager-policy="None" Sep 08 10:55:59.707098 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700046 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 08 10:55:59.707754 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700049 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 08 10:55:59.707754 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700052 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 08 10:55:59.707754 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700056 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 08 10:55:59.707754 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700063 2560 flags.go:64] FLAG: --node-status-max-images="50" Sep 08 10:55:59.707754 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700066 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 08 10:55:59.707754 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700069 2560 flags.go:64] FLAG: --oom-score-adj="-999" Sep 08 10:55:59.707754 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700072 2560 flags.go:64] FLAG: --pod-cidr="" Sep 08 10:55:59.707754 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700075 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 08 10:55:59.707754 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700081 2560 flags.go:64] FLAG: --pod-manifest-path="" Sep 08 10:55:59.707754 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700084 2560 flags.go:64] FLAG: --pod-max-pids="-1" Sep 08 10:55:59.707754 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700087 2560 flags.go:64] FLAG: --pods-per-core="0" Sep 08 10:55:59.707754 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700089 2560 flags.go:64] FLAG: --port="10250" Sep 08 10:55:59.707754 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700092 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 08 10:55:59.707754 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700095 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08663bbb039b1aa99" Sep 08 10:55:59.707754 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700100 2560 flags.go:64] FLAG: --qos-reserved="" Sep 08 10:55:59.707754 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700103 2560 flags.go:64] FLAG: --read-only-port="10255" Sep 08 10:55:59.707754 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700106 2560 flags.go:64] FLAG: --register-node="true" Sep 08 10:55:59.707754 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700109 2560 flags.go:64] FLAG: --register-with-taints="" Sep 08 10:55:59.707754 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700113 2560 flags.go:64] FLAG: --registry-burst="10" Sep 08 10:55:59.707754 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700116 2560 flags.go:64] FLAG: --registry-qps="5" Sep 08 10:55:59.707754 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700118 2560 flags.go:64] FLAG: --reserved-cpus="" Sep 08 10:55:59.707754 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700121 2560 flags.go:64] FLAG: --reserved-memory="" Sep 08 10:55:59.707754 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700125 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 08 10:55:59.707754 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700127 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 08 10:55:59.707754 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700131 2560 flags.go:64] FLAG: --rotate-certificates="false" Sep 08 10:55:59.708403 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700134 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 08 10:55:59.708403 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700137 2560 flags.go:64] FLAG: --runonce="false" Sep 08 10:55:59.708403 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700139 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 08 10:55:59.708403 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700142 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 08 10:55:59.708403 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700145 2560 flags.go:64] FLAG: --seccomp-default="false" Sep 08 10:55:59.708403 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700148 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 08 10:55:59.708403 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700151 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 08 10:55:59.708403 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700154 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 08 10:55:59.708403 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700157 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 08 10:55:59.708403 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700160 2560 flags.go:64] FLAG: --storage-driver-password="root" Sep 08 10:55:59.708403 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700177 2560 flags.go:64] FLAG: --storage-driver-secure="false" Sep 08 10:55:59.708403 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700180 2560 flags.go:64] FLAG: --storage-driver-table="stats" Sep 08 10:55:59.708403 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700183 2560 flags.go:64] FLAG: --storage-driver-user="root" Sep 08 10:55:59.708403 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700185 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 08 10:55:59.708403 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700188 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 08 10:55:59.708403 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700191 2560 flags.go:64] FLAG: --system-cgroups="" Sep 08 10:55:59.708403 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700194 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 08 10:55:59.708403 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700199 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 08 10:55:59.708403 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700201 2560 flags.go:64] FLAG: --tls-cert-file="" Sep 08 10:55:59.708403 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700204 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 08 10:55:59.708403 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700209 2560 flags.go:64] FLAG: --tls-min-version="" Sep 08 10:55:59.708403 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700213 2560 flags.go:64] FLAG: --tls-private-key-file="" Sep 08 10:55:59.708403 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700216 2560 flags.go:64] FLAG: --topology-manager-policy="none" Sep 08 10:55:59.708403 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700219 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 08 10:55:59.708403 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700221 2560 flags.go:64] FLAG: --topology-manager-scope="container" Sep 08 10:55:59.709061 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700224 2560 flags.go:64] FLAG: --v="2" Sep 08 10:55:59.709061 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700228 2560 flags.go:64] FLAG: --version="false" Sep 08 10:55:59.709061 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700232 2560 flags.go:64] FLAG: --vmodule="" Sep 08 10:55:59.709061 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700235 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 08 10:55:59.709061 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.700238 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 08 10:55:59.709061 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700370 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 10:55:59.709061 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700375 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 10:55:59.709061 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700378 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 10:55:59.709061 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700381 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 10:55:59.709061 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700384 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 10:55:59.709061 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700387 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 10:55:59.709061 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700389 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 10:55:59.709061 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700392 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 10:55:59.709061 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700394 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 10:55:59.709061 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700399 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 10:55:59.709061 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700402 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 10:55:59.709061 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700404 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 10:55:59.709061 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700407 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 10:55:59.709061 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700410 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 10:55:59.709061 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700412 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 10:55:59.709061 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700415 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 10:55:59.709904 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700417 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 10:55:59.709904 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700420 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 10:55:59.709904 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700422 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 10:55:59.709904 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700425 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 10:55:59.709904 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700427 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 10:55:59.709904 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700430 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 10:55:59.709904 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700432 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 10:55:59.709904 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700436 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 10:55:59.709904 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700438 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 10:55:59.709904 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700441 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 10:55:59.709904 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700443 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 10:55:59.709904 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700446 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 10:55:59.709904 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700448 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 10:55:59.709904 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700452 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 10:55:59.709904 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700456 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 10:55:59.709904 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700459 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 10:55:59.709904 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700462 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 10:55:59.709904 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700464 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 10:55:59.709904 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700467 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 10:55:59.709904 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700469 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 10:55:59.710787 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700472 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 10:55:59.710787 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700474 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 10:55:59.710787 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700477 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 10:55:59.710787 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700479 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 10:55:59.710787 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700482 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 10:55:59.710787 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700486 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 10:55:59.710787 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700489 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 10:55:59.710787 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700491 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 10:55:59.710787 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700494 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 10:55:59.710787 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700496 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 10:55:59.710787 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700499 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 10:55:59.710787 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700502 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 10:55:59.710787 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700504 2560 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 10:55:59.710787 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700508 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 10:55:59.710787 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700511 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 10:55:59.710787 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700514 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 10:55:59.710787 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700517 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 10:55:59.710787 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700520 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 10:55:59.710787 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700523 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 10:55:59.710787 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700527 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 10:55:59.711681 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700529 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 10:55:59.711681 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700532 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 10:55:59.711681 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700534 2560 feature_gate.go:328] unrecognized feature gate: Example Sep 08 10:55:59.711681 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700537 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 10:55:59.711681 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700539 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 10:55:59.711681 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700541 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 10:55:59.711681 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700544 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 10:55:59.711681 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700547 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 10:55:59.711681 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700552 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 10:55:59.711681 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700556 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 10:55:59.711681 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700559 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 10:55:59.711681 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700562 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 10:55:59.711681 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700564 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 10:55:59.711681 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700567 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 10:55:59.711681 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700569 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 10:55:59.711681 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700572 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 10:55:59.711681 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700574 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 10:55:59.711681 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700578 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 10:55:59.711681 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700581 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 10:55:59.711681 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700584 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 10:55:59.712581 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700586 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 10:55:59.712581 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700589 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 10:55:59.712581 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700591 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 10:55:59.712581 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700594 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 10:55:59.712581 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700597 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 10:55:59.712581 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700599 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 10:55:59.712581 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700602 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 10:55:59.712581 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700604 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 10:55:59.712581 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700607 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 10:55:59.712581 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700609 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 10:55:59.712581 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700612 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 10:55:59.712581 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700615 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 10:55:59.712581 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700618 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 10:55:59.712581 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700620 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 10:55:59.712581 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700623 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 10:55:59.712581 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700625 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 10:55:59.712581 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700627 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 10:55:59.712581 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700630 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 10:55:59.712581 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700634 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 10:55:59.713495 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700637 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 10:55:59.713495 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700639 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 10:55:59.713495 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700642 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 10:55:59.713495 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.700644 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 10:55:59.713495 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.701596 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 10:55:59.713495 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.711882 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 08 10:55:59.713495 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.711903 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 08 10:55:59.713495 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.711923 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 08 10:55:59.713495 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.711932 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 08 10:55:59.713495 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712020 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 10:55:59.713495 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712027 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 10:55:59.713495 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712032 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 10:55:59.713495 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712037 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 10:55:59.713495 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712042 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 10:55:59.713847 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712047 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 10:55:59.713847 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712051 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 10:55:59.713847 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712056 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 10:55:59.713847 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712060 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 10:55:59.713847 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712064 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 10:55:59.713847 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712069 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 10:55:59.713847 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712073 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 10:55:59.713847 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712077 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 10:55:59.713847 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712081 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 10:55:59.713847 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712085 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 10:55:59.713847 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712089 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 10:55:59.713847 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712094 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 10:55:59.713847 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712098 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 10:55:59.713847 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712103 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 10:55:59.713847 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712107 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 10:55:59.713847 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712111 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 10:55:59.713847 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712115 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 10:55:59.713847 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712119 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 10:55:59.713847 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712123 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 10:55:59.713847 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712127 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 10:55:59.714608 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712132 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 10:55:59.714608 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712136 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 10:55:59.714608 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712141 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 10:55:59.714608 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712145 2560 feature_gate.go:328] unrecognized feature gate: Example Sep 08 10:55:59.714608 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712150 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 10:55:59.714608 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712154 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 10:55:59.714608 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712158 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 10:55:59.714608 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712182 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 10:55:59.714608 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712187 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 10:55:59.714608 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712192 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 10:55:59.714608 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712196 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 10:55:59.714608 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712201 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 10:55:59.714608 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712205 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 10:55:59.714608 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712210 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 10:55:59.714608 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712214 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 10:55:59.714608 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712218 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 10:55:59.714608 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712222 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 10:55:59.714608 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712226 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 10:55:59.714608 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712230 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 10:55:59.715414 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712234 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 10:55:59.715414 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712238 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 10:55:59.715414 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712242 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 10:55:59.715414 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712246 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 10:55:59.715414 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712250 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 10:55:59.715414 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712255 2560 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 10:55:59.715414 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712260 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 10:55:59.715414 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712264 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 10:55:59.715414 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712268 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 10:55:59.715414 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712273 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 10:55:59.715414 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712277 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 10:55:59.715414 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712281 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 10:55:59.715414 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712285 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 10:55:59.715414 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712290 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 10:55:59.715414 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712295 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 10:55:59.715414 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712299 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 10:55:59.715414 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712303 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 10:55:59.715414 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712308 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 10:55:59.715414 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712312 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 10:55:59.715414 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712317 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 10:55:59.716000 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712321 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 10:55:59.716000 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712327 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 10:55:59.716000 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712334 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 10:55:59.716000 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712340 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 10:55:59.716000 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712345 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 10:55:59.716000 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712350 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 10:55:59.716000 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712363 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 10:55:59.716000 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712368 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 10:55:59.716000 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712372 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 10:55:59.716000 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712376 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 10:55:59.716000 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712380 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 10:55:59.716000 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712385 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 10:55:59.716000 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712389 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 10:55:59.716000 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712393 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 10:55:59.716000 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712397 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 10:55:59.716000 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712402 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 10:55:59.716000 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712407 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 10:55:59.716000 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712411 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 10:55:59.716000 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712415 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 10:55:59.716642 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712418 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 10:55:59.716642 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712422 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 10:55:59.716642 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712427 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 10:55:59.716642 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712431 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 10:55:59.716642 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712435 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 10:55:59.716642 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712440 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 10:55:59.716642 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712444 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 10:55:59.716642 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712448 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 10:55:59.716642 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712454 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 10:55:59.716642 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712460 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 10:55:59.716642 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712465 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 10:55:59.716642 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712469 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 10:55:59.716642 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712473 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 10:55:59.716642 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712477 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 10:55:59.716642 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712482 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 10:55:59.716642 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712486 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 10:55:59.717050 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.712494 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 10:55:59.717050 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712674 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 10:55:59.717050 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712682 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 10:55:59.717050 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712687 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 10:55:59.717050 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712692 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 10:55:59.717050 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712696 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 10:55:59.717050 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712701 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 10:55:59.717050 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712706 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 10:55:59.717050 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712711 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 10:55:59.717050 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712715 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 10:55:59.717050 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712720 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 10:55:59.717050 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712724 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 10:55:59.717050 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712728 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 10:55:59.717050 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712733 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 10:55:59.717050 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712737 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 10:55:59.717513 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712742 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 10:55:59.717513 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712746 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 10:55:59.717513 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712750 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 10:55:59.717513 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712755 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 10:55:59.717513 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712759 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 10:55:59.717513 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712763 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 10:55:59.717513 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712767 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 10:55:59.717513 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712771 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 10:55:59.717513 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712775 2560 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 10:55:59.717513 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712779 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 10:55:59.717513 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712785 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 10:55:59.717513 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712789 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 10:55:59.717513 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712793 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 10:55:59.717513 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712797 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 10:55:59.717513 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712802 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 10:55:59.717513 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712806 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 10:55:59.717513 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712810 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 10:55:59.717513 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712814 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 10:55:59.717513 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712818 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 10:55:59.717977 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712821 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 10:55:59.717977 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712826 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 10:55:59.717977 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712829 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 10:55:59.717977 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712833 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 10:55:59.717977 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712837 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 10:55:59.717977 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712841 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 10:55:59.717977 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712846 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 10:55:59.717977 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712850 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 10:55:59.717977 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712854 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 10:55:59.717977 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712858 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 10:55:59.717977 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712862 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 10:55:59.717977 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712866 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 10:55:59.717977 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712872 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 10:55:59.717977 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712876 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 10:55:59.717977 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712880 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 10:55:59.717977 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712885 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 10:55:59.717977 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712889 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 10:55:59.717977 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712893 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 10:55:59.717977 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712897 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 10:55:59.717977 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712901 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 10:55:59.718517 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712906 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 10:55:59.718517 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712910 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 10:55:59.718517 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712914 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 10:55:59.718517 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712919 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 10:55:59.718517 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712923 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 10:55:59.718517 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712928 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 10:55:59.718517 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712934 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 10:55:59.718517 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712940 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 10:55:59.718517 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712946 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 10:55:59.718517 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712951 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 10:55:59.718517 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712956 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 10:55:59.718517 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712960 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 10:55:59.718517 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712964 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 10:55:59.718517 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712969 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 10:55:59.718517 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712973 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 10:55:59.718517 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712977 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 10:55:59.718517 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712981 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 10:55:59.718517 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712985 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 10:55:59.718517 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712989 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 10:55:59.718517 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712993 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 10:55:59.719048 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.712996 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 10:55:59.719048 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.713001 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 10:55:59.719048 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.713004 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 10:55:59.719048 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.713009 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 10:55:59.719048 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.713013 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 10:55:59.719048 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.713019 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 10:55:59.719048 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.713023 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 10:55:59.719048 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.713027 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 10:55:59.719048 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.713031 2560 feature_gate.go:328] unrecognized feature gate: Example Sep 08 10:55:59.719048 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.713035 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 10:55:59.719048 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.713040 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 10:55:59.719048 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.713043 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 10:55:59.719048 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.713048 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 10:55:59.719048 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.713052 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 10:55:59.719048 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.713056 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 10:55:59.719048 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.713062 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 10:55:59.719048 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.713066 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 10:55:59.719048 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.713070 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 10:55:59.719048 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.713075 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 10:55:59.719048 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.713079 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 10:55:59.719560 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.713083 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 10:55:59.719560 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.713087 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 10:55:59.719560 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.713092 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 10:55:59.719560 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.713096 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 10:55:59.719560 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.713100 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 10:55:59.719560 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:55:59.713106 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 10:55:59.719560 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.713115 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 10:55:59.719560 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.713289 2560 server.go:962] "Client rotation is on, will bootstrap in background" Sep 08 10:55:59.719560 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.716293 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 08 10:55:59.719560 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.717339 2560 server.go:1019] "Starting client certificate rotation" Sep 08 10:55:59.719560 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.717445 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 08 10:55:59.719560 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.717480 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 08 10:55:59.721020 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.721001 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 08 10:55:59.722228 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.722197 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 08 10:55:59.731199 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.731181 2560 log.go:25] "Validated CRI v1 runtime API" Sep 08 10:55:59.735221 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.735197 2560 log.go:25] "Validated CRI v1 image API" Sep 08 10:55:59.736856 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.736840 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 08 10:55:59.742430 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.742405 2560 fs.go:135] Filesystem UUIDs: map[6c5cbb57-3a9a-4ca3-b080-bfcf69dfbd02:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d963c7fb-e5e8-40e6-a5f3-65358a6b1464:/dev/nvme0n1p4] Sep 08 10:55:59.742485 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.742429 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 08 10:55:59.744870 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.744849 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 08 10:55:59.751023 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.750899 2560 manager.go:216] Machine: {Timestamp:2026-09-08 10:55:59.749461671 +0000 UTC m=+0.382057182 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099699 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fff6ec3a91824d217dff697e591b1 SystemUUID:ec2fff6e-c3a9-1824-d217-dff697e591b1 BootID:4ad53074-43ab-41c6-a107-7b41600b884b Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:26:d6:2e:05:0f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:26:d6:2e:05:0f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:5a:f1:73:b7:5e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 08 10:55:59.751023 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.751012 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 08 10:55:59.751199 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.751106 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 08 10:55:59.754218 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.754188 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 08 10:55:59.754387 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.754223 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-80.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 08 10:55:59.755745 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.755732 2560 topology_manager.go:138] "Creating topology manager with none policy" Sep 08 10:55:59.755801 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.755751 2560 container_manager_linux.go:309] "Creating device plugin manager" Sep 08 10:55:59.755801 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.755762 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 08 10:55:59.756508 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.756495 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 08 10:55:59.758253 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.758241 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 08 10:55:59.761472 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.761458 2560 state_mem.go:36] "Initialized new in-memory state store" Sep 08 10:55:59.761615 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.761604 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 08 10:55:59.761681 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.761644 2560 kubelet.go:486] "Attempting to sync node with API server" Sep 08 10:55:59.761681 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.761659 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 08 10:55:59.761681 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.761678 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 08 10:55:59.761791 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.761691 2560 kubelet.go:398] "Adding apiserver pod source" Sep 08 10:55:59.761791 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.761705 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 08 10:55:59.762141 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.762127 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 08 10:55:59.762244 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.762152 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 08 10:55:59.764750 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.764731 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 08 10:55:59.767323 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.767307 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ms5jg" Sep 08 10:55:59.767736 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.767720 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 08 10:55:59.767800 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.767757 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 08 10:55:59.767930 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.767919 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 08 10:55:59.767982 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.767936 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 08 10:55:59.767982 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.767942 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 08 10:55:59.767982 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.767949 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 08 10:55:59.767982 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.767960 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 08 10:55:59.767982 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.767966 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 08 10:55:59.768528 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.768519 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 08 10:55:59.768528 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.768528 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 08 10:55:59.768592 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.768535 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 08 10:55:59.768592 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.768540 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 08 10:55:59.768592 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.768549 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 08 10:55:59.768592 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.768556 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 08 10:55:59.770033 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.770022 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 08 10:55:59.770033 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.770033 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 08 10:55:59.772795 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.772778 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-80.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 08 10:55:59.772859 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:55:59.772779 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 08 10:55:59.772859 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:55:59.772819 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-80.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 08 10:55:59.774095 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.774082 2560 server.go:1268] "Started kubelet" Sep 08 10:55:59.774181 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.774140 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 08 10:55:59.774415 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.774297 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 08 10:55:59.774516 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.774475 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 08 10:55:59.775079 ip-10-0-139-80 systemd[1]: Started Kubernetes Kubelet. Sep 08 10:55:59.775323 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.775092 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ms5jg" Sep 08 10:55:59.776345 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.776322 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 08 10:55:59.777002 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.776990 2560 server.go:310] "Adding debug handlers to kubelet server" Sep 08 10:55:59.779088 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:55:59.779063 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 08 10:55:59.782881 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.782865 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 08 10:55:59.783635 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.783623 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 08 10:55:59.783744 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:55:59.783721 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-80.ec2.internal\" not found" Sep 08 10:55:59.784398 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.784375 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 08 10:55:59.784493 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.784385 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 08 10:55:59.784493 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.784416 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 08 10:55:59.784693 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.784677 2560 reconstruct.go:97] "Volume reconstruction finished" Sep 08 10:55:59.784693 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.784692 2560 reconciler.go:29] "Reconciler: start to sync state" Sep 08 10:55:59.784779 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.784681 2560 factory.go:55] Registering systemd factory Sep 08 10:55:59.784779 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.784751 2560 factory.go:223] Registration of the systemd container factory successfully Sep 08 10:55:59.784958 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.784946 2560 factory.go:153] Registering CRI-O factory Sep 08 10:55:59.785013 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.784963 2560 factory.go:223] Registration of the crio container factory successfully Sep 08 10:55:59.785059 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.785018 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 08 10:55:59.785059 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.785036 2560 factory.go:103] Registering Raw factory Sep 08 10:55:59.785059 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.785051 2560 manager.go:1196] Started watching for new ooms in manager Sep 08 10:55:59.785419 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.785404 2560 manager.go:349] Starting recovery of all containers Sep 08 10:55:59.787134 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.787109 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 10:55:59.789712 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:55:59.789684 2560 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-80.ec2.internal\" not found" node="ip-10-0-139-80.ec2.internal" Sep 08 10:55:59.798110 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.798085 2560 manager.go:354] Recovery completed Sep 08 10:55:59.802450 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.802435 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 10:55:59.804099 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.804083 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-80.ec2.internal" event="NodeHasSufficientMemory" Sep 08 10:55:59.804157 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.804114 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-80.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 10:55:59.804157 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.804126 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-80.ec2.internal" event="NodeHasSufficientPID" Sep 08 10:55:59.804807 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.804790 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 08 10:55:59.804807 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.804801 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 08 10:55:59.804908 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.804819 2560 state_mem.go:36] "Initialized new in-memory state store" Sep 08 10:55:59.804908 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.804803 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 10:55:59.805612 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.805596 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-80.ec2.internal" event="NodeHasSufficientMemory" Sep 08 10:55:59.805669 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.805624 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-80.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 10:55:59.805669 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.805634 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-80.ec2.internal" event="NodeHasSufficientPID" Sep 08 10:55:59.806063 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.806051 2560 policy_none.go:49] "None policy: Start" Sep 08 10:55:59.806092 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.806068 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 08 10:55:59.806092 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.806079 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 08 10:55:59.806951 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.806933 2560 policy_none.go:47] "Start" Sep 08 10:55:59.846054 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.846039 2560 manager.go:337] "Starting Device Plugin manager" Sep 08 10:55:59.868640 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:55:59.846084 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 08 10:55:59.868640 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.846095 2560 server.go:87] "Starting device plugin registration server" Sep 08 10:55:59.868640 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.846452 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 08 10:55:59.868640 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.846462 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 08 10:55:59.868640 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.846574 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 08 10:55:59.868640 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.846683 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 08 10:55:59.868640 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.846693 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 08 10:55:59.868640 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:55:59.848391 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 08 10:55:59.868640 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:55:59.848450 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-80.ec2.internal\" not found" Sep 08 10:55:59.893227 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.893184 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 08 10:55:59.894471 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.894446 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 08 10:55:59.894545 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.894522 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 08 10:55:59.894580 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.894559 2560 kubelet.go:2448] "Starting kubelet main sync loop" Sep 08 10:55:59.894625 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:55:59.894611 2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 08 10:55:59.897157 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.897137 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 10:55:59.946695 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.946579 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 10:55:59.947580 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.947560 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-80.ec2.internal" event="NodeHasSufficientMemory" Sep 08 10:55:59.947668 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.947599 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-80.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 10:55:59.947668 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.947610 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-80.ec2.internal" event="NodeHasSufficientPID" Sep 08 10:55:59.947668 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.947634 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-80.ec2.internal" Sep 08 10:55:59.961934 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.961912 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-80.ec2.internal" Sep 08 10:55:59.961989 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:55:59.961940 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-80.ec2.internal\": node \"ip-10-0-139-80.ec2.internal\" not found" Sep 08 10:55:59.978329 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:55:59.978300 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-80.ec2.internal\" not found" Sep 08 10:55:59.995744 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.995705 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-80.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-80.ec2.internal"] Sep 08 10:55:59.995870 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.995812 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 10:55:59.997457 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.997440 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-80.ec2.internal" event="NodeHasSufficientMemory" Sep 08 10:55:59.997546 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.997468 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-80.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 10:55:59.997546 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.997486 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-80.ec2.internal" event="NodeHasSufficientPID" Sep 08 10:55:59.999383 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.999369 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 10:55:59.999512 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.999497 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-80.ec2.internal" Sep 08 10:55:59.999552 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:55:59.999529 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 10:56:00.000118 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.000102 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-80.ec2.internal" event="NodeHasSufficientMemory" Sep 08 10:56:00.000224 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.000119 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-80.ec2.internal" event="NodeHasSufficientMemory" Sep 08 10:56:00.000224 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.000131 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-80.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 10:56:00.000224 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.000138 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-80.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 10:56:00.000224 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.000141 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-80.ec2.internal" event="NodeHasSufficientPID" Sep 08 10:56:00.000224 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.000148 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-80.ec2.internal" event="NodeHasSufficientPID" Sep 08 10:56:00.002091 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.002075 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-80.ec2.internal" Sep 08 10:56:00.002197 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.002100 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 10:56:00.002781 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.002767 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-80.ec2.internal" event="NodeHasSufficientMemory" Sep 08 10:56:00.002838 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.002792 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-80.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 10:56:00.002838 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.002806 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-80.ec2.internal" event="NodeHasSufficientPID" Sep 08 10:56:00.022963 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:00.022935 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-80.ec2.internal\" not found" node="ip-10-0-139-80.ec2.internal" Sep 08 10:56:00.027466 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:00.027449 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-80.ec2.internal\" not found" node="ip-10-0-139-80.ec2.internal" Sep 08 10:56:00.079310 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:00.079282 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-80.ec2.internal\" not found" Sep 08 10:56:00.085655 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.085630 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5973e251c0e47bb871ab5b1debe18153-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-80.ec2.internal\" (UID: \"5973e251c0e47bb871ab5b1debe18153\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-80.ec2.internal" Sep 08 10:56:00.085734 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.085663 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/952015d437c3d0f0cd335c2b2dde7781-config\") pod \"kube-apiserver-proxy-ip-10-0-139-80.ec2.internal\" (UID: \"952015d437c3d0f0cd335c2b2dde7781\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-80.ec2.internal" Sep 08 10:56:00.085734 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.085681 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5973e251c0e47bb871ab5b1debe18153-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-80.ec2.internal\" (UID: \"5973e251c0e47bb871ab5b1debe18153\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-80.ec2.internal" Sep 08 10:56:00.179849 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:00.179816 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-80.ec2.internal\" not found" Sep 08 10:56:00.186206 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.186186 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5973e251c0e47bb871ab5b1debe18153-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-80.ec2.internal\" (UID: \"5973e251c0e47bb871ab5b1debe18153\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-80.ec2.internal" Sep 08 10:56:00.186310 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.186214 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5973e251c0e47bb871ab5b1debe18153-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-80.ec2.internal\" (UID: \"5973e251c0e47bb871ab5b1debe18153\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-80.ec2.internal" Sep 08 10:56:00.186310 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.186231 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/952015d437c3d0f0cd335c2b2dde7781-config\") pod \"kube-apiserver-proxy-ip-10-0-139-80.ec2.internal\" (UID: \"952015d437c3d0f0cd335c2b2dde7781\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-80.ec2.internal" Sep 08 10:56:00.186310 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.186260 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/952015d437c3d0f0cd335c2b2dde7781-config\") pod \"kube-apiserver-proxy-ip-10-0-139-80.ec2.internal\" (UID: \"952015d437c3d0f0cd335c2b2dde7781\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-80.ec2.internal" Sep 08 10:56:00.186310 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.186292 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5973e251c0e47bb871ab5b1debe18153-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-80.ec2.internal\" (UID: \"5973e251c0e47bb871ab5b1debe18153\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-80.ec2.internal" Sep 08 10:56:00.186442 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.186295 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5973e251c0e47bb871ab5b1debe18153-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-80.ec2.internal\" (UID: \"5973e251c0e47bb871ab5b1debe18153\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-80.ec2.internal" Sep 08 10:56:00.280620 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:00.280554 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-80.ec2.internal\" not found" Sep 08 10:56:00.326019 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.325983 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-80.ec2.internal" Sep 08 10:56:00.331067 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.330625 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-80.ec2.internal" Sep 08 10:56:00.380921 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:00.380881 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-80.ec2.internal\" not found" Sep 08 10:56:00.481452 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:00.481424 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-80.ec2.internal\" not found" Sep 08 10:56:00.582023 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:00.581943 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-80.ec2.internal\" not found" Sep 08 10:56:00.682659 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:00.682624 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-80.ec2.internal\" not found" Sep 08 10:56:00.717082 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.717054 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 08 10:56:00.717519 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.717219 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 08 10:56:00.717519 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.717223 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 08 10:56:00.744984 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.744957 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 10:56:00.762207 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.762181 2560 apiserver.go:52] "Watching apiserver" Sep 08 10:56:00.773993 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.773961 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 08 10:56:00.774341 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.774317 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-wfrtm","openshift-image-registry/node-ca-wx4r8","openshift-multus/multus-6sb6d","openshift-network-operator/iptables-alerter-lbdsq","kube-system/konnectivity-agent-cjnqs","openshift-multus/multus-additional-cni-plugins-zzppw","openshift-multus/network-metrics-daemon-msdpf","openshift-network-diagnostics/network-check-target-pdd9x","openshift-ovn-kubernetes/ovnkube-node-2fn2c","kube-system/global-pull-secret-syncer-vtxs2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwswd","openshift-cluster-node-tuning-operator/tuned-pj5pz"] Sep 08 10:56:00.776886 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.776871 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wfrtm" Sep 08 10:56:00.778918 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.778895 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wx4r8" Sep 08 10:56:00.779401 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.779383 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9vdbn\"" Sep 08 10:56:00.779401 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.779390 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 08 10:56:00.779553 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.779385 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 08 10:56:00.781043 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.781025 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.781374 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.781357 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 08 10:56:00.781464 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.781358 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 08 10:56:00.781464 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.781445 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 08 10:56:00.781574 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.781498 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7xshf\"" Sep 08 10:56:00.781574 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.781535 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 10:51:00 +0000 UTC" deadline="2028-04-17 08:04:17.787470364 +0000 UTC" Sep 08 10:56:00.781668 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.781574 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14085h8m17.005900205s" Sep 08 10:56:00.783065 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.783038 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 08 10:56:00.783156 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.783121 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lbdsq" Sep 08 10:56:00.783263 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.783247 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 08 10:56:00.783794 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.783611 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-t6slc\"" Sep 08 10:56:00.783794 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.783662 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 08 10:56:00.783794 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.783688 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 08 10:56:00.783932 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.783822 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-80.ec2.internal" Sep 08 10:56:00.785275 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.785257 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cjnqs" Sep 08 10:56:00.787719 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.787698 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 08 10:56:00.787719 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.787698 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 08 10:56:00.787864 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.787763 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 08 10:56:00.787864 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.787763 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lhtck\"" Sep 08 10:56:00.787959 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.787918 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 08 10:56:00.788007 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.787969 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zzppw" Sep 08 10:56:00.788007 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.787993 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qb8xk\"" Sep 08 10:56:00.788094 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.788026 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 08 10:56:00.788152 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.788122 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 08 10:56:00.789960 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.789937 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-host-var-lib-cni-multus\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.790062 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.789972 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwmdv\" (UniqueName: \"kubernetes.io/projected/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-kube-api-access-fwmdv\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.790062 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.789997 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83286d64-d4e8-4548-8a35-e9fb3201c67e-konnectivity-ca\") pod \"konnectivity-agent-cjnqs\" (UID: \"83286d64-d4e8-4548-8a35-e9fb3201c67e\") " pod="kube-system/konnectivity-agent-cjnqs" Sep 08 10:56:00.790062 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.790005 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:56:00.790062 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.790020 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-system-cni-dir\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.790298 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.790061 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-host-run-k8s-cni-cncf-io\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.790298 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:00.790062 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msdpf" podUID="dc69f433-ba6d-4fd6-ad22-29d26782f11d" Sep 08 10:56:00.790298 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.790133 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-hostroot\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.790298 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.790196 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-host-run-multus-certs\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.790298 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.790222 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/984def62-1940-433d-83c1-b241c0f5cfa5-tmp-dir\") pod \"node-resolver-wfrtm\" (UID: \"984def62-1940-433d-83c1-b241c0f5cfa5\") " pod="openshift-dns/node-resolver-wfrtm" Sep 08 10:56:00.790298 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.790255 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb5352bc-dbdc-4c6c-a20a-62c87a1e446f-host\") pod \"node-ca-wx4r8\" (UID: \"eb5352bc-dbdc-4c6c-a20a-62c87a1e446f\") " pod="openshift-image-registry/node-ca-wx4r8" Sep 08 10:56:00.790298 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.790293 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/090c52f2-8dd6-471d-8dd0-96b288d6aec7-host-slash\") pod \"iptables-alerter-lbdsq\" (UID: \"090c52f2-8dd6-471d-8dd0-96b288d6aec7\") " pod="openshift-network-operator/iptables-alerter-lbdsq" Sep 08 10:56:00.790651 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.790311 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgb8n\" (UniqueName: \"kubernetes.io/projected/090c52f2-8dd6-471d-8dd0-96b288d6aec7-kube-api-access-rgb8n\") pod \"iptables-alerter-lbdsq\" (UID: \"090c52f2-8dd6-471d-8dd0-96b288d6aec7\") " pod="openshift-network-operator/iptables-alerter-lbdsq" Sep 08 10:56:00.790651 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.790335 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xndtd\" (UniqueName: \"kubernetes.io/projected/984def62-1940-433d-83c1-b241c0f5cfa5-kube-api-access-xndtd\") pod \"node-resolver-wfrtm\" (UID: \"984def62-1940-433d-83c1-b241c0f5cfa5\") " pod="openshift-dns/node-resolver-wfrtm" Sep 08 10:56:00.790651 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.790360 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcl4w\" (UniqueName: \"kubernetes.io/projected/eb5352bc-dbdc-4c6c-a20a-62c87a1e446f-kube-api-access-xcl4w\") pod \"node-ca-wx4r8\" (UID: \"eb5352bc-dbdc-4c6c-a20a-62c87a1e446f\") " pod="openshift-image-registry/node-ca-wx4r8" Sep 08 10:56:00.790651 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.790374 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-multus-cni-dir\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.790651 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.790389 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-cni-binary-copy\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.790651 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.790403 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-multus-socket-dir-parent\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.790651 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.790427 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-host-var-lib-kubelet\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.790651 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.790450 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/090c52f2-8dd6-471d-8dd0-96b288d6aec7-iptables-alerter-script\") pod \"iptables-alerter-lbdsq\" (UID: \"090c52f2-8dd6-471d-8dd0-96b288d6aec7\") " pod="openshift-network-operator/iptables-alerter-lbdsq" Sep 08 10:56:00.790651 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.790473 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-cnibin\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.790651 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.790503 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-host-run-netns\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.790651 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.790525 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-host-var-lib-cni-bin\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.790651 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.790544 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-multus-conf-dir\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.790651 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.790561 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/984def62-1940-433d-83c1-b241c0f5cfa5-hosts-file\") pod \"node-resolver-wfrtm\" (UID: \"984def62-1940-433d-83c1-b241c0f5cfa5\") " pod="openshift-dns/node-resolver-wfrtm" Sep 08 10:56:00.790651 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.790574 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb5352bc-dbdc-4c6c-a20a-62c87a1e446f-serviceca\") pod \"node-ca-wx4r8\" (UID: \"eb5352bc-dbdc-4c6c-a20a-62c87a1e446f\") " pod="openshift-image-registry/node-ca-wx4r8" Sep 08 10:56:00.790651 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.790587 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-multus-daemon-config\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.790651 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.790607 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83286d64-d4e8-4548-8a35-e9fb3201c67e-agent-certs\") pod \"konnectivity-agent-cjnqs\" (UID: \"83286d64-d4e8-4548-8a35-e9fb3201c67e\") " pod="kube-system/konnectivity-agent-cjnqs" Sep 08 10:56:00.790651 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.790641 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-etc-kubernetes\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.791409 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.790740 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pbdjc\"" Sep 08 10:56:00.791409 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.790991 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 08 10:56:00.791409 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.791024 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 08 10:56:00.792281 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.792266 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:56:00.792378 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:00.792344 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdd9x" podUID="bd67d177-bc24-48be-acca-e3cd070e193e" Sep 08 10:56:00.797274 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.796391 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 08 10:56:00.797274 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.796523 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.797274 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.796622 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-80.ec2.internal" Sep 08 10:56:00.798909 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.798888 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 08 10:56:00.798909 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.798901 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:00.799060 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:00.798975 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtxs2" podUID="30463b34-4ef7-4a59-8b30-dd4b1199e7a6" Sep 08 10:56:00.799270 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.799246 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 08 10:56:00.799437 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.799425 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 08 10:56:00.799584 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.799545 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 08 10:56:00.799771 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.799737 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pwmgl\"" Sep 08 10:56:00.799771 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.799769 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 08 10:56:00.799888 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.799806 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 08 10:56:00.799888 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.799847 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 08 10:56:00.801243 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.801228 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwswd" Sep 08 10:56:00.803373 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.803358 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 08 10:56:00.803533 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.803504 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-80.ec2.internal"] Sep 08 10:56:00.803657 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.803542 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nl7cq\"" Sep 08 10:56:00.803657 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.803566 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 08 10:56:00.803657 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.803592 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.803657 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.803593 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 08 10:56:00.806180 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.806148 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 08 10:56:00.806294 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.806271 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qdpgc\"" Sep 08 10:56:00.806551 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.806530 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 08 10:56:00.806637 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.806533 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 08 10:56:00.806761 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.806742 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-80.ec2.internal"] Sep 08 10:56:00.821664 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.821633 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rtz5w" Sep 08 10:56:00.831043 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.831013 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rtz5w" Sep 08 10:56:00.875880 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:56:00.875847 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5973e251c0e47bb871ab5b1debe18153.slice/crio-a41e21c094795ac0cf02d1a44a33f50ca399330dfba278572ab21f414214500f WatchSource:0}: Error finding container a41e21c094795ac0cf02d1a44a33f50ca399330dfba278572ab21f414214500f: Status 404 returned error can't find the container with id a41e21c094795ac0cf02d1a44a33f50ca399330dfba278572ab21f414214500f Sep 08 10:56:00.881384 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.881362 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 10:56:00.885738 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.885721 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 08 10:56:00.890889 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.890868 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-etc-sysconfig\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.891000 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.890895 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-etc-kubernetes\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.891000 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.890914 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f6a86c3a-a256-4e5a-aaa8-737dee4e9147-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zzppw\" (UID: \"f6a86c3a-a256-4e5a-aaa8-737dee4e9147\") " pod="openshift-multus/multus-additional-cni-plugins-zzppw" Sep 08 10:56:00.891000 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.890971 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-multus-cni-dir\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.891000 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.890995 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xdd5\" (UniqueName: \"kubernetes.io/projected/9b62f9f1-9031-4f6a-acdb-5dfa1658d05f-kube-api-access-9xdd5\") pod \"aws-ebs-csi-driver-node-qwswd\" (UID: \"9b62f9f1-9031-4f6a-acdb-5dfa1658d05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwswd" Sep 08 10:56:00.891180 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.891050 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqw48\" (UniqueName: \"kubernetes.io/projected/dc69f433-ba6d-4fd6-ad22-29d26782f11d-kube-api-access-pqw48\") pod \"network-metrics-daemon-msdpf\" (UID: \"dc69f433-ba6d-4fd6-ad22-29d26782f11d\") " pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:56:00.891233 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.891159 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-log-socket\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.891346 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.891192 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-multus-cni-dir\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.891429 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.891408 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6437c1e3-5290-4262-815a-b5b88425796d-env-overrides\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.891551 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.891532 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-host-var-lib-kubelet\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.891622 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.891582 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-etc-sysctl-conf\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.891673 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.891618 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-sys\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.891673 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.891650 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6437c1e3-5290-4262-815a-b5b88425796d-ovnkube-script-lib\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.891773 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.891687 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-multus-conf-dir\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.891773 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.891716 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb5352bc-dbdc-4c6c-a20a-62c87a1e446f-serviceca\") pod \"node-ca-wx4r8\" (UID: \"eb5352bc-dbdc-4c6c-a20a-62c87a1e446f\") " pod="openshift-image-registry/node-ca-wx4r8" Sep 08 10:56:00.891866 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.891817 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-host-var-lib-kubelet\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.891960 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.891935 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-multus-conf-dir\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.894720 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.892039 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9b62f9f1-9031-4f6a-acdb-5dfa1658d05f-registration-dir\") pod \"aws-ebs-csi-driver-node-qwswd\" (UID: \"9b62f9f1-9031-4f6a-acdb-5dfa1658d05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwswd" Sep 08 10:56:00.894720 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.892089 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9b62f9f1-9031-4f6a-acdb-5dfa1658d05f-device-dir\") pod \"aws-ebs-csi-driver-node-qwswd\" (UID: \"9b62f9f1-9031-4f6a-acdb-5dfa1658d05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwswd" Sep 08 10:56:00.894720 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.892122 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c3655b0c-f997-41c9-9dea-43e50b077382-etc-tuned\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.894720 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.892150 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-host-cni-bin\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.894720 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.892202 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-multus-daemon-config\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.894720 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.892232 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-run\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.894720 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.892262 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-host-kubelet\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.894720 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.892293 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-etc-kubernetes\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.894720 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.892325 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9b62f9f1-9031-4f6a-acdb-5dfa1658d05f-socket-dir\") pod \"aws-ebs-csi-driver-node-qwswd\" (UID: \"9b62f9f1-9031-4f6a-acdb-5dfa1658d05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwswd" Sep 08 10:56:00.894720 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.892333 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb5352bc-dbdc-4c6c-a20a-62c87a1e446f-serviceca\") pod \"node-ca-wx4r8\" (UID: \"eb5352bc-dbdc-4c6c-a20a-62c87a1e446f\") " pod="openshift-image-registry/node-ca-wx4r8" Sep 08 10:56:00.894720 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.892347 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvn89\" (UniqueName: \"kubernetes.io/projected/bd67d177-bc24-48be-acca-e3cd070e193e-kube-api-access-mvn89\") pod \"network-check-target-pdd9x\" (UID: \"bd67d177-bc24-48be-acca-e3cd070e193e\") " pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:56:00.894720 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.892377 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-systemd-units\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.894720 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.892399 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-host-slash\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.894720 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.892448 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-host-run-ovn-kubernetes\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.894720 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.892629 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-etc-kubernetes\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.894720 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.892699 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.895427 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.892753 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6437c1e3-5290-4262-815a-b5b88425796d-ovnkube-config\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.895427 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.892809 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-host-var-lib-cni-multus\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.895427 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.892851 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-etc-modprobe-d\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.895427 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.892879 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3655b0c-f997-41c9-9dea-43e50b077382-tmp\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.895427 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.892916 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6a86c3a-a256-4e5a-aaa8-737dee4e9147-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zzppw\" (UID: \"f6a86c3a-a256-4e5a-aaa8-737dee4e9147\") " pod="openshift-multus/multus-additional-cni-plugins-zzppw" Sep 08 10:56:00.895427 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.892924 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-multus-daemon-config\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.895427 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.892945 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkqjl\" (UniqueName: \"kubernetes.io/projected/6437c1e3-5290-4262-815a-b5b88425796d-kube-api-access-vkqjl\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.895427 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.892976 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-system-cni-dir\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.895427 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.892979 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-host-var-lib-cni-multus\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.895427 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893015 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-hostroot\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.895427 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893043 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-host-run-multus-certs\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.895427 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893071 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb5352bc-dbdc-4c6c-a20a-62c87a1e446f-host\") pod \"node-ca-wx4r8\" (UID: \"eb5352bc-dbdc-4c6c-a20a-62c87a1e446f\") " pod="openshift-image-registry/node-ca-wx4r8" Sep 08 10:56:00.895427 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893102 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-system-cni-dir\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.895427 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893118 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6437c1e3-5290-4262-815a-b5b88425796d-ovn-node-metrics-cert\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.895427 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893145 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgb8n\" (UniqueName: \"kubernetes.io/projected/090c52f2-8dd6-471d-8dd0-96b288d6aec7-kube-api-access-rgb8n\") pod \"iptables-alerter-lbdsq\" (UID: \"090c52f2-8dd6-471d-8dd0-96b288d6aec7\") " pod="openshift-network-operator/iptables-alerter-lbdsq" Sep 08 10:56:00.895427 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893154 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb5352bc-dbdc-4c6c-a20a-62c87a1e446f-host\") pod \"node-ca-wx4r8\" (UID: \"eb5352bc-dbdc-4c6c-a20a-62c87a1e446f\") " pod="openshift-image-registry/node-ca-wx4r8" Sep 08 10:56:00.895427 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893185 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-etc-sysctl-d\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.896137 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893226 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-host-run-multus-certs\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.896137 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893274 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-etc-systemd\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.896137 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893327 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-hostroot\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.896137 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893497 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-cni-binary-copy\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.896137 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893535 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-multus-socket-dir-parent\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.896137 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893565 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-lib-modules\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.896137 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893598 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/090c52f2-8dd6-471d-8dd0-96b288d6aec7-iptables-alerter-script\") pod \"iptables-alerter-lbdsq\" (UID: \"090c52f2-8dd6-471d-8dd0-96b288d6aec7\") " pod="openshift-network-operator/iptables-alerter-lbdsq" Sep 08 10:56:00.896137 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893621 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-etc-openvswitch\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.896137 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893640 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-cnibin\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.896137 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893683 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-host-run-netns\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.896137 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893701 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-host-var-lib-cni-bin\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.896137 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893720 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/984def62-1940-433d-83c1-b241c0f5cfa5-hosts-file\") pod \"node-resolver-wfrtm\" (UID: \"984def62-1940-433d-83c1-b241c0f5cfa5\") " pod="openshift-dns/node-resolver-wfrtm" Sep 08 10:56:00.896137 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893734 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-node-log\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.896137 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893760 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83286d64-d4e8-4548-8a35-e9fb3201c67e-agent-certs\") pod \"konnectivity-agent-cjnqs\" (UID: \"83286d64-d4e8-4548-8a35-e9fb3201c67e\") " pod="kube-system/konnectivity-agent-cjnqs" Sep 08 10:56:00.896137 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893779 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9b62f9f1-9031-4f6a-acdb-5dfa1658d05f-etc-selinux\") pod \"aws-ebs-csi-driver-node-qwswd\" (UID: \"9b62f9f1-9031-4f6a-acdb-5dfa1658d05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwswd" Sep 08 10:56:00.896137 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893799 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9b62f9f1-9031-4f6a-acdb-5dfa1658d05f-sys-fs\") pod \"aws-ebs-csi-driver-node-qwswd\" (UID: \"9b62f9f1-9031-4f6a-acdb-5dfa1658d05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwswd" Sep 08 10:56:00.896137 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893817 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30463b34-4ef7-4a59-8b30-dd4b1199e7a6-original-pull-secret\") pod \"global-pull-secret-syncer-vtxs2\" (UID: \"30463b34-4ef7-4a59-8b30-dd4b1199e7a6\") " pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:00.896707 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893841 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9b62f9f1-9031-4f6a-acdb-5dfa1658d05f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qwswd\" (UID: \"9b62f9f1-9031-4f6a-acdb-5dfa1658d05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwswd" Sep 08 10:56:00.896707 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893858 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-var-lib-kubelet\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.896707 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893877 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f6a86c3a-a256-4e5a-aaa8-737dee4e9147-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zzppw\" (UID: \"f6a86c3a-a256-4e5a-aaa8-737dee4e9147\") " pod="openshift-multus/multus-additional-cni-plugins-zzppw" Sep 08 10:56:00.896707 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893906 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-host-cni-netd\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.896707 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893924 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwmdv\" (UniqueName: \"kubernetes.io/projected/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-kube-api-access-fwmdv\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.896707 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893943 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83286d64-d4e8-4548-8a35-e9fb3201c67e-konnectivity-ca\") pod \"konnectivity-agent-cjnqs\" (UID: \"83286d64-d4e8-4548-8a35-e9fb3201c67e\") " pod="kube-system/konnectivity-agent-cjnqs" Sep 08 10:56:00.896707 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.893989 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-cni-binary-copy\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.896707 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.894075 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-multus-socket-dir-parent\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.896707 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.894439 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/30463b34-4ef7-4a59-8b30-dd4b1199e7a6-kubelet-config\") pod \"global-pull-secret-syncer-vtxs2\" (UID: \"30463b34-4ef7-4a59-8b30-dd4b1199e7a6\") " pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:00.896707 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.894459 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/30463b34-4ef7-4a59-8b30-dd4b1199e7a6-dbus\") pod \"global-pull-secret-syncer-vtxs2\" (UID: \"30463b34-4ef7-4a59-8b30-dd4b1199e7a6\") " pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:00.896707 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.894477 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6a86c3a-a256-4e5a-aaa8-737dee4e9147-cnibin\") pod \"multus-additional-cni-plugins-zzppw\" (UID: \"f6a86c3a-a256-4e5a-aaa8-737dee4e9147\") " pod="openshift-multus/multus-additional-cni-plugins-zzppw" Sep 08 10:56:00.896707 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.894504 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6a86c3a-a256-4e5a-aaa8-737dee4e9147-cni-binary-copy\") pod \"multus-additional-cni-plugins-zzppw\" (UID: \"f6a86c3a-a256-4e5a-aaa8-737dee4e9147\") " pod="openshift-multus/multus-additional-cni-plugins-zzppw" Sep 08 10:56:00.896707 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.894524 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd464\" (UniqueName: \"kubernetes.io/projected/f6a86c3a-a256-4e5a-aaa8-737dee4e9147-kube-api-access-rd464\") pod \"multus-additional-cni-plugins-zzppw\" (UID: \"f6a86c3a-a256-4e5a-aaa8-737dee4e9147\") " pod="openshift-multus/multus-additional-cni-plugins-zzppw" Sep 08 10:56:00.896707 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.894541 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-run-systemd\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.896707 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.894556 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/090c52f2-8dd6-471d-8dd0-96b288d6aec7-iptables-alerter-script\") pod \"iptables-alerter-lbdsq\" (UID: \"090c52f2-8dd6-471d-8dd0-96b288d6aec7\") " pod="openshift-network-operator/iptables-alerter-lbdsq" Sep 08 10:56:00.896707 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.894561 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-host-run-k8s-cni-cncf-io\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.897458 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.894670 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-host-run-netns\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.897458 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.894684 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/984def62-1940-433d-83c1-b241c0f5cfa5-tmp-dir\") pod \"node-resolver-wfrtm\" (UID: \"984def62-1940-433d-83c1-b241c0f5cfa5\") " pod="openshift-dns/node-resolver-wfrtm" Sep 08 10:56:00.897458 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.895039 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-host-run-k8s-cni-cncf-io\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.897458 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.895109 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-cnibin\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.897458 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.895260 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-host-var-lib-cni-bin\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.897458 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.895267 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/984def62-1940-433d-83c1-b241c0f5cfa5-hosts-file\") pod \"node-resolver-wfrtm\" (UID: \"984def62-1940-433d-83c1-b241c0f5cfa5\") " pod="openshift-dns/node-resolver-wfrtm" Sep 08 10:56:00.897458 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.895302 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 08 10:56:00.897458 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.895309 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7js9w\" (UniqueName: \"kubernetes.io/projected/c3655b0c-f997-41c9-9dea-43e50b077382-kube-api-access-7js9w\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.897458 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.895369 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc69f433-ba6d-4fd6-ad22-29d26782f11d-metrics-certs\") pod \"network-metrics-daemon-msdpf\" (UID: \"dc69f433-ba6d-4fd6-ad22-29d26782f11d\") " pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:56:00.897458 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.895420 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-host-run-netns\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.897458 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.895447 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-var-lib-openvswitch\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.897458 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.895482 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-run-openvswitch\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.897458 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.895539 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-run-ovn\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.897458 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.895575 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-host\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.897458 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.895600 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6a86c3a-a256-4e5a-aaa8-737dee4e9147-system-cni-dir\") pod \"multus-additional-cni-plugins-zzppw\" (UID: \"f6a86c3a-a256-4e5a-aaa8-737dee4e9147\") " pod="openshift-multus/multus-additional-cni-plugins-zzppw" Sep 08 10:56:00.897458 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.895622 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/090c52f2-8dd6-471d-8dd0-96b288d6aec7-host-slash\") pod \"iptables-alerter-lbdsq\" (UID: \"090c52f2-8dd6-471d-8dd0-96b288d6aec7\") " pod="openshift-network-operator/iptables-alerter-lbdsq" Sep 08 10:56:00.897458 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.895670 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/090c52f2-8dd6-471d-8dd0-96b288d6aec7-host-slash\") pod \"iptables-alerter-lbdsq\" (UID: \"090c52f2-8dd6-471d-8dd0-96b288d6aec7\") " pod="openshift-network-operator/iptables-alerter-lbdsq" Sep 08 10:56:00.897458 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.895678 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/984def62-1940-433d-83c1-b241c0f5cfa5-tmp-dir\") pod \"node-resolver-wfrtm\" (UID: \"984def62-1940-433d-83c1-b241c0f5cfa5\") " pod="openshift-dns/node-resolver-wfrtm" Sep 08 10:56:00.898281 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.895686 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xndtd\" (UniqueName: \"kubernetes.io/projected/984def62-1940-433d-83c1-b241c0f5cfa5-kube-api-access-xndtd\") pod \"node-resolver-wfrtm\" (UID: \"984def62-1940-433d-83c1-b241c0f5cfa5\") " pod="openshift-dns/node-resolver-wfrtm" Sep 08 10:56:00.898281 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.895894 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcl4w\" (UniqueName: \"kubernetes.io/projected/eb5352bc-dbdc-4c6c-a20a-62c87a1e446f-kube-api-access-xcl4w\") pod \"node-ca-wx4r8\" (UID: \"eb5352bc-dbdc-4c6c-a20a-62c87a1e446f\") " pod="openshift-image-registry/node-ca-wx4r8" Sep 08 10:56:00.898281 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.896067 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83286d64-d4e8-4548-8a35-e9fb3201c67e-konnectivity-ca\") pod \"konnectivity-agent-cjnqs\" (UID: \"83286d64-d4e8-4548-8a35-e9fb3201c67e\") " pod="kube-system/konnectivity-agent-cjnqs" Sep 08 10:56:00.899121 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.899085 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-80.ec2.internal" event={"ID":"5973e251c0e47bb871ab5b1debe18153","Type":"ContainerStarted","Data":"a41e21c094795ac0cf02d1a44a33f50ca399330dfba278572ab21f414214500f"} Sep 08 10:56:00.899866 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.899841 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83286d64-d4e8-4548-8a35-e9fb3201c67e-agent-certs\") pod \"konnectivity-agent-cjnqs\" (UID: \"83286d64-d4e8-4548-8a35-e9fb3201c67e\") " pod="kube-system/konnectivity-agent-cjnqs" Sep 08 10:56:00.901525 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.901490 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgb8n\" (UniqueName: \"kubernetes.io/projected/090c52f2-8dd6-471d-8dd0-96b288d6aec7-kube-api-access-rgb8n\") pod \"iptables-alerter-lbdsq\" (UID: \"090c52f2-8dd6-471d-8dd0-96b288d6aec7\") " pod="openshift-network-operator/iptables-alerter-lbdsq" Sep 08 10:56:00.903006 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.902981 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwmdv\" (UniqueName: \"kubernetes.io/projected/2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9-kube-api-access-fwmdv\") pod \"multus-6sb6d\" (UID: \"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9\") " pod="openshift-multus/multus-6sb6d" Sep 08 10:56:00.903652 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.903618 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xndtd\" (UniqueName: \"kubernetes.io/projected/984def62-1940-433d-83c1-b241c0f5cfa5-kube-api-access-xndtd\") pod \"node-resolver-wfrtm\" (UID: \"984def62-1940-433d-83c1-b241c0f5cfa5\") " pod="openshift-dns/node-resolver-wfrtm" Sep 08 10:56:00.903747 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.903734 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcl4w\" (UniqueName: \"kubernetes.io/projected/eb5352bc-dbdc-4c6c-a20a-62c87a1e446f-kube-api-access-xcl4w\") pod \"node-ca-wx4r8\" (UID: \"eb5352bc-dbdc-4c6c-a20a-62c87a1e446f\") " pod="openshift-image-registry/node-ca-wx4r8" Sep 08 10:56:00.996365 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996157 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-etc-modprobe-d\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.996365 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996336 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-etc-modprobe-d\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.996365 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996367 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3655b0c-f997-41c9-9dea-43e50b077382-tmp\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.996648 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996385 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6a86c3a-a256-4e5a-aaa8-737dee4e9147-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zzppw\" (UID: \"f6a86c3a-a256-4e5a-aaa8-737dee4e9147\") " pod="openshift-multus/multus-additional-cni-plugins-zzppw" Sep 08 10:56:00.996648 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996403 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkqjl\" (UniqueName: \"kubernetes.io/projected/6437c1e3-5290-4262-815a-b5b88425796d-kube-api-access-vkqjl\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.996648 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996421 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6437c1e3-5290-4262-815a-b5b88425796d-ovn-node-metrics-cert\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.996648 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996436 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-etc-sysctl-d\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.996648 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996465 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-etc-systemd\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.996648 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996482 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-lib-modules\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.996648 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996506 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-etc-openvswitch\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.996648 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996531 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-node-log\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.996648 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996559 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9b62f9f1-9031-4f6a-acdb-5dfa1658d05f-etc-selinux\") pod \"aws-ebs-csi-driver-node-qwswd\" (UID: \"9b62f9f1-9031-4f6a-acdb-5dfa1658d05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwswd" Sep 08 10:56:00.996648 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996565 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-etc-systemd\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.996648 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996581 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9b62f9f1-9031-4f6a-acdb-5dfa1658d05f-sys-fs\") pod \"aws-ebs-csi-driver-node-qwswd\" (UID: \"9b62f9f1-9031-4f6a-acdb-5dfa1658d05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwswd" Sep 08 10:56:00.996648 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996579 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-etc-openvswitch\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.996648 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996627 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30463b34-4ef7-4a59-8b30-dd4b1199e7a6-original-pull-secret\") pod \"global-pull-secret-syncer-vtxs2\" (UID: \"30463b34-4ef7-4a59-8b30-dd4b1199e7a6\") " pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:00.996648 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996634 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-lib-modules\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.996648 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996655 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9b62f9f1-9031-4f6a-acdb-5dfa1658d05f-sys-fs\") pod \"aws-ebs-csi-driver-node-qwswd\" (UID: \"9b62f9f1-9031-4f6a-acdb-5dfa1658d05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwswd" Sep 08 10:56:00.997328 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996673 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9b62f9f1-9031-4f6a-acdb-5dfa1658d05f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qwswd\" (UID: \"9b62f9f1-9031-4f6a-acdb-5dfa1658d05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwswd" Sep 08 10:56:00.997328 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996683 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-etc-sysctl-d\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.997328 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996693 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-node-log\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.997328 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996700 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-var-lib-kubelet\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.997328 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:00.996725 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 10:56:00.997328 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996731 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9b62f9f1-9031-4f6a-acdb-5dfa1658d05f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qwswd\" (UID: \"9b62f9f1-9031-4f6a-acdb-5dfa1658d05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwswd" Sep 08 10:56:00.997328 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996766 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9b62f9f1-9031-4f6a-acdb-5dfa1658d05f-etc-selinux\") pod \"aws-ebs-csi-driver-node-qwswd\" (UID: \"9b62f9f1-9031-4f6a-acdb-5dfa1658d05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwswd" Sep 08 10:56:00.997328 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996725 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f6a86c3a-a256-4e5a-aaa8-737dee4e9147-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zzppw\" (UID: \"f6a86c3a-a256-4e5a-aaa8-737dee4e9147\") " pod="openshift-multus/multus-additional-cni-plugins-zzppw" Sep 08 10:56:00.997328 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996803 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-var-lib-kubelet\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.997328 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:00.996830 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30463b34-4ef7-4a59-8b30-dd4b1199e7a6-original-pull-secret podName:30463b34-4ef7-4a59-8b30-dd4b1199e7a6 nodeName:}" failed. No retries permitted until 2026-09-08 10:56:01.496781362 +0000 UTC m=+2.129376837 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30463b34-4ef7-4a59-8b30-dd4b1199e7a6-original-pull-secret") pod "global-pull-secret-syncer-vtxs2" (UID: "30463b34-4ef7-4a59-8b30-dd4b1199e7a6") : object "kube-system"/"original-pull-secret" not registered Sep 08 10:56:00.997328 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996861 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-host-cni-netd\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.997328 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996891 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/30463b34-4ef7-4a59-8b30-dd4b1199e7a6-kubelet-config\") pod \"global-pull-secret-syncer-vtxs2\" (UID: \"30463b34-4ef7-4a59-8b30-dd4b1199e7a6\") " pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:00.997328 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996917 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/30463b34-4ef7-4a59-8b30-dd4b1199e7a6-dbus\") pod \"global-pull-secret-syncer-vtxs2\" (UID: \"30463b34-4ef7-4a59-8b30-dd4b1199e7a6\") " pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:00.997328 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996942 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6a86c3a-a256-4e5a-aaa8-737dee4e9147-cnibin\") pod \"multus-additional-cni-plugins-zzppw\" (UID: \"f6a86c3a-a256-4e5a-aaa8-737dee4e9147\") " pod="openshift-multus/multus-additional-cni-plugins-zzppw" Sep 08 10:56:00.997328 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996965 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6a86c3a-a256-4e5a-aaa8-737dee4e9147-cni-binary-copy\") pod \"multus-additional-cni-plugins-zzppw\" (UID: \"f6a86c3a-a256-4e5a-aaa8-737dee4e9147\") " pod="openshift-multus/multus-additional-cni-plugins-zzppw" Sep 08 10:56:00.997328 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996978 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-host-cni-netd\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.997328 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996991 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd464\" (UniqueName: \"kubernetes.io/projected/f6a86c3a-a256-4e5a-aaa8-737dee4e9147-kube-api-access-rd464\") pod \"multus-additional-cni-plugins-zzppw\" (UID: \"f6a86c3a-a256-4e5a-aaa8-737dee4e9147\") " pod="openshift-multus/multus-additional-cni-plugins-zzppw" Sep 08 10:56:00.998267 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997014 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-run-systemd\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.998267 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.996978 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/30463b34-4ef7-4a59-8b30-dd4b1199e7a6-kubelet-config\") pod \"global-pull-secret-syncer-vtxs2\" (UID: \"30463b34-4ef7-4a59-8b30-dd4b1199e7a6\") " pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:00.998267 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997040 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7js9w\" (UniqueName: \"kubernetes.io/projected/c3655b0c-f997-41c9-9dea-43e50b077382-kube-api-access-7js9w\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.998267 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997062 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc69f433-ba6d-4fd6-ad22-29d26782f11d-metrics-certs\") pod \"network-metrics-daemon-msdpf\" (UID: \"dc69f433-ba6d-4fd6-ad22-29d26782f11d\") " pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:56:00.998267 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997087 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-host-run-netns\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.998267 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997108 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/30463b34-4ef7-4a59-8b30-dd4b1199e7a6-dbus\") pod \"global-pull-secret-syncer-vtxs2\" (UID: \"30463b34-4ef7-4a59-8b30-dd4b1199e7a6\") " pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:00.998267 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997211 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6a86c3a-a256-4e5a-aaa8-737dee4e9147-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zzppw\" (UID: \"f6a86c3a-a256-4e5a-aaa8-737dee4e9147\") " pod="openshift-multus/multus-additional-cni-plugins-zzppw" Sep 08 10:56:00.998267 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997230 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6a86c3a-a256-4e5a-aaa8-737dee4e9147-cnibin\") pod \"multus-additional-cni-plugins-zzppw\" (UID: \"f6a86c3a-a256-4e5a-aaa8-737dee4e9147\") " pod="openshift-multus/multus-additional-cni-plugins-zzppw" Sep 08 10:56:00.998267 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997258 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f6a86c3a-a256-4e5a-aaa8-737dee4e9147-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zzppw\" (UID: \"f6a86c3a-a256-4e5a-aaa8-737dee4e9147\") " pod="openshift-multus/multus-additional-cni-plugins-zzppw" Sep 08 10:56:00.998267 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997304 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-var-lib-openvswitch\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.998267 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997325 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-run-openvswitch\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.998267 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997353 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-run-ovn\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.998267 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997378 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-var-lib-openvswitch\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.998267 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997398 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-host-run-netns\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.998267 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997407 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-host\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.998267 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997432 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-run-openvswitch\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.998267 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997444 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-run-systemd\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.998991 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997452 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-host\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.998991 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997448 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6a86c3a-a256-4e5a-aaa8-737dee4e9147-system-cni-dir\") pod \"multus-additional-cni-plugins-zzppw\" (UID: \"f6a86c3a-a256-4e5a-aaa8-737dee4e9147\") " pod="openshift-multus/multus-additional-cni-plugins-zzppw" Sep 08 10:56:00.998991 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997483 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6a86c3a-a256-4e5a-aaa8-737dee4e9147-system-cni-dir\") pod \"multus-additional-cni-plugins-zzppw\" (UID: \"f6a86c3a-a256-4e5a-aaa8-737dee4e9147\") " pod="openshift-multus/multus-additional-cni-plugins-zzppw" Sep 08 10:56:00.998991 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997488 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-run-ovn\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.998991 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997498 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-etc-sysconfig\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.998991 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997524 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-etc-kubernetes\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.998991 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997550 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f6a86c3a-a256-4e5a-aaa8-737dee4e9147-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zzppw\" (UID: \"f6a86c3a-a256-4e5a-aaa8-737dee4e9147\") " pod="openshift-multus/multus-additional-cni-plugins-zzppw" Sep 08 10:56:00.998991 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:00.997566 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:56:00.998991 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997578 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xdd5\" (UniqueName: \"kubernetes.io/projected/9b62f9f1-9031-4f6a-acdb-5dfa1658d05f-kube-api-access-9xdd5\") pod \"aws-ebs-csi-driver-node-qwswd\" (UID: \"9b62f9f1-9031-4f6a-acdb-5dfa1658d05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwswd" Sep 08 10:56:00.998991 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997583 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-etc-sysconfig\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.998991 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997605 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqw48\" (UniqueName: \"kubernetes.io/projected/dc69f433-ba6d-4fd6-ad22-29d26782f11d-kube-api-access-pqw48\") pod \"network-metrics-daemon-msdpf\" (UID: \"dc69f433-ba6d-4fd6-ad22-29d26782f11d\") " pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:56:00.998991 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:00.997621 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc69f433-ba6d-4fd6-ad22-29d26782f11d-metrics-certs podName:dc69f433-ba6d-4fd6-ad22-29d26782f11d nodeName:}" failed. No retries permitted until 2026-09-08 10:56:01.497606299 +0000 UTC m=+2.130201755 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc69f433-ba6d-4fd6-ad22-29d26782f11d-metrics-certs") pod "network-metrics-daemon-msdpf" (UID: "dc69f433-ba6d-4fd6-ad22-29d26782f11d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:56:00.998991 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997654 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-log-socket\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.998991 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997677 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6437c1e3-5290-4262-815a-b5b88425796d-env-overrides\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.998991 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997696 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-etc-kubernetes\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.998991 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997732 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-log-socket\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.998991 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997702 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-etc-sysctl-conf\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.999529 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997823 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-sys\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.999529 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997849 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6437c1e3-5290-4262-815a-b5b88425796d-ovnkube-script-lib\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.999529 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997872 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-sys\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.999529 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997875 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9b62f9f1-9031-4f6a-acdb-5dfa1658d05f-registration-dir\") pod \"aws-ebs-csi-driver-node-qwswd\" (UID: \"9b62f9f1-9031-4f6a-acdb-5dfa1658d05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwswd" Sep 08 10:56:00.999529 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997914 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9b62f9f1-9031-4f6a-acdb-5dfa1658d05f-device-dir\") pod \"aws-ebs-csi-driver-node-qwswd\" (UID: \"9b62f9f1-9031-4f6a-acdb-5dfa1658d05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwswd" Sep 08 10:56:00.999529 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997924 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9b62f9f1-9031-4f6a-acdb-5dfa1658d05f-registration-dir\") pod \"aws-ebs-csi-driver-node-qwswd\" (UID: \"9b62f9f1-9031-4f6a-acdb-5dfa1658d05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwswd" Sep 08 10:56:00.999529 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997825 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-etc-sysctl-conf\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.999529 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997941 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c3655b0c-f997-41c9-9dea-43e50b077382-etc-tuned\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.999529 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997965 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-host-cni-bin\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.999529 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.997991 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-run\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.999529 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.998013 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-host-kubelet\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.999529 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.998026 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6a86c3a-a256-4e5a-aaa8-737dee4e9147-cni-binary-copy\") pod \"multus-additional-cni-plugins-zzppw\" (UID: \"f6a86c3a-a256-4e5a-aaa8-737dee4e9147\") " pod="openshift-multus/multus-additional-cni-plugins-zzppw" Sep 08 10:56:00.999529 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.998042 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9b62f9f1-9031-4f6a-acdb-5dfa1658d05f-socket-dir\") pod \"aws-ebs-csi-driver-node-qwswd\" (UID: \"9b62f9f1-9031-4f6a-acdb-5dfa1658d05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwswd" Sep 08 10:56:00.999529 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.998081 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvn89\" (UniqueName: \"kubernetes.io/projected/bd67d177-bc24-48be-acca-e3cd070e193e-kube-api-access-mvn89\") pod \"network-check-target-pdd9x\" (UID: \"bd67d177-bc24-48be-acca-e3cd070e193e\") " pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:56:00.999529 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.998109 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-systemd-units\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.999529 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.998134 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-host-slash\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.999529 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.998151 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9b62f9f1-9031-4f6a-acdb-5dfa1658d05f-socket-dir\") pod \"aws-ebs-csi-driver-node-qwswd\" (UID: \"9b62f9f1-9031-4f6a-acdb-5dfa1658d05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwswd" Sep 08 10:56:00.999985 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.998158 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-host-run-ovn-kubernetes\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.999985 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.998195 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6437c1e3-5290-4262-815a-b5b88425796d-env-overrides\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.999985 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.998209 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.999985 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.998211 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f6a86c3a-a256-4e5a-aaa8-737dee4e9147-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zzppw\" (UID: \"f6a86c3a-a256-4e5a-aaa8-737dee4e9147\") " pod="openshift-multus/multus-additional-cni-plugins-zzppw" Sep 08 10:56:00.999985 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.998226 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9b62f9f1-9031-4f6a-acdb-5dfa1658d05f-device-dir\") pod \"aws-ebs-csi-driver-node-qwswd\" (UID: \"9b62f9f1-9031-4f6a-acdb-5dfa1658d05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwswd" Sep 08 10:56:00.999985 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.998235 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6437c1e3-5290-4262-815a-b5b88425796d-ovnkube-config\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.999985 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.998246 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-host-cni-bin\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.999985 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.998273 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c3655b0c-f997-41c9-9dea-43e50b077382-run\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.999985 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.998326 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-host-slash\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.999985 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.998325 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.999985 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.998357 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-host-run-ovn-kubernetes\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.999985 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.998432 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-systemd-units\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.999985 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.998454 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6437c1e3-5290-4262-815a-b5b88425796d-ovnkube-script-lib\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.999985 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.998486 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6437c1e3-5290-4262-815a-b5b88425796d-host-kubelet\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.999985 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.998804 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6437c1e3-5290-4262-815a-b5b88425796d-ovnkube-config\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:00.999985 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.999093 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3655b0c-f997-41c9-9dea-43e50b077382-tmp\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:00.999985 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:00.999121 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6437c1e3-5290-4262-815a-b5b88425796d-ovn-node-metrics-cert\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:01.000476 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.000191 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c3655b0c-f997-41c9-9dea-43e50b077382-etc-tuned\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:01.005966 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:01.005944 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 10:56:01.005966 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:01.005969 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 10:56:01.006148 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:01.005983 2560 projected.go:196] Error preparing data for projected volume kube-api-access-mvn89 for pod openshift-network-diagnostics/network-check-target-pdd9x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:56:01.006148 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:01.006055 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd67d177-bc24-48be-acca-e3cd070e193e-kube-api-access-mvn89 podName:bd67d177-bc24-48be-acca-e3cd070e193e nodeName:}" failed. No retries permitted until 2026-09-08 10:56:01.506032937 +0000 UTC m=+2.138628423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mvn89" (UniqueName: "kubernetes.io/projected/bd67d177-bc24-48be-acca-e3cd070e193e-kube-api-access-mvn89") pod "network-check-target-pdd9x" (UID: "bd67d177-bc24-48be-acca-e3cd070e193e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:56:01.007249 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.007158 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkqjl\" (UniqueName: \"kubernetes.io/projected/6437c1e3-5290-4262-815a-b5b88425796d-kube-api-access-vkqjl\") pod \"ovnkube-node-2fn2c\" (UID: \"6437c1e3-5290-4262-815a-b5b88425796d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:01.007997 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.007976 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xdd5\" (UniqueName: \"kubernetes.io/projected/9b62f9f1-9031-4f6a-acdb-5dfa1658d05f-kube-api-access-9xdd5\") pod \"aws-ebs-csi-driver-node-qwswd\" (UID: \"9b62f9f1-9031-4f6a-acdb-5dfa1658d05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwswd" Sep 08 10:56:01.008133 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.008113 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd464\" (UniqueName: \"kubernetes.io/projected/f6a86c3a-a256-4e5a-aaa8-737dee4e9147-kube-api-access-rd464\") pod \"multus-additional-cni-plugins-zzppw\" (UID: \"f6a86c3a-a256-4e5a-aaa8-737dee4e9147\") " pod="openshift-multus/multus-additional-cni-plugins-zzppw" Sep 08 10:56:01.008367 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.008345 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7js9w\" (UniqueName: \"kubernetes.io/projected/c3655b0c-f997-41c9-9dea-43e50b077382-kube-api-access-7js9w\") pod \"tuned-pj5pz\" (UID: \"c3655b0c-f997-41c9-9dea-43e50b077382\") " pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:01.008435 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.008420 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqw48\" (UniqueName: \"kubernetes.io/projected/dc69f433-ba6d-4fd6-ad22-29d26782f11d-kube-api-access-pqw48\") pod \"network-metrics-daemon-msdpf\" (UID: \"dc69f433-ba6d-4fd6-ad22-29d26782f11d\") " pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:56:01.107725 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.107703 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wfrtm" Sep 08 10:56:01.112313 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.112292 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wx4r8" Sep 08 10:56:01.119564 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:56:01.119516 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod984def62_1940_433d_83c1_b241c0f5cfa5.slice/crio-5f72692422012bb98180bb795a7992f677898ac5f6d3261f00a8283eed5e8cf7 WatchSource:0}: Error finding container 5f72692422012bb98180bb795a7992f677898ac5f6d3261f00a8283eed5e8cf7: Status 404 returned error can't find the container with id 5f72692422012bb98180bb795a7992f677898ac5f6d3261f00a8283eed5e8cf7 Sep 08 10:56:01.121542 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:56:01.121516 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb5352bc_dbdc_4c6c_a20a_62c87a1e446f.slice/crio-dbf23c1b3d610ca5fbda6146121298bd9c8d3929d8516c44d6300cc048e18107 WatchSource:0}: Error finding container dbf23c1b3d610ca5fbda6146121298bd9c8d3929d8516c44d6300cc048e18107: Status 404 returned error can't find the container with id dbf23c1b3d610ca5fbda6146121298bd9c8d3929d8516c44d6300cc048e18107 Sep 08 10:56:01.137202 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.137159 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6sb6d" Sep 08 10:56:01.147398 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:56:01.147369 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d558595_1fcc_4bb3_b6a1_9cca8f1f3ab9.slice/crio-463b647e53c23e85e107b9fe973e77fb8e7dc7f6e093fc8dd03528f4b6e1d89c WatchSource:0}: Error finding container 463b647e53c23e85e107b9fe973e77fb8e7dc7f6e093fc8dd03528f4b6e1d89c: Status 404 returned error can't find the container with id 463b647e53c23e85e107b9fe973e77fb8e7dc7f6e093fc8dd03528f4b6e1d89c Sep 08 10:56:01.150793 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.150774 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lbdsq" Sep 08 10:56:01.159899 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:56:01.159877 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod090c52f2_8dd6_471d_8dd0_96b288d6aec7.slice/crio-9df8098a6dccfc268b0e9b3b4ef785a1b538a2969eb1024409fde23658afbc1f WatchSource:0}: Error finding container 9df8098a6dccfc268b0e9b3b4ef785a1b538a2969eb1024409fde23658afbc1f: Status 404 returned error can't find the container with id 9df8098a6dccfc268b0e9b3b4ef785a1b538a2969eb1024409fde23658afbc1f Sep 08 10:56:01.178453 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.178429 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cjnqs" Sep 08 10:56:01.184395 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.184374 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zzppw" Sep 08 10:56:01.184990 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.184970 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 10:56:01.187769 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:56:01.187741 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83286d64_d4e8_4548_8a35_e9fb3201c67e.slice/crio-806f0b6cc5271a7e6116489a2be7cadc59e2b6b0883d01d05e81b20ea6a18a1c WatchSource:0}: Error finding container 806f0b6cc5271a7e6116489a2be7cadc59e2b6b0883d01d05e81b20ea6a18a1c: Status 404 returned error can't find the container with id 806f0b6cc5271a7e6116489a2be7cadc59e2b6b0883d01d05e81b20ea6a18a1c Sep 08 10:56:01.190316 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.190297 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:01.194046 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:56:01.194021 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6a86c3a_a256_4e5a_aaa8_737dee4e9147.slice/crio-ec3dd8920fbc88a5fb27ca0eb19daa94c88340c71434ecdf44825a64544856dc WatchSource:0}: Error finding container ec3dd8920fbc88a5fb27ca0eb19daa94c88340c71434ecdf44825a64544856dc: Status 404 returned error can't find the container with id ec3dd8920fbc88a5fb27ca0eb19daa94c88340c71434ecdf44825a64544856dc Sep 08 10:56:01.199293 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:56:01.199272 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6437c1e3_5290_4262_815a_b5b88425796d.slice/crio-774ba1798e24125fc1a3da7b61f8d71b1dd4d1f8f27bd58873e331f56214d2c4 WatchSource:0}: Error finding container 774ba1798e24125fc1a3da7b61f8d71b1dd4d1f8f27bd58873e331f56214d2c4: Status 404 returned error can't find the container with id 774ba1798e24125fc1a3da7b61f8d71b1dd4d1f8f27bd58873e331f56214d2c4 Sep 08 10:56:01.199942 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.199924 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwswd" Sep 08 10:56:01.210973 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.210890 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" Sep 08 10:56:01.212983 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:56:01.212956 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b62f9f1_9031_4f6a_acdb_5dfa1658d05f.slice/crio-ecb9d460969a257a3e2c62374d511094b0b131b7c5de8b97cae9ef4397053a13 WatchSource:0}: Error finding container ecb9d460969a257a3e2c62374d511094b0b131b7c5de8b97cae9ef4397053a13: Status 404 returned error can't find the container with id ecb9d460969a257a3e2c62374d511094b0b131b7c5de8b97cae9ef4397053a13 Sep 08 10:56:01.220971 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:56:01.220944 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3655b0c_f997_41c9_9dea_43e50b077382.slice/crio-7a1c51b1baecdafcb629be124c282b51b0f27232beee890f86c5e718dfd76b80 WatchSource:0}: Error finding container 7a1c51b1baecdafcb629be124c282b51b0f27232beee890f86c5e718dfd76b80: Status 404 returned error can't find the container with id 7a1c51b1baecdafcb629be124c282b51b0f27232beee890f86c5e718dfd76b80 Sep 08 10:56:01.501598 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.501502 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30463b34-4ef7-4a59-8b30-dd4b1199e7a6-original-pull-secret\") pod \"global-pull-secret-syncer-vtxs2\" (UID: \"30463b34-4ef7-4a59-8b30-dd4b1199e7a6\") " pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:01.501598 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.501546 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc69f433-ba6d-4fd6-ad22-29d26782f11d-metrics-certs\") pod \"network-metrics-daemon-msdpf\" (UID: \"dc69f433-ba6d-4fd6-ad22-29d26782f11d\") " pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:56:01.501816 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:01.501666 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:56:01.501816 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:01.501673 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 10:56:01.501816 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:01.501722 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc69f433-ba6d-4fd6-ad22-29d26782f11d-metrics-certs podName:dc69f433-ba6d-4fd6-ad22-29d26782f11d nodeName:}" failed. No retries permitted until 2026-09-08 10:56:02.501706794 +0000 UTC m=+3.134302251 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc69f433-ba6d-4fd6-ad22-29d26782f11d-metrics-certs") pod "network-metrics-daemon-msdpf" (UID: "dc69f433-ba6d-4fd6-ad22-29d26782f11d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:56:01.501816 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:01.501736 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30463b34-4ef7-4a59-8b30-dd4b1199e7a6-original-pull-secret podName:30463b34-4ef7-4a59-8b30-dd4b1199e7a6 nodeName:}" failed. No retries permitted until 2026-09-08 10:56:02.501729747 +0000 UTC m=+3.134325204 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30463b34-4ef7-4a59-8b30-dd4b1199e7a6-original-pull-secret") pod "global-pull-secret-syncer-vtxs2" (UID: "30463b34-4ef7-4a59-8b30-dd4b1199e7a6") : object "kube-system"/"original-pull-secret" not registered Sep 08 10:56:01.602898 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.602178 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvn89\" (UniqueName: \"kubernetes.io/projected/bd67d177-bc24-48be-acca-e3cd070e193e-kube-api-access-mvn89\") pod \"network-check-target-pdd9x\" (UID: \"bd67d177-bc24-48be-acca-e3cd070e193e\") " pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:56:01.602898 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:01.602423 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 10:56:01.602898 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:01.602445 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 10:56:01.602898 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:01.602458 2560 projected.go:196] Error preparing data for projected volume kube-api-access-mvn89 for pod openshift-network-diagnostics/network-check-target-pdd9x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:56:01.602898 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:01.602529 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd67d177-bc24-48be-acca-e3cd070e193e-kube-api-access-mvn89 podName:bd67d177-bc24-48be-acca-e3cd070e193e nodeName:}" failed. No retries permitted until 2026-09-08 10:56:02.602509056 +0000 UTC m=+3.235104538 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mvn89" (UniqueName: "kubernetes.io/projected/bd67d177-bc24-48be-acca-e3cd070e193e-kube-api-access-mvn89") pod "network-check-target-pdd9x" (UID: "bd67d177-bc24-48be-acca-e3cd070e193e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:56:01.756102 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.755829 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 10:56:01.834571 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.834497 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 10:51:01 +0000 UTC" deadline="2028-06-18 19:12:29.376524806 +0000 UTC" Sep 08 10:56:01.834571 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.834564 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15584h16m27.541965902s" Sep 08 10:56:01.901382 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.901353 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:56:01.901586 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:01.901460 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdd9x" podUID="bd67d177-bc24-48be-acca-e3cd070e193e" Sep 08 10:56:01.907880 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.907842 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" event={"ID":"c3655b0c-f997-41c9-9dea-43e50b077382","Type":"ContainerStarted","Data":"7a1c51b1baecdafcb629be124c282b51b0f27232beee890f86c5e718dfd76b80"} Sep 08 10:56:01.909630 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.909600 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwswd" event={"ID":"9b62f9f1-9031-4f6a-acdb-5dfa1658d05f","Type":"ContainerStarted","Data":"ecb9d460969a257a3e2c62374d511094b0b131b7c5de8b97cae9ef4397053a13"} Sep 08 10:56:01.914597 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.914569 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" event={"ID":"6437c1e3-5290-4262-815a-b5b88425796d","Type":"ContainerStarted","Data":"774ba1798e24125fc1a3da7b61f8d71b1dd4d1f8f27bd58873e331f56214d2c4"} Sep 08 10:56:01.919464 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.919433 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cjnqs" event={"ID":"83286d64-d4e8-4548-8a35-e9fb3201c67e","Type":"ContainerStarted","Data":"806f0b6cc5271a7e6116489a2be7cadc59e2b6b0883d01d05e81b20ea6a18a1c"} Sep 08 10:56:01.921970 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.921943 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lbdsq" event={"ID":"090c52f2-8dd6-471d-8dd0-96b288d6aec7","Type":"ContainerStarted","Data":"9df8098a6dccfc268b0e9b3b4ef785a1b538a2969eb1024409fde23658afbc1f"} Sep 08 10:56:01.922418 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.922185 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 10:56:01.927295 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.927270 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6sb6d" event={"ID":"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9","Type":"ContainerStarted","Data":"463b647e53c23e85e107b9fe973e77fb8e7dc7f6e093fc8dd03528f4b6e1d89c"} Sep 08 10:56:01.930110 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.930070 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wx4r8" event={"ID":"eb5352bc-dbdc-4c6c-a20a-62c87a1e446f","Type":"ContainerStarted","Data":"dbf23c1b3d610ca5fbda6146121298bd9c8d3929d8516c44d6300cc048e18107"} Sep 08 10:56:01.933615 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.933587 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zzppw" event={"ID":"f6a86c3a-a256-4e5a-aaa8-737dee4e9147","Type":"ContainerStarted","Data":"ec3dd8920fbc88a5fb27ca0eb19daa94c88340c71434ecdf44825a64544856dc"} Sep 08 10:56:01.937005 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:01.936975 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wfrtm" event={"ID":"984def62-1940-433d-83c1-b241c0f5cfa5","Type":"ContainerStarted","Data":"5f72692422012bb98180bb795a7992f677898ac5f6d3261f00a8283eed5e8cf7"} Sep 08 10:56:02.510708 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:02.510666 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30463b34-4ef7-4a59-8b30-dd4b1199e7a6-original-pull-secret\") pod \"global-pull-secret-syncer-vtxs2\" (UID: \"30463b34-4ef7-4a59-8b30-dd4b1199e7a6\") " pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:02.510912 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:02.510733 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc69f433-ba6d-4fd6-ad22-29d26782f11d-metrics-certs\") pod \"network-metrics-daemon-msdpf\" (UID: \"dc69f433-ba6d-4fd6-ad22-29d26782f11d\") " pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:56:02.511000 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:02.510962 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:56:02.511057 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:02.511032 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc69f433-ba6d-4fd6-ad22-29d26782f11d-metrics-certs podName:dc69f433-ba6d-4fd6-ad22-29d26782f11d nodeName:}" failed. No retries permitted until 2026-09-08 10:56:04.511011491 +0000 UTC m=+5.143606965 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc69f433-ba6d-4fd6-ad22-29d26782f11d-metrics-certs") pod "network-metrics-daemon-msdpf" (UID: "dc69f433-ba6d-4fd6-ad22-29d26782f11d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:56:02.511376 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:02.511350 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 10:56:02.511480 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:02.511423 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30463b34-4ef7-4a59-8b30-dd4b1199e7a6-original-pull-secret podName:30463b34-4ef7-4a59-8b30-dd4b1199e7a6 nodeName:}" failed. No retries permitted until 2026-09-08 10:56:04.511403956 +0000 UTC m=+5.143999426 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30463b34-4ef7-4a59-8b30-dd4b1199e7a6-original-pull-secret") pod "global-pull-secret-syncer-vtxs2" (UID: "30463b34-4ef7-4a59-8b30-dd4b1199e7a6") : object "kube-system"/"original-pull-secret" not registered Sep 08 10:56:02.611249 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:02.611207 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvn89\" (UniqueName: \"kubernetes.io/projected/bd67d177-bc24-48be-acca-e3cd070e193e-kube-api-access-mvn89\") pod \"network-check-target-pdd9x\" (UID: \"bd67d177-bc24-48be-acca-e3cd070e193e\") " pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:56:02.611498 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:02.611471 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 10:56:02.611498 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:02.611498 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 10:56:02.611749 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:02.611511 2560 projected.go:196] Error preparing data for projected volume kube-api-access-mvn89 for pod openshift-network-diagnostics/network-check-target-pdd9x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:56:02.611749 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:02.611578 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd67d177-bc24-48be-acca-e3cd070e193e-kube-api-access-mvn89 podName:bd67d177-bc24-48be-acca-e3cd070e193e nodeName:}" failed. No retries permitted until 2026-09-08 10:56:04.611558838 +0000 UTC m=+5.244154311 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mvn89" (UniqueName: "kubernetes.io/projected/bd67d177-bc24-48be-acca-e3cd070e193e-kube-api-access-mvn89") pod "network-check-target-pdd9x" (UID: "bd67d177-bc24-48be-acca-e3cd070e193e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:56:02.834966 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:02.834752 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 10:51:01 +0000 UTC" deadline="2028-03-02 04:54:28.029317717 +0000 UTC" Sep 08 10:56:02.834966 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:02.834790 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12977h58m25.194532409s" Sep 08 10:56:02.895348 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:02.895310 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:56:02.895556 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:02.895474 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msdpf" podUID="dc69f433-ba6d-4fd6-ad22-29d26782f11d" Sep 08 10:56:02.895959 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:02.895919 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:02.896045 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:02.896029 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtxs2" podUID="30463b34-4ef7-4a59-8b30-dd4b1199e7a6" Sep 08 10:56:03.895765 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:03.895733 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:56:03.896476 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:03.895906 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdd9x" podUID="bd67d177-bc24-48be-acca-e3cd070e193e" Sep 08 10:56:04.528655 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:04.528620 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30463b34-4ef7-4a59-8b30-dd4b1199e7a6-original-pull-secret\") pod \"global-pull-secret-syncer-vtxs2\" (UID: \"30463b34-4ef7-4a59-8b30-dd4b1199e7a6\") " pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:04.528859 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:04.528671 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc69f433-ba6d-4fd6-ad22-29d26782f11d-metrics-certs\") pod \"network-metrics-daemon-msdpf\" (UID: \"dc69f433-ba6d-4fd6-ad22-29d26782f11d\") " pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:56:04.528859 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:04.528802 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:56:04.528859 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:04.528825 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 10:56:04.529041 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:04.528863 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc69f433-ba6d-4fd6-ad22-29d26782f11d-metrics-certs podName:dc69f433-ba6d-4fd6-ad22-29d26782f11d nodeName:}" failed. No retries permitted until 2026-09-08 10:56:08.52884917 +0000 UTC m=+9.161444628 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc69f433-ba6d-4fd6-ad22-29d26782f11d-metrics-certs") pod "network-metrics-daemon-msdpf" (UID: "dc69f433-ba6d-4fd6-ad22-29d26782f11d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:56:04.529041 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:04.528905 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30463b34-4ef7-4a59-8b30-dd4b1199e7a6-original-pull-secret podName:30463b34-4ef7-4a59-8b30-dd4b1199e7a6 nodeName:}" failed. No retries permitted until 2026-09-08 10:56:08.528883931 +0000 UTC m=+9.161479392 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30463b34-4ef7-4a59-8b30-dd4b1199e7a6-original-pull-secret") pod "global-pull-secret-syncer-vtxs2" (UID: "30463b34-4ef7-4a59-8b30-dd4b1199e7a6") : object "kube-system"/"original-pull-secret" not registered Sep 08 10:56:04.629794 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:04.629757 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvn89\" (UniqueName: \"kubernetes.io/projected/bd67d177-bc24-48be-acca-e3cd070e193e-kube-api-access-mvn89\") pod \"network-check-target-pdd9x\" (UID: \"bd67d177-bc24-48be-acca-e3cd070e193e\") " pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:56:04.629985 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:04.629938 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 10:56:04.629985 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:04.629956 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 10:56:04.629985 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:04.629966 2560 projected.go:196] Error preparing data for projected volume kube-api-access-mvn89 for pod openshift-network-diagnostics/network-check-target-pdd9x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:56:04.630107 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:04.630024 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd67d177-bc24-48be-acca-e3cd070e193e-kube-api-access-mvn89 podName:bd67d177-bc24-48be-acca-e3cd070e193e nodeName:}" failed. No retries permitted until 2026-09-08 10:56:08.630007179 +0000 UTC m=+9.262602648 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mvn89" (UniqueName: "kubernetes.io/projected/bd67d177-bc24-48be-acca-e3cd070e193e-kube-api-access-mvn89") pod "network-check-target-pdd9x" (UID: "bd67d177-bc24-48be-acca-e3cd070e193e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:56:04.894918 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:04.894829 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:56:04.895073 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:04.894842 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:04.895073 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:04.894984 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msdpf" podUID="dc69f433-ba6d-4fd6-ad22-29d26782f11d" Sep 08 10:56:04.895073 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:04.895024 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtxs2" podUID="30463b34-4ef7-4a59-8b30-dd4b1199e7a6" Sep 08 10:56:05.895922 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:05.895886 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:56:05.896429 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:05.896029 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdd9x" podUID="bd67d177-bc24-48be-acca-e3cd070e193e" Sep 08 10:56:06.081629 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:56:06.081585 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod952015d437c3d0f0cd335c2b2dde7781.slice/crio-1eba2290e0fdb5a121894e8b4f3155690a0a265ac2501bfbacf9502691c50be4 WatchSource:0}: Error finding container 1eba2290e0fdb5a121894e8b4f3155690a0a265ac2501bfbacf9502691c50be4: Status 404 returned error can't find the container with id 1eba2290e0fdb5a121894e8b4f3155690a0a265ac2501bfbacf9502691c50be4 Sep 08 10:56:06.896723 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:06.895713 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:56:06.896723 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:06.896112 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msdpf" podUID="dc69f433-ba6d-4fd6-ad22-29d26782f11d" Sep 08 10:56:06.896723 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:06.895724 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:06.896723 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:06.896586 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtxs2" podUID="30463b34-4ef7-4a59-8b30-dd4b1199e7a6" Sep 08 10:56:06.950921 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:06.950869 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wx4r8" event={"ID":"eb5352bc-dbdc-4c6c-a20a-62c87a1e446f","Type":"ContainerStarted","Data":"0e291172cdd617d704739d04a8edffb53f124070ef2d4c465c10039756e30615"} Sep 08 10:56:06.954974 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:06.954937 2560 generic.go:356] "Generic (PLEG): container finished" podID="f6a86c3a-a256-4e5a-aaa8-737dee4e9147" containerID="ac73459305681a1986f5caa7ae8bb881c0879dc24e2e421001dd560e6a8855ab" exitCode=0 Sep 08 10:56:06.955165 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:06.955030 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zzppw" event={"ID":"f6a86c3a-a256-4e5a-aaa8-737dee4e9147","Type":"ContainerDied","Data":"ac73459305681a1986f5caa7ae8bb881c0879dc24e2e421001dd560e6a8855ab"} Sep 08 10:56:06.959223 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:06.959049 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wfrtm" event={"ID":"984def62-1940-433d-83c1-b241c0f5cfa5","Type":"ContainerStarted","Data":"bd5939ef7b55805d30771788a82d6b8fda4bcf9153c41b45965388d5b0da4e9b"} Sep 08 10:56:06.963328 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:06.963257 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-80.ec2.internal" event={"ID":"952015d437c3d0f0cd335c2b2dde7781","Type":"ContainerStarted","Data":"1eba2290e0fdb5a121894e8b4f3155690a0a265ac2501bfbacf9502691c50be4"} Sep 08 10:56:06.966189 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:06.966162 2560 generic.go:356] "Generic (PLEG): container finished" podID="5973e251c0e47bb871ab5b1debe18153" containerID="a79a593c7787a0b176e2848b730c37d897a84c3e5710b8f232560ac9b3b20227" exitCode=0 Sep 08 10:56:06.966307 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:06.966261 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-80.ec2.internal" event={"ID":"5973e251c0e47bb871ab5b1debe18153","Type":"ContainerDied","Data":"a79a593c7787a0b176e2848b730c37d897a84c3e5710b8f232560ac9b3b20227"} Sep 08 10:56:06.969473 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:06.969446 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwswd" event={"ID":"9b62f9f1-9031-4f6a-acdb-5dfa1658d05f","Type":"ContainerStarted","Data":"140e33d303c2486c806450046cc1138303867c6228e7244f652ea9b22f129dfa"} Sep 08 10:56:06.971710 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:06.971670 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wx4r8" podStartSLOduration=2.02438082 podStartE2EDuration="6.97165812s" totalImagesPullingTime="4.9472773s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:56:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:56:06.971398109 +0000 UTC m=+7.603993592" watchObservedRunningTime="2026-09-08 10:56:06.97165812 +0000 UTC m=+7.604253601" Sep 08 10:56:06.973390 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:06.973366 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cjnqs" event={"ID":"83286d64-d4e8-4548-8a35-e9fb3201c67e","Type":"ContainerStarted","Data":"f4101f0132ae08269a7035abc4917e6e383579218800151fd3be2db1602365ac"} Sep 08 10:56:06.987225 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:06.987162 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wfrtm" podStartSLOduration=2.021790427 podStartE2EDuration="6.987138069s" totalImagesPullingTime="4.965347642s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:56:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:56:06.986559642 +0000 UTC m=+7.619155125" watchObservedRunningTime="2026-09-08 10:56:06.987138069 +0000 UTC m=+7.619733550" Sep 08 10:56:07.895573 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:07.895536 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:56:07.895737 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:07.895673 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdd9x" podUID="bd67d177-bc24-48be-acca-e3cd070e193e" Sep 08 10:56:07.981977 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:07.981936 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lbdsq" event={"ID":"090c52f2-8dd6-471d-8dd0-96b288d6aec7","Type":"ContainerStarted","Data":"d6c23dba5a62af257d781295aef084d5dd6ba4f949e84ff77522ee6805d9d8c5"} Sep 08 10:56:07.985467 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:07.984637 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-80.ec2.internal" event={"ID":"5973e251c0e47bb871ab5b1debe18153","Type":"ContainerStarted","Data":"7a3172f0fcfbd0cc13276a68ab38a0b3bdca8d00e9d4628e2fffbb5aeca01c6c"} Sep 08 10:56:07.999211 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:07.998933 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lbdsq" podStartSLOduration=3.073420317 podStartE2EDuration="7.998911436s" totalImagesPullingTime="4.925491119s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:56:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:56:07.997963211 +0000 UTC m=+8.630558690" watchObservedRunningTime="2026-09-08 10:56:07.998911436 +0000 UTC m=+8.631506919" Sep 08 10:56:07.999211 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:07.999078 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cjnqs" podStartSLOduration=3.167560187 podStartE2EDuration="7.999071093s" totalImagesPullingTime="4.831510906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:56:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:56:07.048402236 +0000 UTC m=+7.680997719" watchObservedRunningTime="2026-09-08 10:56:07.999071093 +0000 UTC m=+8.631666573" Sep 08 10:56:08.564338 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:08.564264 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30463b34-4ef7-4a59-8b30-dd4b1199e7a6-original-pull-secret\") pod \"global-pull-secret-syncer-vtxs2\" (UID: \"30463b34-4ef7-4a59-8b30-dd4b1199e7a6\") " pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:08.564499 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:08.564363 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc69f433-ba6d-4fd6-ad22-29d26782f11d-metrics-certs\") pod \"network-metrics-daemon-msdpf\" (UID: \"dc69f433-ba6d-4fd6-ad22-29d26782f11d\") " pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:56:08.564572 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:08.564541 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:56:08.564625 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:08.564603 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc69f433-ba6d-4fd6-ad22-29d26782f11d-metrics-certs podName:dc69f433-ba6d-4fd6-ad22-29d26782f11d nodeName:}" failed. No retries permitted until 2026-09-08 10:56:16.564584064 +0000 UTC m=+17.197179542 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc69f433-ba6d-4fd6-ad22-29d26782f11d-metrics-certs") pod "network-metrics-daemon-msdpf" (UID: "dc69f433-ba6d-4fd6-ad22-29d26782f11d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:56:08.565089 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:08.565068 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 10:56:08.565216 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:08.565123 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30463b34-4ef7-4a59-8b30-dd4b1199e7a6-original-pull-secret podName:30463b34-4ef7-4a59-8b30-dd4b1199e7a6 nodeName:}" failed. No retries permitted until 2026-09-08 10:56:16.56510778 +0000 UTC m=+17.197703242 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30463b34-4ef7-4a59-8b30-dd4b1199e7a6-original-pull-secret") pod "global-pull-secret-syncer-vtxs2" (UID: "30463b34-4ef7-4a59-8b30-dd4b1199e7a6") : object "kube-system"/"original-pull-secret" not registered Sep 08 10:56:08.617923 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:08.617574 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cjnqs" Sep 08 10:56:08.618327 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:08.618306 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cjnqs" Sep 08 10:56:08.635958 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:08.634926 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-80.ec2.internal" podStartSLOduration=7.634900142 podStartE2EDuration="7.634900142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:56:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:56:08.015374686 +0000 UTC m=+8.647970164" watchObservedRunningTime="2026-09-08 10:56:08.634900142 +0000 UTC m=+9.267495620" Sep 08 10:56:08.665650 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:08.665543 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvn89\" (UniqueName: \"kubernetes.io/projected/bd67d177-bc24-48be-acca-e3cd070e193e-kube-api-access-mvn89\") pod \"network-check-target-pdd9x\" (UID: \"bd67d177-bc24-48be-acca-e3cd070e193e\") " pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:56:08.665812 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:08.665679 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 10:56:08.665812 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:08.665702 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 10:56:08.665812 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:08.665711 2560 projected.go:196] Error preparing data for projected volume kube-api-access-mvn89 for pod openshift-network-diagnostics/network-check-target-pdd9x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:56:08.665812 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:08.665772 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd67d177-bc24-48be-acca-e3cd070e193e-kube-api-access-mvn89 podName:bd67d177-bc24-48be-acca-e3cd070e193e nodeName:}" failed. No retries permitted until 2026-09-08 10:56:16.665759023 +0000 UTC m=+17.298354493 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mvn89" (UniqueName: "kubernetes.io/projected/bd67d177-bc24-48be-acca-e3cd070e193e-kube-api-access-mvn89") pod "network-check-target-pdd9x" (UID: "bd67d177-bc24-48be-acca-e3cd070e193e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:56:08.896136 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:08.895339 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:08.896136 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:08.895475 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtxs2" podUID="30463b34-4ef7-4a59-8b30-dd4b1199e7a6" Sep 08 10:56:08.896136 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:08.895869 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:56:08.896136 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:08.895970 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msdpf" podUID="dc69f433-ba6d-4fd6-ad22-29d26782f11d" Sep 08 10:56:08.987606 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:08.987574 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cjnqs" Sep 08 10:56:08.988471 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:08.988158 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cjnqs" Sep 08 10:56:09.897082 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:09.896622 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:56:09.897082 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:09.896733 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdd9x" podUID="bd67d177-bc24-48be-acca-e3cd070e193e" Sep 08 10:56:10.896339 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:10.895645 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:56:10.896339 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:10.895788 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msdpf" podUID="dc69f433-ba6d-4fd6-ad22-29d26782f11d" Sep 08 10:56:10.896339 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:10.895852 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:10.896339 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:10.895926 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtxs2" podUID="30463b34-4ef7-4a59-8b30-dd4b1199e7a6" Sep 08 10:56:10.995786 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:10.995647 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-80.ec2.internal" event={"ID":"952015d437c3d0f0cd335c2b2dde7781","Type":"ContainerStarted","Data":"029e79e72634b5043255948c5c1297338eda18a679ad8a8320226057a762a50f"} Sep 08 10:56:11.010769 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:11.010616 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-80.ec2.internal" podStartSLOduration=10.010592988 podStartE2EDuration="10.010592988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:56:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:56:11.009509952 +0000 UTC m=+11.642105431" watchObservedRunningTime="2026-09-08 10:56:11.010592988 +0000 UTC m=+11.643188467" Sep 08 10:56:11.895792 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:11.895753 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:56:11.896054 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:11.895893 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdd9x" podUID="bd67d177-bc24-48be-acca-e3cd070e193e" Sep 08 10:56:12.895207 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:12.895151 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:12.895635 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:12.895309 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtxs2" podUID="30463b34-4ef7-4a59-8b30-dd4b1199e7a6" Sep 08 10:56:12.895706 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:12.895687 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:56:12.895851 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:12.895811 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msdpf" podUID="dc69f433-ba6d-4fd6-ad22-29d26782f11d" Sep 08 10:56:13.894810 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:13.894780 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:56:13.894999 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:13.894918 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdd9x" podUID="bd67d177-bc24-48be-acca-e3cd070e193e" Sep 08 10:56:14.895669 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:14.895632 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:14.896151 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:14.895643 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:56:14.896151 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:14.895750 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtxs2" podUID="30463b34-4ef7-4a59-8b30-dd4b1199e7a6" Sep 08 10:56:14.896151 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:14.895854 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msdpf" podUID="dc69f433-ba6d-4fd6-ad22-29d26782f11d" Sep 08 10:56:15.895586 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:15.895552 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:56:15.895770 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:15.895676 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdd9x" podUID="bd67d177-bc24-48be-acca-e3cd070e193e" Sep 08 10:56:16.631745 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:16.631699 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30463b34-4ef7-4a59-8b30-dd4b1199e7a6-original-pull-secret\") pod \"global-pull-secret-syncer-vtxs2\" (UID: \"30463b34-4ef7-4a59-8b30-dd4b1199e7a6\") " pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:16.631745 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:16.631750 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc69f433-ba6d-4fd6-ad22-29d26782f11d-metrics-certs\") pod \"network-metrics-daemon-msdpf\" (UID: \"dc69f433-ba6d-4fd6-ad22-29d26782f11d\") " pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:56:16.632026 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:16.631880 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 10:56:16.632026 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:16.631889 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:56:16.632026 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:16.631964 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30463b34-4ef7-4a59-8b30-dd4b1199e7a6-original-pull-secret podName:30463b34-4ef7-4a59-8b30-dd4b1199e7a6 nodeName:}" failed. No retries permitted until 2026-09-08 10:56:32.631943116 +0000 UTC m=+33.264538587 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30463b34-4ef7-4a59-8b30-dd4b1199e7a6-original-pull-secret") pod "global-pull-secret-syncer-vtxs2" (UID: "30463b34-4ef7-4a59-8b30-dd4b1199e7a6") : object "kube-system"/"original-pull-secret" not registered Sep 08 10:56:16.632026 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:16.631984 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc69f433-ba6d-4fd6-ad22-29d26782f11d-metrics-certs podName:dc69f433-ba6d-4fd6-ad22-29d26782f11d nodeName:}" failed. No retries permitted until 2026-09-08 10:56:32.631974603 +0000 UTC m=+33.264570073 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc69f433-ba6d-4fd6-ad22-29d26782f11d-metrics-certs") pod "network-metrics-daemon-msdpf" (UID: "dc69f433-ba6d-4fd6-ad22-29d26782f11d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:56:16.732451 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:16.732415 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvn89\" (UniqueName: \"kubernetes.io/projected/bd67d177-bc24-48be-acca-e3cd070e193e-kube-api-access-mvn89\") pod \"network-check-target-pdd9x\" (UID: \"bd67d177-bc24-48be-acca-e3cd070e193e\") " pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:56:16.732645 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:16.732624 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 10:56:16.732714 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:16.732652 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 10:56:16.732714 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:16.732664 2560 projected.go:196] Error preparing data for projected volume kube-api-access-mvn89 for pod openshift-network-diagnostics/network-check-target-pdd9x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:56:16.732808 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:16.732732 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd67d177-bc24-48be-acca-e3cd070e193e-kube-api-access-mvn89 podName:bd67d177-bc24-48be-acca-e3cd070e193e nodeName:}" failed. No retries permitted until 2026-09-08 10:56:32.732710135 +0000 UTC m=+33.365305592 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mvn89" (UniqueName: "kubernetes.io/projected/bd67d177-bc24-48be-acca-e3cd070e193e-kube-api-access-mvn89") pod "network-check-target-pdd9x" (UID: "bd67d177-bc24-48be-acca-e3cd070e193e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:56:16.895505 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:16.895428 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:16.896033 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:16.895432 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:56:16.896033 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:16.895555 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtxs2" podUID="30463b34-4ef7-4a59-8b30-dd4b1199e7a6" Sep 08 10:56:16.896033 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:16.895607 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msdpf" podUID="dc69f433-ba6d-4fd6-ad22-29d26782f11d" Sep 08 10:56:17.895687 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:17.895649 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:56:17.895854 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:17.895758 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdd9x" podUID="bd67d177-bc24-48be-acca-e3cd070e193e" Sep 08 10:56:18.894752 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:18.894718 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:18.894752 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:18.894751 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:56:18.895272 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:18.894862 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtxs2" podUID="30463b34-4ef7-4a59-8b30-dd4b1199e7a6" Sep 08 10:56:18.895272 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:18.894981 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msdpf" podUID="dc69f433-ba6d-4fd6-ad22-29d26782f11d" Sep 08 10:56:19.895920 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:19.895888 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:56:19.896462 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:19.896017 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdd9x" podUID="bd67d177-bc24-48be-acca-e3cd070e193e" Sep 08 10:56:20.895537 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:20.895495 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:20.895716 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:20.895512 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:56:20.895716 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:20.895616 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtxs2" podUID="30463b34-4ef7-4a59-8b30-dd4b1199e7a6" Sep 08 10:56:20.895716 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:20.895692 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msdpf" podUID="dc69f433-ba6d-4fd6-ad22-29d26782f11d" Sep 08 10:56:21.895320 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:21.895283 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:56:21.895980 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:21.895439 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdd9x" podUID="bd67d177-bc24-48be-acca-e3cd070e193e" Sep 08 10:56:22.895809 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:22.895772 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:56:22.896286 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:22.895815 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:22.896286 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:22.895918 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msdpf" podUID="dc69f433-ba6d-4fd6-ad22-29d26782f11d" Sep 08 10:56:22.896286 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:22.896060 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtxs2" podUID="30463b34-4ef7-4a59-8b30-dd4b1199e7a6" Sep 08 10:56:23.328457 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:23.328255 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 08 10:56:23.857767 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:23.857499 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T10:56:23.328442995Z","UUID":"ee9a9dfb-3640-42de-9e23-4312c4ad156f","Handler":null,"Name":"","Endpoint":""} Sep 08 10:56:23.859240 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:23.859214 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 08 10:56:23.859383 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:23.859250 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 08 10:56:23.894860 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:23.894827 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:56:23.895022 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:23.894964 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdd9x" podUID="bd67d177-bc24-48be-acca-e3cd070e193e" Sep 08 10:56:24.026084 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:24.025994 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" event={"ID":"c3655b0c-f997-41c9-9dea-43e50b077382","Type":"ContainerStarted","Data":"c6e422722a01d3d45be07325ea183ad4f6f6ab3f59de44e5206a6b48cd2b78e8"} Sep 08 10:56:24.028158 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:24.028132 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwswd" event={"ID":"9b62f9f1-9031-4f6a-acdb-5dfa1658d05f","Type":"ContainerStarted","Data":"1ac7572cc7e3a56278e026688a345538d2af987a3728e0f6a20756b5fdf0625b"} Sep 08 10:56:24.031606 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:24.031578 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" event={"ID":"6437c1e3-5290-4262-815a-b5b88425796d","Type":"ContainerStarted","Data":"25f2a4f35cb99e16f20ea25bba0cb057e060171affa7d08c78b72164b5d78570"} Sep 08 10:56:24.031741 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:24.031658 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" event={"ID":"6437c1e3-5290-4262-815a-b5b88425796d","Type":"ContainerStarted","Data":"87a807e9340384e4f83813bb47292c221af615d63e71957be9df512b33b25cda"} Sep 08 10:56:24.031741 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:24.031691 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" event={"ID":"6437c1e3-5290-4262-815a-b5b88425796d","Type":"ContainerStarted","Data":"3af806f3fcf571bc82134032a0077c05162234cfcc362bc558932cb698bb0e57"} Sep 08 10:56:24.031741 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:24.031719 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" event={"ID":"6437c1e3-5290-4262-815a-b5b88425796d","Type":"ContainerStarted","Data":"cd5724ba0694e57e52d465624fa673239b9cf7f4398b7f899d960a97fa253b83"} Sep 08 10:56:24.031904 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:24.031745 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" event={"ID":"6437c1e3-5290-4262-815a-b5b88425796d","Type":"ContainerStarted","Data":"7f5200c4caf066082cc75ae7b2775ab180addff9227a886fbaf2d043a32a9af2"} Sep 08 10:56:24.031904 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:24.031777 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" event={"ID":"6437c1e3-5290-4262-815a-b5b88425796d","Type":"ContainerStarted","Data":"f33dfc196f4a7206239359211f16f5a9d8253611eeefd014dfb1656a2564e1ec"} Sep 08 10:56:24.033346 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:24.033319 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6sb6d" event={"ID":"2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9","Type":"ContainerStarted","Data":"065a1dabbbdd947b5d01bed453d268f1b3e9881d850a9375bf5c90a131754c55"} Sep 08 10:56:24.035252 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:24.035229 2560 generic.go:356] "Generic (PLEG): container finished" podID="f6a86c3a-a256-4e5a-aaa8-737dee4e9147" containerID="4c6a0bf6d6203c62402aa09cc701cbc4d7e1a86d458827a3b9c6f51a6c5a5506" exitCode=0 Sep 08 10:56:24.035366 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:24.035269 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zzppw" event={"ID":"f6a86c3a-a256-4e5a-aaa8-737dee4e9147","Type":"ContainerDied","Data":"4c6a0bf6d6203c62402aa09cc701cbc4d7e1a86d458827a3b9c6f51a6c5a5506"} Sep 08 10:56:24.044454 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:24.044406 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pj5pz" podStartSLOduration=2.100299112 podStartE2EDuration="24.044392224s" totalImagesPullingTime="21.944093112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:56:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:56:24.043854956 +0000 UTC m=+24.676450435" watchObservedRunningTime="2026-09-08 10:56:24.044392224 +0000 UTC m=+24.676987702" Sep 08 10:56:24.059666 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:24.059612 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6sb6d" podStartSLOduration=1.871399445 podStartE2EDuration="24.059591631s" totalImagesPullingTime="22.188192186s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:56:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:56:24.059345386 +0000 UTC m=+24.691940866" watchObservedRunningTime="2026-09-08 10:56:24.059591631 +0000 UTC m=+24.692187112" Sep 08 10:56:24.895749 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:24.895717 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:24.895915 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:24.895724 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:56:24.895915 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:24.895815 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtxs2" podUID="30463b34-4ef7-4a59-8b30-dd4b1199e7a6" Sep 08 10:56:24.895984 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:24.895909 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msdpf" podUID="dc69f433-ba6d-4fd6-ad22-29d26782f11d" Sep 08 10:56:25.039620 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:25.039572 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwswd" event={"ID":"9b62f9f1-9031-4f6a-acdb-5dfa1658d05f","Type":"ContainerStarted","Data":"c0e63701041c5de349edc90b4639ea4518dfb8985745296ad8a0e73f2f19b0df"} Sep 08 10:56:25.058967 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:25.058913 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwswd" podStartSLOduration=2.7596700199999997 podStartE2EDuration="25.058898949s" totalImagesPullingTime="22.299228929s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:56:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:56:25.058374993 +0000 UTC m=+25.690970471" watchObservedRunningTime="2026-09-08 10:56:25.058898949 +0000 UTC m=+25.691494422" Sep 08 10:56:25.894981 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:25.894952 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:56:25.895123 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:25.895081 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdd9x" podUID="bd67d177-bc24-48be-acca-e3cd070e193e" Sep 08 10:56:26.044636 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:26.044605 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" event={"ID":"6437c1e3-5290-4262-815a-b5b88425796d","Type":"ContainerStarted","Data":"d1fe213c5c0862fba571991dfdd575bc8fc1ea8469b76973b0035ceeae83c7c5"} Sep 08 10:56:26.895360 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:26.895331 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:56:26.895526 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:26.895335 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:26.895526 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:26.895436 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msdpf" podUID="dc69f433-ba6d-4fd6-ad22-29d26782f11d" Sep 08 10:56:26.895526 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:26.895510 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtxs2" podUID="30463b34-4ef7-4a59-8b30-dd4b1199e7a6" Sep 08 10:56:27.894990 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:27.894784 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:56:27.895284 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:27.895073 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdd9x" podUID="bd67d177-bc24-48be-acca-e3cd070e193e" Sep 08 10:56:28.054085 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:28.054042 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" event={"ID":"6437c1e3-5290-4262-815a-b5b88425796d","Type":"ContainerStarted","Data":"4cf85af043ab44ecadc16c00e4f83a7d5028abba268b0c9c15187bc8ec4581be"} Sep 08 10:56:28.056210 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:28.056186 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:28.056351 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:28.056312 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:28.056413 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:28.056376 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:28.077119 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:28.077090 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:28.077358 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:28.077247 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:56:28.087364 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:28.087287 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" podStartSLOduration=6.076140845 podStartE2EDuration="28.087273647s" totalImagesPullingTime="22.011132802s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:56:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:56:28.086881924 +0000 UTC m=+28.719477403" watchObservedRunningTime="2026-09-08 10:56:28.087273647 +0000 UTC m=+28.719869124" Sep 08 10:56:28.895140 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:28.895114 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:56:28.895785 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:28.895150 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:28.895785 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:28.895253 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msdpf" podUID="dc69f433-ba6d-4fd6-ad22-29d26782f11d" Sep 08 10:56:28.895785 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:28.895369 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtxs2" podUID="30463b34-4ef7-4a59-8b30-dd4b1199e7a6" Sep 08 10:56:29.057844 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:29.057814 2560 generic.go:356] "Generic (PLEG): container finished" podID="f6a86c3a-a256-4e5a-aaa8-737dee4e9147" containerID="1d461f21ca9fd69bdb1467c33b0d13f35a65962a530b386b8f625b16998991be" exitCode=0 Sep 08 10:56:29.058028 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:29.057909 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zzppw" event={"ID":"f6a86c3a-a256-4e5a-aaa8-737dee4e9147","Type":"ContainerDied","Data":"1d461f21ca9fd69bdb1467c33b0d13f35a65962a530b386b8f625b16998991be"} Sep 08 10:56:29.104017 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:29.103980 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:29.202935 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:29.202838 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:29.797383 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:29.797110 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pdd9x"] Sep 08 10:56:29.797543 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:29.797500 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:56:29.797636 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:29.797617 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdd9x" podUID="bd67d177-bc24-48be-acca-e3cd070e193e" Sep 08 10:56:29.800075 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:29.800046 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vtxs2"] Sep 08 10:56:29.800248 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:29.800148 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:29.800338 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:29.800250 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtxs2" podUID="30463b34-4ef7-4a59-8b30-dd4b1199e7a6" Sep 08 10:56:29.800787 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:29.800722 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-msdpf"] Sep 08 10:56:29.800894 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:29.800831 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:56:29.800964 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:29.800941 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msdpf" podUID="dc69f433-ba6d-4fd6-ad22-29d26782f11d" Sep 08 10:56:30.895226 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:30.895195 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:30.895701 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:30.895299 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtxs2" podUID="30463b34-4ef7-4a59-8b30-dd4b1199e7a6" Sep 08 10:56:31.064532 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:31.064499 2560 generic.go:356] "Generic (PLEG): container finished" podID="f6a86c3a-a256-4e5a-aaa8-737dee4e9147" containerID="51fa5a63f02b3b226ba119eae4a9a2459f3554f52b3efda5866dd7ab5c40f3cb" exitCode=0 Sep 08 10:56:31.064715 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:31.064548 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zzppw" event={"ID":"f6a86c3a-a256-4e5a-aaa8-737dee4e9147","Type":"ContainerDied","Data":"51fa5a63f02b3b226ba119eae4a9a2459f3554f52b3efda5866dd7ab5c40f3cb"} Sep 08 10:56:31.895122 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:31.895093 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:56:31.895315 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:31.895250 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msdpf" podUID="dc69f433-ba6d-4fd6-ad22-29d26782f11d" Sep 08 10:56:31.895669 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:31.895356 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:56:31.895669 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:31.895436 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdd9x" podUID="bd67d177-bc24-48be-acca-e3cd070e193e" Sep 08 10:56:32.649142 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:32.649109 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30463b34-4ef7-4a59-8b30-dd4b1199e7a6-original-pull-secret\") pod \"global-pull-secret-syncer-vtxs2\" (UID: \"30463b34-4ef7-4a59-8b30-dd4b1199e7a6\") " pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:32.649322 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:32.649153 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc69f433-ba6d-4fd6-ad22-29d26782f11d-metrics-certs\") pod \"network-metrics-daemon-msdpf\" (UID: \"dc69f433-ba6d-4fd6-ad22-29d26782f11d\") " pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:56:32.649322 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:32.649264 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:56:32.649322 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:32.649262 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 10:56:32.649322 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:32.649324 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc69f433-ba6d-4fd6-ad22-29d26782f11d-metrics-certs podName:dc69f433-ba6d-4fd6-ad22-29d26782f11d nodeName:}" failed. No retries permitted until 2026-09-08 10:57:04.649302456 +0000 UTC m=+65.281897915 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc69f433-ba6d-4fd6-ad22-29d26782f11d-metrics-certs") pod "network-metrics-daemon-msdpf" (UID: "dc69f433-ba6d-4fd6-ad22-29d26782f11d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:56:32.649486 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:32.649339 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30463b34-4ef7-4a59-8b30-dd4b1199e7a6-original-pull-secret podName:30463b34-4ef7-4a59-8b30-dd4b1199e7a6 nodeName:}" failed. No retries permitted until 2026-09-08 10:57:04.649331476 +0000 UTC m=+65.281926932 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30463b34-4ef7-4a59-8b30-dd4b1199e7a6-original-pull-secret") pod "global-pull-secret-syncer-vtxs2" (UID: "30463b34-4ef7-4a59-8b30-dd4b1199e7a6") : object "kube-system"/"original-pull-secret" not registered Sep 08 10:56:32.749820 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:32.749783 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvn89\" (UniqueName: \"kubernetes.io/projected/bd67d177-bc24-48be-acca-e3cd070e193e-kube-api-access-mvn89\") pod \"network-check-target-pdd9x\" (UID: \"bd67d177-bc24-48be-acca-e3cd070e193e\") " pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:56:32.749996 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:32.749976 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 10:56:32.750043 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:32.750001 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 10:56:32.750043 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:32.750015 2560 projected.go:196] Error preparing data for projected volume kube-api-access-mvn89 for pod openshift-network-diagnostics/network-check-target-pdd9x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:56:32.750117 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:32.750084 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd67d177-bc24-48be-acca-e3cd070e193e-kube-api-access-mvn89 podName:bd67d177-bc24-48be-acca-e3cd070e193e nodeName:}" failed. No retries permitted until 2026-09-08 10:57:04.750062706 +0000 UTC m=+65.382658165 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mvn89" (UniqueName: "kubernetes.io/projected/bd67d177-bc24-48be-acca-e3cd070e193e-kube-api-access-mvn89") pod "network-check-target-pdd9x" (UID: "bd67d177-bc24-48be-acca-e3cd070e193e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:56:32.895216 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:32.895119 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:32.895380 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:32.895250 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtxs2" podUID="30463b34-4ef7-4a59-8b30-dd4b1199e7a6" Sep 08 10:56:33.085852 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:33.085817 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:33.147930 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:33.147827 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:33.895297 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:33.895266 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:56:33.895458 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:33.895314 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:56:33.895458 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:33.895415 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msdpf" podUID="dc69f433-ba6d-4fd6-ad22-29d26782f11d" Sep 08 10:56:33.895845 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:33.895555 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdd9x" podUID="bd67d177-bc24-48be-acca-e3cd070e193e" Sep 08 10:56:34.395516 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:34.395476 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:34.895057 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:34.895021 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:34.895258 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:34.895150 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vtxs2" podUID="30463b34-4ef7-4a59-8b30-dd4b1199e7a6" Sep 08 10:56:35.253149 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:35.253048 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:35.346784 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:35.346749 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:35.895798 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:35.895757 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:56:35.895991 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:35.895886 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msdpf" podUID="dc69f433-ba6d-4fd6-ad22-29d26782f11d" Sep 08 10:56:35.896045 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:35.895984 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:56:35.896139 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:35.896115 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdd9x" podUID="bd67d177-bc24-48be-acca-e3cd070e193e" Sep 08 10:56:36.084209 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.084154 2560 generic.go:356] "Generic (PLEG): container finished" podID="f6a86c3a-a256-4e5a-aaa8-737dee4e9147" containerID="ef6f46f29a1f5152f5c49a0968ff67f040158c5b813a3fd982b3f7274136585c" exitCode=0 Sep 08 10:56:36.084338 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.084225 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zzppw" event={"ID":"f6a86c3a-a256-4e5a-aaa8-737dee4e9147","Type":"ContainerDied","Data":"ef6f46f29a1f5152f5c49a0968ff67f040158c5b813a3fd982b3f7274136585c"} Sep 08 10:56:36.147277 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.147251 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-80.ec2.internal" event="NodeReady" Sep 08 10:56:36.147439 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.147380 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 08 10:56:36.194461 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.194431 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:36.197554 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.197311 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zs2dr"] Sep 08 10:56:36.221078 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.221051 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xm8x2"] Sep 08 10:56:36.221209 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.221193 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zs2dr" Sep 08 10:56:36.223976 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.223813 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 08 10:56:36.223976 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.223882 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7pklm\"" Sep 08 10:56:36.223976 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.223974 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 08 10:56:36.241326 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.241305 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zs2dr"] Sep 08 10:56:36.241422 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.241345 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xm8x2"] Sep 08 10:56:36.241626 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.241607 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xm8x2" Sep 08 10:56:36.244277 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.244257 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p7wtt\"" Sep 08 10:56:36.244389 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.244294 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 08 10:56:36.244389 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.244304 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 08 10:56:36.244560 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.244547 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 08 10:56:36.265480 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.265459 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:36.333285 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.333249 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:36.374878 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.374840 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a72bab02-fa2c-499a-81be-8bf56c3db578-tmp-dir\") pod \"dns-default-zs2dr\" (UID: \"a72bab02-fa2c-499a-81be-8bf56c3db578\") " pod="openshift-dns/dns-default-zs2dr" Sep 08 10:56:36.374988 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.374884 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvpzq\" (UniqueName: \"kubernetes.io/projected/8317d8ea-1acd-4ad7-870b-7eb5476f4151-kube-api-access-lvpzq\") pod \"ingress-canary-xm8x2\" (UID: \"8317d8ea-1acd-4ad7-870b-7eb5476f4151\") " pod="openshift-ingress-canary/ingress-canary-xm8x2" Sep 08 10:56:36.374988 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.374975 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a72bab02-fa2c-499a-81be-8bf56c3db578-config-volume\") pod \"dns-default-zs2dr\" (UID: \"a72bab02-fa2c-499a-81be-8bf56c3db578\") " pod="openshift-dns/dns-default-zs2dr" Sep 08 10:56:36.375059 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.374998 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a72bab02-fa2c-499a-81be-8bf56c3db578-metrics-tls\") pod \"dns-default-zs2dr\" (UID: \"a72bab02-fa2c-499a-81be-8bf56c3db578\") " pod="openshift-dns/dns-default-zs2dr" Sep 08 10:56:36.375059 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.375016 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvnjc\" (UniqueName: \"kubernetes.io/projected/a72bab02-fa2c-499a-81be-8bf56c3db578-kube-api-access-mvnjc\") pod \"dns-default-zs2dr\" (UID: \"a72bab02-fa2c-499a-81be-8bf56c3db578\") " pod="openshift-dns/dns-default-zs2dr" Sep 08 10:56:36.375059 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.375034 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8317d8ea-1acd-4ad7-870b-7eb5476f4151-cert\") pod \"ingress-canary-xm8x2\" (UID: \"8317d8ea-1acd-4ad7-870b-7eb5476f4151\") " pod="openshift-ingress-canary/ingress-canary-xm8x2" Sep 08 10:56:36.433621 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.433578 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:36.475464 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.475388 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a72bab02-fa2c-499a-81be-8bf56c3db578-tmp-dir\") pod \"dns-default-zs2dr\" (UID: \"a72bab02-fa2c-499a-81be-8bf56c3db578\") " pod="openshift-dns/dns-default-zs2dr" Sep 08 10:56:36.475464 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.475425 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvpzq\" (UniqueName: \"kubernetes.io/projected/8317d8ea-1acd-4ad7-870b-7eb5476f4151-kube-api-access-lvpzq\") pod \"ingress-canary-xm8x2\" (UID: \"8317d8ea-1acd-4ad7-870b-7eb5476f4151\") " pod="openshift-ingress-canary/ingress-canary-xm8x2" Sep 08 10:56:36.475622 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.475493 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a72bab02-fa2c-499a-81be-8bf56c3db578-config-volume\") pod \"dns-default-zs2dr\" (UID: \"a72bab02-fa2c-499a-81be-8bf56c3db578\") " pod="openshift-dns/dns-default-zs2dr" Sep 08 10:56:36.475622 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.475515 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a72bab02-fa2c-499a-81be-8bf56c3db578-metrics-tls\") pod \"dns-default-zs2dr\" (UID: \"a72bab02-fa2c-499a-81be-8bf56c3db578\") " pod="openshift-dns/dns-default-zs2dr" Sep 08 10:56:36.475695 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.475632 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvnjc\" (UniqueName: \"kubernetes.io/projected/a72bab02-fa2c-499a-81be-8bf56c3db578-kube-api-access-mvnjc\") pod \"dns-default-zs2dr\" (UID: \"a72bab02-fa2c-499a-81be-8bf56c3db578\") " pod="openshift-dns/dns-default-zs2dr" Sep 08 10:56:36.475695 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.475678 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8317d8ea-1acd-4ad7-870b-7eb5476f4151-cert\") pod \"ingress-canary-xm8x2\" (UID: \"8317d8ea-1acd-4ad7-870b-7eb5476f4151\") " pod="openshift-ingress-canary/ingress-canary-xm8x2" Sep 08 10:56:36.475769 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:36.475697 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 10:56:36.475769 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:36.475760 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a72bab02-fa2c-499a-81be-8bf56c3db578-metrics-tls podName:a72bab02-fa2c-499a-81be-8bf56c3db578 nodeName:}" failed. No retries permitted until 2026-09-08 10:56:36.975740976 +0000 UTC m=+37.608336453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a72bab02-fa2c-499a-81be-8bf56c3db578-metrics-tls") pod "dns-default-zs2dr" (UID: "a72bab02-fa2c-499a-81be-8bf56c3db578") : secret "dns-default-metrics-tls" not found Sep 08 10:56:36.476108 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.476090 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a72bab02-fa2c-499a-81be-8bf56c3db578-tmp-dir\") pod \"dns-default-zs2dr\" (UID: \"a72bab02-fa2c-499a-81be-8bf56c3db578\") " pod="openshift-dns/dns-default-zs2dr" Sep 08 10:56:36.476293 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.476278 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a72bab02-fa2c-499a-81be-8bf56c3db578-config-volume\") pod \"dns-default-zs2dr\" (UID: \"a72bab02-fa2c-499a-81be-8bf56c3db578\") " pod="openshift-dns/dns-default-zs2dr" Sep 08 10:56:36.480210 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.480070 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8317d8ea-1acd-4ad7-870b-7eb5476f4151-cert\") pod \"ingress-canary-xm8x2\" (UID: \"8317d8ea-1acd-4ad7-870b-7eb5476f4151\") " pod="openshift-ingress-canary/ingress-canary-xm8x2" Sep 08 10:56:36.485755 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.485737 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvnjc\" (UniqueName: \"kubernetes.io/projected/a72bab02-fa2c-499a-81be-8bf56c3db578-kube-api-access-mvnjc\") pod \"dns-default-zs2dr\" (UID: \"a72bab02-fa2c-499a-81be-8bf56c3db578\") " pod="openshift-dns/dns-default-zs2dr" Sep 08 10:56:36.486302 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.486288 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvpzq\" (UniqueName: \"kubernetes.io/projected/8317d8ea-1acd-4ad7-870b-7eb5476f4151-kube-api-access-lvpzq\") pod \"ingress-canary-xm8x2\" (UID: \"8317d8ea-1acd-4ad7-870b-7eb5476f4151\") " pod="openshift-ingress-canary/ingress-canary-xm8x2" Sep 08 10:56:36.549377 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.549346 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xm8x2" Sep 08 10:56:36.880858 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.880831 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xm8x2"] Sep 08 10:56:36.885502 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:56:36.885474 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8317d8ea_1acd_4ad7_870b_7eb5476f4151.slice/crio-327ae3afe557bde511b8a041d88b94f74137e5f623226f9e1d6038fbcf6dcc17 WatchSource:0}: Error finding container 327ae3afe557bde511b8a041d88b94f74137e5f623226f9e1d6038fbcf6dcc17: Status 404 returned error can't find the container with id 327ae3afe557bde511b8a041d88b94f74137e5f623226f9e1d6038fbcf6dcc17 Sep 08 10:56:36.895152 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.895133 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:56:36.898076 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.898060 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 08 10:56:36.980477 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:36.980438 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a72bab02-fa2c-499a-81be-8bf56c3db578-metrics-tls\") pod \"dns-default-zs2dr\" (UID: \"a72bab02-fa2c-499a-81be-8bf56c3db578\") " pod="openshift-dns/dns-default-zs2dr" Sep 08 10:56:36.980654 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:36.980593 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 10:56:36.980692 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:36.980665 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a72bab02-fa2c-499a-81be-8bf56c3db578-metrics-tls podName:a72bab02-fa2c-499a-81be-8bf56c3db578 nodeName:}" failed. No retries permitted until 2026-09-08 10:56:37.980648571 +0000 UTC m=+38.613244049 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a72bab02-fa2c-499a-81be-8bf56c3db578-metrics-tls") pod "dns-default-zs2dr" (UID: "a72bab02-fa2c-499a-81be-8bf56c3db578") : secret "dns-default-metrics-tls" not found Sep 08 10:56:37.090282 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:37.090246 2560 generic.go:356] "Generic (PLEG): container finished" podID="f6a86c3a-a256-4e5a-aaa8-737dee4e9147" containerID="077f294ff8b5f8eb4f9e5718591759b8f0945cea9d36bdffb7a7a85a4181fd01" exitCode=0 Sep 08 10:56:37.090451 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:37.090328 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zzppw" event={"ID":"f6a86c3a-a256-4e5a-aaa8-737dee4e9147","Type":"ContainerDied","Data":"077f294ff8b5f8eb4f9e5718591759b8f0945cea9d36bdffb7a7a85a4181fd01"} Sep 08 10:56:37.091400 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:37.091377 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xm8x2" event={"ID":"8317d8ea-1acd-4ad7-870b-7eb5476f4151","Type":"ContainerStarted","Data":"327ae3afe557bde511b8a041d88b94f74137e5f623226f9e1d6038fbcf6dcc17"} Sep 08 10:56:37.895475 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:37.895440 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:56:37.896418 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:37.895497 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:56:37.898931 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:37.898908 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7d5p2\"" Sep 08 10:56:37.899353 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:37.899333 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 08 10:56:37.899756 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:37.899733 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 08 10:56:37.899864 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:37.899785 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fxwg7\"" Sep 08 10:56:37.899864 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:37.899813 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 08 10:56:37.905438 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:37.905412 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:37.987105 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:37.987076 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a72bab02-fa2c-499a-81be-8bf56c3db578-metrics-tls\") pod \"dns-default-zs2dr\" (UID: \"a72bab02-fa2c-499a-81be-8bf56c3db578\") " pod="openshift-dns/dns-default-zs2dr" Sep 08 10:56:37.987306 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:37.987251 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 10:56:37.987366 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:37.987320 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a72bab02-fa2c-499a-81be-8bf56c3db578-metrics-tls podName:a72bab02-fa2c-499a-81be-8bf56c3db578 nodeName:}" failed. No retries permitted until 2026-09-08 10:56:39.987301966 +0000 UTC m=+40.619897424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a72bab02-fa2c-499a-81be-8bf56c3db578-metrics-tls") pod "dns-default-zs2dr" (UID: "a72bab02-fa2c-499a-81be-8bf56c3db578") : secret "dns-default-metrics-tls" not found Sep 08 10:56:38.004393 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:38.004357 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:38.099072 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:38.098845 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zzppw" event={"ID":"f6a86c3a-a256-4e5a-aaa8-737dee4e9147","Type":"ContainerStarted","Data":"39bc029dea12ac5754ae88e98d7e25ed1b1206f5d0260cada471cdd8e65fb587"} Sep 08 10:56:38.123212 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:38.121811 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zzppw" podStartSLOduration=7.099131717 podStartE2EDuration="38.12179052s" totalImagesPullingTime="31.022658803s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:56:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:56:38.120706444 +0000 UTC m=+38.753301923" watchObservedRunningTime="2026-09-08 10:56:38.12179052 +0000 UTC m=+38.754386007" Sep 08 10:56:38.246027 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:38.245941 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:38.345654 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:38.345619 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:40.004454 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:40.004418 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a72bab02-fa2c-499a-81be-8bf56c3db578-metrics-tls\") pod \"dns-default-zs2dr\" (UID: \"a72bab02-fa2c-499a-81be-8bf56c3db578\") " pod="openshift-dns/dns-default-zs2dr" Sep 08 10:56:40.004796 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:40.004523 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 10:56:40.004796 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:40.004576 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a72bab02-fa2c-499a-81be-8bf56c3db578-metrics-tls podName:a72bab02-fa2c-499a-81be-8bf56c3db578 nodeName:}" failed. No retries permitted until 2026-09-08 10:56:44.004563035 +0000 UTC m=+44.637158491 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a72bab02-fa2c-499a-81be-8bf56c3db578-metrics-tls") pod "dns-default-zs2dr" (UID: "a72bab02-fa2c-499a-81be-8bf56c3db578") : secret "dns-default-metrics-tls" not found Sep 08 10:56:40.106361 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:40.106321 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xm8x2" event={"ID":"8317d8ea-1acd-4ad7-870b-7eb5476f4151","Type":"ContainerStarted","Data":"29ad38706c3e15c7fdca1960512f1ad6225efa93b62410ff3c9821792f4d8395"} Sep 08 10:56:40.123433 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:40.123386 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xm8x2" podStartSLOduration=1.672661469 podStartE2EDuration="4.123372073s" totalImagesPullingTime="2.450710604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:56:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:56:40.122455563 +0000 UTC m=+40.755051234" watchObservedRunningTime="2026-09-08 10:56:40.123372073 +0000 UTC m=+40.755967548" Sep 08 10:56:40.638356 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:40.638324 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:41.123840 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.123808 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:41.181805 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.181764 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:41.509461 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.509385 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-q6mzn"] Sep 08 10:56:41.553492 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.553460 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-q6mzn"] Sep 08 10:56:41.553645 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.553577 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-q6mzn" Sep 08 10:56:41.556284 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.556265 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 08 10:56:41.557156 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.557139 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-x9d6r\"" Sep 08 10:56:41.557257 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.557157 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 08 10:56:41.619465 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.619122 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-h8954"] Sep 08 10:56:41.641764 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.641730 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-z7dwr"] Sep 08 10:56:41.641914 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.641862 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-h8954" Sep 08 10:56:41.644389 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.644370 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8jj2w\"" Sep 08 10:56:41.665286 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.665252 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-s4z4b"] Sep 08 10:56:41.665445 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.665380 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-z7dwr" Sep 08 10:56:41.667997 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.667967 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 08 10:56:41.667997 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.667988 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 08 10:56:41.668221 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.668075 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-szxhd\"" Sep 08 10:56:41.668221 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.668078 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 08 10:56:41.668364 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.668349 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 08 10:56:41.686626 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.686599 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-h8954"] Sep 08 10:56:41.686626 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.686632 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-z7dwr"] Sep 08 10:56:41.686774 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.686646 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-s4z4b"] Sep 08 10:56:41.686774 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.686711 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-s4z4b" Sep 08 10:56:41.689036 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.689019 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 08 10:56:41.689156 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.689073 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 08 10:56:41.689156 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.689099 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 08 10:56:41.689281 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.689216 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6d7np\"" Sep 08 10:56:41.690154 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.690131 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 08 10:56:41.710098 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.710070 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nsrxz"] Sep 08 10:56:41.717287 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.717258 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9dnv\" (UniqueName: \"kubernetes.io/projected/5c8bcb6a-6008-4e01-8647-ad956f48a346-kube-api-access-r9dnv\") pod \"volume-data-source-validator-695c895bd6-q6mzn\" (UID: \"5c8bcb6a-6008-4e01-8647-ad956f48a346\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-q6mzn" Sep 08 10:56:41.717287 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.717287 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cd9q\" (UniqueName: \"kubernetes.io/projected/dbb4fbf0-e68e-4657-bcc1-76eaa1ed729b-kube-api-access-7cd9q\") pod \"network-check-source-685456655f-h8954\" (UID: \"dbb4fbf0-e68e-4657-bcc1-76eaa1ed729b\") " pod="openshift-network-diagnostics/network-check-source-685456655f-h8954" Sep 08 10:56:41.730026 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.729991 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-f285w"] Sep 08 10:56:41.730180 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.730120 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nsrxz" Sep 08 10:56:41.732740 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.732718 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-z9gts\"" Sep 08 10:56:41.732887 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.732751 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 08 10:56:41.732887 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.732762 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 08 10:56:41.732887 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.732721 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 08 10:56:41.753131 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.753095 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nsrxz"] Sep 08 10:56:41.753279 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.753152 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-f285w"] Sep 08 10:56:41.753279 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.753217 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-f285w" Sep 08 10:56:41.755725 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.755706 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 08 10:56:41.755862 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.755843 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 08 10:56:41.755914 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.755872 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 08 10:56:41.755914 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.755849 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-gpfk4\"" Sep 08 10:56:41.755983 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.755951 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 08 10:56:41.760944 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.760892 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 08 10:56:41.817633 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.817594 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9dnv\" (UniqueName: \"kubernetes.io/projected/5c8bcb6a-6008-4e01-8647-ad956f48a346-kube-api-access-r9dnv\") pod \"volume-data-source-validator-695c895bd6-q6mzn\" (UID: \"5c8bcb6a-6008-4e01-8647-ad956f48a346\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-q6mzn" Sep 08 10:56:41.817633 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.817628 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cd9q\" (UniqueName: \"kubernetes.io/projected/dbb4fbf0-e68e-4657-bcc1-76eaa1ed729b-kube-api-access-7cd9q\") pod \"network-check-source-685456655f-h8954\" (UID: \"dbb4fbf0-e68e-4657-bcc1-76eaa1ed729b\") " pod="openshift-network-diagnostics/network-check-source-685456655f-h8954" Sep 08 10:56:41.817873 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.817648 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e149ccac-29e4-4805-9c68-36fdcdd8a649-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-s4z4b\" (UID: \"e149ccac-29e4-4805-9c68-36fdcdd8a649\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-s4z4b" Sep 08 10:56:41.817873 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.817687 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svkr4\" (UniqueName: \"kubernetes.io/projected/80be3338-ebb8-4dd1-8545-0fcdf56b9ef3-kube-api-access-svkr4\") pod \"console-operator-85b454874b-f285w\" (UID: \"80be3338-ebb8-4dd1-8545-0fcdf56b9ef3\") " pod="openshift-console-operator/console-operator-85b454874b-f285w" Sep 08 10:56:41.817873 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.817704 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/49f2f9b9-ad37-448a-bf04-ab22ff6b8fd3-serving-cert\") pod \"service-ca-operator-859f94c4b-z7dwr\" (UID: \"49f2f9b9-ad37-448a-bf04-ab22ff6b8fd3\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-z7dwr" Sep 08 10:56:41.817873 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.817724 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/49f2f9b9-ad37-448a-bf04-ab22ff6b8fd3-config\") pod \"service-ca-operator-859f94c4b-z7dwr\" (UID: \"49f2f9b9-ad37-448a-bf04-ab22ff6b8fd3\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-z7dwr" Sep 08 10:56:41.817873 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.817770 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dqcq\" (UniqueName: \"kubernetes.io/projected/49f2f9b9-ad37-448a-bf04-ab22ff6b8fd3-kube-api-access-8dqcq\") pod \"service-ca-operator-859f94c4b-z7dwr\" (UID: \"49f2f9b9-ad37-448a-bf04-ab22ff6b8fd3\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-z7dwr" Sep 08 10:56:41.817873 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.817796 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9r9w\" (UniqueName: \"kubernetes.io/projected/e149ccac-29e4-4805-9c68-36fdcdd8a649-kube-api-access-l9r9w\") pod \"cluster-monitoring-operator-6cdcc96965-s4z4b\" (UID: \"e149ccac-29e4-4805-9c68-36fdcdd8a649\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-s4z4b" Sep 08 10:56:41.817873 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.817814 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80be3338-ebb8-4dd1-8545-0fcdf56b9ef3-config\") pod \"console-operator-85b454874b-f285w\" (UID: \"80be3338-ebb8-4dd1-8545-0fcdf56b9ef3\") " pod="openshift-console-operator/console-operator-85b454874b-f285w" Sep 08 10:56:41.817873 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.817839 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dae2c429-76f0-472c-bd1e-ab2f6b9e96f1-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nsrxz\" (UID: \"dae2c429-76f0-472c-bd1e-ab2f6b9e96f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nsrxz" Sep 08 10:56:41.818275 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.817896 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e149ccac-29e4-4805-9c68-36fdcdd8a649-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-s4z4b\" (UID: \"e149ccac-29e4-4805-9c68-36fdcdd8a649\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-s4z4b" Sep 08 10:56:41.818275 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.817953 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80be3338-ebb8-4dd1-8545-0fcdf56b9ef3-serving-cert\") pod \"console-operator-85b454874b-f285w\" (UID: \"80be3338-ebb8-4dd1-8545-0fcdf56b9ef3\") " pod="openshift-console-operator/console-operator-85b454874b-f285w" Sep 08 10:56:41.818275 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.817977 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80be3338-ebb8-4dd1-8545-0fcdf56b9ef3-trusted-ca\") pod \"console-operator-85b454874b-f285w\" (UID: \"80be3338-ebb8-4dd1-8545-0fcdf56b9ef3\") " pod="openshift-console-operator/console-operator-85b454874b-f285w" Sep 08 10:56:41.818275 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.817998 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85pcr\" (UniqueName: \"kubernetes.io/projected/dae2c429-76f0-472c-bd1e-ab2f6b9e96f1-kube-api-access-85pcr\") pod \"cluster-samples-operator-7cdcfcf76c-nsrxz\" (UID: \"dae2c429-76f0-472c-bd1e-ab2f6b9e96f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nsrxz" Sep 08 10:56:41.829948 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.829919 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cd9q\" (UniqueName: \"kubernetes.io/projected/dbb4fbf0-e68e-4657-bcc1-76eaa1ed729b-kube-api-access-7cd9q\") pod \"network-check-source-685456655f-h8954\" (UID: \"dbb4fbf0-e68e-4657-bcc1-76eaa1ed729b\") " pod="openshift-network-diagnostics/network-check-source-685456655f-h8954" Sep 08 10:56:41.829999 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.829922 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9dnv\" (UniqueName: \"kubernetes.io/projected/5c8bcb6a-6008-4e01-8647-ad956f48a346-kube-api-access-r9dnv\") pod \"volume-data-source-validator-695c895bd6-q6mzn\" (UID: \"5c8bcb6a-6008-4e01-8647-ad956f48a346\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-q6mzn" Sep 08 10:56:41.850643 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.850601 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:41.863594 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.863565 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-q6mzn" Sep 08 10:56:41.918432 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.918396 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e149ccac-29e4-4805-9c68-36fdcdd8a649-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-s4z4b\" (UID: \"e149ccac-29e4-4805-9c68-36fdcdd8a649\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-s4z4b" Sep 08 10:56:41.918615 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.918469 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80be3338-ebb8-4dd1-8545-0fcdf56b9ef3-serving-cert\") pod \"console-operator-85b454874b-f285w\" (UID: \"80be3338-ebb8-4dd1-8545-0fcdf56b9ef3\") " pod="openshift-console-operator/console-operator-85b454874b-f285w" Sep 08 10:56:41.918615 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.918489 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80be3338-ebb8-4dd1-8545-0fcdf56b9ef3-trusted-ca\") pod \"console-operator-85b454874b-f285w\" (UID: \"80be3338-ebb8-4dd1-8545-0fcdf56b9ef3\") " pod="openshift-console-operator/console-operator-85b454874b-f285w" Sep 08 10:56:41.918615 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.918505 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85pcr\" (UniqueName: \"kubernetes.io/projected/dae2c429-76f0-472c-bd1e-ab2f6b9e96f1-kube-api-access-85pcr\") pod \"cluster-samples-operator-7cdcfcf76c-nsrxz\" (UID: \"dae2c429-76f0-472c-bd1e-ab2f6b9e96f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nsrxz" Sep 08 10:56:41.918785 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.918650 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e149ccac-29e4-4805-9c68-36fdcdd8a649-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-s4z4b\" (UID: \"e149ccac-29e4-4805-9c68-36fdcdd8a649\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-s4z4b" Sep 08 10:56:41.918785 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.918708 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svkr4\" (UniqueName: \"kubernetes.io/projected/80be3338-ebb8-4dd1-8545-0fcdf56b9ef3-kube-api-access-svkr4\") pod \"console-operator-85b454874b-f285w\" (UID: \"80be3338-ebb8-4dd1-8545-0fcdf56b9ef3\") " pod="openshift-console-operator/console-operator-85b454874b-f285w" Sep 08 10:56:41.918785 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.918734 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/49f2f9b9-ad37-448a-bf04-ab22ff6b8fd3-serving-cert\") pod \"service-ca-operator-859f94c4b-z7dwr\" (UID: \"49f2f9b9-ad37-448a-bf04-ab22ff6b8fd3\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-z7dwr" Sep 08 10:56:41.918785 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.918759 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/49f2f9b9-ad37-448a-bf04-ab22ff6b8fd3-config\") pod \"service-ca-operator-859f94c4b-z7dwr\" (UID: \"49f2f9b9-ad37-448a-bf04-ab22ff6b8fd3\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-z7dwr" Sep 08 10:56:41.918785 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.918781 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dqcq\" (UniqueName: \"kubernetes.io/projected/49f2f9b9-ad37-448a-bf04-ab22ff6b8fd3-kube-api-access-8dqcq\") pod \"service-ca-operator-859f94c4b-z7dwr\" (UID: \"49f2f9b9-ad37-448a-bf04-ab22ff6b8fd3\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-z7dwr" Sep 08 10:56:41.919063 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.918805 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9r9w\" (UniqueName: \"kubernetes.io/projected/e149ccac-29e4-4805-9c68-36fdcdd8a649-kube-api-access-l9r9w\") pod \"cluster-monitoring-operator-6cdcc96965-s4z4b\" (UID: \"e149ccac-29e4-4805-9c68-36fdcdd8a649\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-s4z4b" Sep 08 10:56:41.919063 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.918829 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80be3338-ebb8-4dd1-8545-0fcdf56b9ef3-config\") pod \"console-operator-85b454874b-f285w\" (UID: \"80be3338-ebb8-4dd1-8545-0fcdf56b9ef3\") " pod="openshift-console-operator/console-operator-85b454874b-f285w" Sep 08 10:56:41.919063 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:41.918926 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 08 10:56:41.919063 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:41.919012 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e149ccac-29e4-4805-9c68-36fdcdd8a649-cluster-monitoring-operator-tls podName:e149ccac-29e4-4805-9c68-36fdcdd8a649 nodeName:}" failed. No retries permitted until 2026-09-08 10:56:42.418990772 +0000 UTC m=+43.051586247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e149ccac-29e4-4805-9c68-36fdcdd8a649-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-s4z4b" (UID: "e149ccac-29e4-4805-9c68-36fdcdd8a649") : secret "cluster-monitoring-operator-tls" not found Sep 08 10:56:41.919624 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.919487 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80be3338-ebb8-4dd1-8545-0fcdf56b9ef3-config\") pod \"console-operator-85b454874b-f285w\" (UID: \"80be3338-ebb8-4dd1-8545-0fcdf56b9ef3\") " pod="openshift-console-operator/console-operator-85b454874b-f285w" Sep 08 10:56:41.919624 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.919570 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dae2c429-76f0-472c-bd1e-ab2f6b9e96f1-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nsrxz\" (UID: \"dae2c429-76f0-472c-bd1e-ab2f6b9e96f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nsrxz" Sep 08 10:56:41.919786 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:41.919722 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 08 10:56:41.919786 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:41.919785 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dae2c429-76f0-472c-bd1e-ab2f6b9e96f1-samples-operator-tls podName:dae2c429-76f0-472c-bd1e-ab2f6b9e96f1 nodeName:}" failed. No retries permitted until 2026-09-08 10:56:42.419768297 +0000 UTC m=+43.052363768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dae2c429-76f0-472c-bd1e-ab2f6b9e96f1-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-nsrxz" (UID: "dae2c429-76f0-472c-bd1e-ab2f6b9e96f1") : secret "samples-operator-tls" not found Sep 08 10:56:41.919898 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.919883 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/49f2f9b9-ad37-448a-bf04-ab22ff6b8fd3-config\") pod \"service-ca-operator-859f94c4b-z7dwr\" (UID: \"49f2f9b9-ad37-448a-bf04-ab22ff6b8fd3\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-z7dwr" Sep 08 10:56:41.920319 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.920269 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80be3338-ebb8-4dd1-8545-0fcdf56b9ef3-trusted-ca\") pod \"console-operator-85b454874b-f285w\" (UID: \"80be3338-ebb8-4dd1-8545-0fcdf56b9ef3\") " pod="openshift-console-operator/console-operator-85b454874b-f285w" Sep 08 10:56:41.920480 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.920445 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e149ccac-29e4-4805-9c68-36fdcdd8a649-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-s4z4b\" (UID: \"e149ccac-29e4-4805-9c68-36fdcdd8a649\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-s4z4b" Sep 08 10:56:41.921694 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.921669 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/49f2f9b9-ad37-448a-bf04-ab22ff6b8fd3-serving-cert\") pod \"service-ca-operator-859f94c4b-z7dwr\" (UID: \"49f2f9b9-ad37-448a-bf04-ab22ff6b8fd3\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-z7dwr" Sep 08 10:56:41.922122 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.922100 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80be3338-ebb8-4dd1-8545-0fcdf56b9ef3-serving-cert\") pod \"console-operator-85b454874b-f285w\" (UID: \"80be3338-ebb8-4dd1-8545-0fcdf56b9ef3\") " pod="openshift-console-operator/console-operator-85b454874b-f285w" Sep 08 10:56:41.930668 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.930645 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dqcq\" (UniqueName: \"kubernetes.io/projected/49f2f9b9-ad37-448a-bf04-ab22ff6b8fd3-kube-api-access-8dqcq\") pod \"service-ca-operator-859f94c4b-z7dwr\" (UID: \"49f2f9b9-ad37-448a-bf04-ab22ff6b8fd3\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-z7dwr" Sep 08 10:56:41.930957 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.930934 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svkr4\" (UniqueName: \"kubernetes.io/projected/80be3338-ebb8-4dd1-8545-0fcdf56b9ef3-kube-api-access-svkr4\") pod \"console-operator-85b454874b-f285w\" (UID: \"80be3338-ebb8-4dd1-8545-0fcdf56b9ef3\") " pod="openshift-console-operator/console-operator-85b454874b-f285w" Sep 08 10:56:41.931410 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.931359 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9r9w\" (UniqueName: \"kubernetes.io/projected/e149ccac-29e4-4805-9c68-36fdcdd8a649-kube-api-access-l9r9w\") pod \"cluster-monitoring-operator-6cdcc96965-s4z4b\" (UID: \"e149ccac-29e4-4805-9c68-36fdcdd8a649\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-s4z4b" Sep 08 10:56:41.932151 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.932081 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85pcr\" (UniqueName: \"kubernetes.io/projected/dae2c429-76f0-472c-bd1e-ab2f6b9e96f1-kube-api-access-85pcr\") pod \"cluster-samples-operator-7cdcfcf76c-nsrxz\" (UID: \"dae2c429-76f0-472c-bd1e-ab2f6b9e96f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nsrxz" Sep 08 10:56:41.949543 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.949477 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-h8954" Sep 08 10:56:41.951924 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.951874 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:41.974071 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:41.974035 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-z7dwr" Sep 08 10:56:42.062405 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:42.062375 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-f285w" Sep 08 10:56:42.156345 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:42.156315 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-q6mzn"] Sep 08 10:56:42.159120 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:56:42.159089 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c8bcb6a_6008_4e01_8647_ad956f48a346.slice/crio-ce0887565ec12e691f30467264ecfa30646b01730da763e5aef0e6141aa5ef99 WatchSource:0}: Error finding container ce0887565ec12e691f30467264ecfa30646b01730da763e5aef0e6141aa5ef99: Status 404 returned error can't find the container with id ce0887565ec12e691f30467264ecfa30646b01730da763e5aef0e6141aa5ef99 Sep 08 10:56:42.253513 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:42.253484 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-h8954"] Sep 08 10:56:42.256282 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:56:42.256260 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbb4fbf0_e68e_4657_bcc1_76eaa1ed729b.slice/crio-7e36a8625c0a3a421ae08f16593433935290a515c14323f547f86c2a39c44c4d WatchSource:0}: Error finding container 7e36a8625c0a3a421ae08f16593433935290a515c14323f547f86c2a39c44c4d: Status 404 returned error can't find the container with id 7e36a8625c0a3a421ae08f16593433935290a515c14323f547f86c2a39c44c4d Sep 08 10:56:42.279933 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:42.279868 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-z7dwr"] Sep 08 10:56:42.283013 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:56:42.282981 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49f2f9b9_ad37_448a_bf04_ab22ff6b8fd3.slice/crio-8063179c9991c225d1406abf2748d5559a6ee8d7a6a39ba48ab0798a268e4b69 WatchSource:0}: Error finding container 8063179c9991c225d1406abf2748d5559a6ee8d7a6a39ba48ab0798a268e4b69: Status 404 returned error can't find the container with id 8063179c9991c225d1406abf2748d5559a6ee8d7a6a39ba48ab0798a268e4b69 Sep 08 10:56:42.350491 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:42.350460 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-f285w"] Sep 08 10:56:42.353018 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:56:42.352995 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80be3338_ebb8_4dd1_8545_0fcdf56b9ef3.slice/crio-5674c91e61fd3ed0ee4058fbac1d817207dcffd00d71f0162e3ca8856d167234 WatchSource:0}: Error finding container 5674c91e61fd3ed0ee4058fbac1d817207dcffd00d71f0162e3ca8856d167234: Status 404 returned error can't find the container with id 5674c91e61fd3ed0ee4058fbac1d817207dcffd00d71f0162e3ca8856d167234 Sep 08 10:56:42.423672 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:42.423628 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e149ccac-29e4-4805-9c68-36fdcdd8a649-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-s4z4b\" (UID: \"e149ccac-29e4-4805-9c68-36fdcdd8a649\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-s4z4b" Sep 08 10:56:42.423863 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:42.423691 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dae2c429-76f0-472c-bd1e-ab2f6b9e96f1-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nsrxz\" (UID: \"dae2c429-76f0-472c-bd1e-ab2f6b9e96f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nsrxz" Sep 08 10:56:42.423863 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:42.423784 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 08 10:56:42.423863 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:42.423854 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e149ccac-29e4-4805-9c68-36fdcdd8a649-cluster-monitoring-operator-tls podName:e149ccac-29e4-4805-9c68-36fdcdd8a649 nodeName:}" failed. No retries permitted until 2026-09-08 10:56:43.423836798 +0000 UTC m=+44.056432270 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e149ccac-29e4-4805-9c68-36fdcdd8a649-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-s4z4b" (UID: "e149ccac-29e4-4805-9c68-36fdcdd8a649") : secret "cluster-monitoring-operator-tls" not found Sep 08 10:56:42.424007 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:42.423870 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 08 10:56:42.424007 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:42.423928 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dae2c429-76f0-472c-bd1e-ab2f6b9e96f1-samples-operator-tls podName:dae2c429-76f0-472c-bd1e-ab2f6b9e96f1 nodeName:}" failed. No retries permitted until 2026-09-08 10:56:43.423910991 +0000 UTC m=+44.056506473 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dae2c429-76f0-472c-bd1e-ab2f6b9e96f1-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-nsrxz" (UID: "dae2c429-76f0-472c-bd1e-ab2f6b9e96f1") : secret "samples-operator-tls" not found Sep 08 10:56:43.116766 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.116691 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-z7dwr" event={"ID":"49f2f9b9-ad37-448a-bf04-ab22ff6b8fd3","Type":"ContainerStarted","Data":"8063179c9991c225d1406abf2748d5559a6ee8d7a6a39ba48ab0798a268e4b69"} Sep 08 10:56:43.118498 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.118463 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-q6mzn" event={"ID":"5c8bcb6a-6008-4e01-8647-ad956f48a346","Type":"ContainerStarted","Data":"ce0887565ec12e691f30467264ecfa30646b01730da763e5aef0e6141aa5ef99"} Sep 08 10:56:43.119933 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.119907 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-h8954" event={"ID":"dbb4fbf0-e68e-4657-bcc1-76eaa1ed729b","Type":"ContainerStarted","Data":"7e36a8625c0a3a421ae08f16593433935290a515c14323f547f86c2a39c44c4d"} Sep 08 10:56:43.121086 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.121062 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-f285w" event={"ID":"80be3338-ebb8-4dd1-8545-0fcdf56b9ef3","Type":"ContainerStarted","Data":"5674c91e61fd3ed0ee4058fbac1d817207dcffd00d71f0162e3ca8856d167234"} Sep 08 10:56:43.324056 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.324018 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b4f945f56-dwd8z"] Sep 08 10:56:43.352335 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.352296 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b4f945f56-dwd8z"] Sep 08 10:56:43.352506 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.352359 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:56:43.356096 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.355538 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 08 10:56:43.356096 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.355786 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7lxng\"" Sep 08 10:56:43.356096 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.355941 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 08 10:56:43.357196 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.356560 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 08 10:56:43.365139 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.365114 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 08 10:56:43.431479 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.431392 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-bound-sa-token\") pod \"image-registry-5b4f945f56-dwd8z\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:56:43.431653 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.431573 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/84deda8f-2d13-4d89-88a2-1c6891b11d5a-image-registry-private-configuration\") pod \"image-registry-5b4f945f56-dwd8z\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:56:43.431653 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.431609 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/84deda8f-2d13-4d89-88a2-1c6891b11d5a-registry-certificates\") pod \"image-registry-5b4f945f56-dwd8z\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:56:43.431653 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.431644 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e149ccac-29e4-4805-9c68-36fdcdd8a649-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-s4z4b\" (UID: \"e149ccac-29e4-4805-9c68-36fdcdd8a649\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-s4z4b" Sep 08 10:56:43.431809 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.431671 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/84deda8f-2d13-4d89-88a2-1c6891b11d5a-installation-pull-secrets\") pod \"image-registry-5b4f945f56-dwd8z\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:56:43.431809 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.431696 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwqxs\" (UniqueName: \"kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-kube-api-access-rwqxs\") pod \"image-registry-5b4f945f56-dwd8z\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:56:43.431809 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.431751 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-registry-tls\") pod \"image-registry-5b4f945f56-dwd8z\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:56:43.431809 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:43.431766 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 08 10:56:43.431809 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.431785 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dae2c429-76f0-472c-bd1e-ab2f6b9e96f1-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nsrxz\" (UID: \"dae2c429-76f0-472c-bd1e-ab2f6b9e96f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nsrxz" Sep 08 10:56:43.432044 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.431809 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/84deda8f-2d13-4d89-88a2-1c6891b11d5a-trusted-ca\") pod \"image-registry-5b4f945f56-dwd8z\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:56:43.432044 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:43.431851 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e149ccac-29e4-4805-9c68-36fdcdd8a649-cluster-monitoring-operator-tls podName:e149ccac-29e4-4805-9c68-36fdcdd8a649 nodeName:}" failed. No retries permitted until 2026-09-08 10:56:45.431829334 +0000 UTC m=+46.064424792 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e149ccac-29e4-4805-9c68-36fdcdd8a649-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-s4z4b" (UID: "e149ccac-29e4-4805-9c68-36fdcdd8a649") : secret "cluster-monitoring-operator-tls" not found Sep 08 10:56:43.432044 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.431872 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/84deda8f-2d13-4d89-88a2-1c6891b11d5a-ca-trust-extracted\") pod \"image-registry-5b4f945f56-dwd8z\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:56:43.432044 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:43.431952 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 08 10:56:43.432044 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:43.432003 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dae2c429-76f0-472c-bd1e-ab2f6b9e96f1-samples-operator-tls podName:dae2c429-76f0-472c-bd1e-ab2f6b9e96f1 nodeName:}" failed. No retries permitted until 2026-09-08 10:56:45.431987358 +0000 UTC m=+46.064582831 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dae2c429-76f0-472c-bd1e-ab2f6b9e96f1-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-nsrxz" (UID: "dae2c429-76f0-472c-bd1e-ab2f6b9e96f1") : secret "samples-operator-tls" not found Sep 08 10:56:43.533582 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.532893 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/84deda8f-2d13-4d89-88a2-1c6891b11d5a-installation-pull-secrets\") pod \"image-registry-5b4f945f56-dwd8z\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:56:43.533582 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.532960 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwqxs\" (UniqueName: \"kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-kube-api-access-rwqxs\") pod \"image-registry-5b4f945f56-dwd8z\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:56:43.533582 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.533027 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-registry-tls\") pod \"image-registry-5b4f945f56-dwd8z\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:56:43.533582 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.533068 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/84deda8f-2d13-4d89-88a2-1c6891b11d5a-trusted-ca\") pod \"image-registry-5b4f945f56-dwd8z\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:56:43.533582 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.533098 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/84deda8f-2d13-4d89-88a2-1c6891b11d5a-ca-trust-extracted\") pod \"image-registry-5b4f945f56-dwd8z\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:56:43.533582 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.533126 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-bound-sa-token\") pod \"image-registry-5b4f945f56-dwd8z\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:56:43.533582 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:43.533200 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 10:56:43.533582 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:43.533222 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b4f945f56-dwd8z: secret "image-registry-tls" not found Sep 08 10:56:43.533582 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.533243 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/84deda8f-2d13-4d89-88a2-1c6891b11d5a-image-registry-private-configuration\") pod \"image-registry-5b4f945f56-dwd8z\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:56:43.533582 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:43.533281 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-registry-tls podName:84deda8f-2d13-4d89-88a2-1c6891b11d5a nodeName:}" failed. No retries permitted until 2026-09-08 10:56:44.03325952 +0000 UTC m=+44.665854979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-registry-tls") pod "image-registry-5b4f945f56-dwd8z" (UID: "84deda8f-2d13-4d89-88a2-1c6891b11d5a") : secret "image-registry-tls" not found Sep 08 10:56:43.533582 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.533302 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/84deda8f-2d13-4d89-88a2-1c6891b11d5a-registry-certificates\") pod \"image-registry-5b4f945f56-dwd8z\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:56:43.533582 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.533597 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/84deda8f-2d13-4d89-88a2-1c6891b11d5a-ca-trust-extracted\") pod \"image-registry-5b4f945f56-dwd8z\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:56:43.534406 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.533818 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/84deda8f-2d13-4d89-88a2-1c6891b11d5a-registry-certificates\") pod \"image-registry-5b4f945f56-dwd8z\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:56:43.534406 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.534394 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/84deda8f-2d13-4d89-88a2-1c6891b11d5a-trusted-ca\") pod \"image-registry-5b4f945f56-dwd8z\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:56:43.535923 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.535897 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/84deda8f-2d13-4d89-88a2-1c6891b11d5a-installation-pull-secrets\") pod \"image-registry-5b4f945f56-dwd8z\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:56:43.537300 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.537257 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/84deda8f-2d13-4d89-88a2-1c6891b11d5a-image-registry-private-configuration\") pod \"image-registry-5b4f945f56-dwd8z\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:56:43.542914 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.542892 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-bound-sa-token\") pod \"image-registry-5b4f945f56-dwd8z\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:56:43.544020 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:43.543998 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwqxs\" (UniqueName: \"kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-kube-api-access-rwqxs\") pod \"image-registry-5b4f945f56-dwd8z\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:56:44.041051 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:44.039370 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a72bab02-fa2c-499a-81be-8bf56c3db578-metrics-tls\") pod \"dns-default-zs2dr\" (UID: \"a72bab02-fa2c-499a-81be-8bf56c3db578\") " pod="openshift-dns/dns-default-zs2dr" Sep 08 10:56:44.041051 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:44.039525 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-registry-tls\") pod \"image-registry-5b4f945f56-dwd8z\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:56:44.041051 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:44.039730 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 10:56:44.041051 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:44.039745 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b4f945f56-dwd8z: secret "image-registry-tls" not found Sep 08 10:56:44.041051 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:44.039823 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-registry-tls podName:84deda8f-2d13-4d89-88a2-1c6891b11d5a nodeName:}" failed. No retries permitted until 2026-09-08 10:56:45.039803799 +0000 UTC m=+45.672399272 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-registry-tls") pod "image-registry-5b4f945f56-dwd8z" (UID: "84deda8f-2d13-4d89-88a2-1c6891b11d5a") : secret "image-registry-tls" not found Sep 08 10:56:44.041051 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:44.040355 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 10:56:44.041051 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:44.040415 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a72bab02-fa2c-499a-81be-8bf56c3db578-metrics-tls podName:a72bab02-fa2c-499a-81be-8bf56c3db578 nodeName:}" failed. No retries permitted until 2026-09-08 10:56:52.040391743 +0000 UTC m=+52.672987212 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a72bab02-fa2c-499a-81be-8bf56c3db578-metrics-tls") pod "dns-default-zs2dr" (UID: "a72bab02-fa2c-499a-81be-8bf56c3db578") : secret "dns-default-metrics-tls" not found Sep 08 10:56:44.126511 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:44.126471 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-q6mzn" event={"ID":"5c8bcb6a-6008-4e01-8647-ad956f48a346","Type":"ContainerStarted","Data":"d5a62dbd021dfb7c9d52dd642a6a1fdd57e36257cb6eea09cb4ad0c207535992"} Sep 08 10:56:44.143131 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:44.143072 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-q6mzn" podStartSLOduration=1.394302321 podStartE2EDuration="3.143057832s" totalImagesPullingTime="1.748755511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:56:44.14266595 +0000 UTC m=+44.775261428" watchObservedRunningTime="2026-09-08 10:56:44.143057832 +0000 UTC m=+44.775653309" Sep 08 10:56:44.268023 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:44.267939 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:44.336733 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:44.336694 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:45.047857 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:45.047808 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-registry-tls\") pod \"image-registry-5b4f945f56-dwd8z\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:56:45.048117 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:45.048003 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 10:56:45.048117 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:45.048027 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b4f945f56-dwd8z: secret "image-registry-tls" not found Sep 08 10:56:45.048240 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:45.048120 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-registry-tls podName:84deda8f-2d13-4d89-88a2-1c6891b11d5a nodeName:}" failed. No retries permitted until 2026-09-08 10:56:47.048087145 +0000 UTC m=+47.680682609 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-registry-tls") pod "image-registry-5b4f945f56-dwd8z" (UID: "84deda8f-2d13-4d89-88a2-1c6891b11d5a") : secret "image-registry-tls" not found Sep 08 10:56:45.451082 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:45.450993 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e149ccac-29e4-4805-9c68-36fdcdd8a649-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-s4z4b\" (UID: \"e149ccac-29e4-4805-9c68-36fdcdd8a649\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-s4z4b" Sep 08 10:56:45.451512 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:45.451088 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dae2c429-76f0-472c-bd1e-ab2f6b9e96f1-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nsrxz\" (UID: \"dae2c429-76f0-472c-bd1e-ab2f6b9e96f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nsrxz" Sep 08 10:56:45.451512 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:45.451158 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 08 10:56:45.451512 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:45.451221 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 08 10:56:45.451512 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:45.451270 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e149ccac-29e4-4805-9c68-36fdcdd8a649-cluster-monitoring-operator-tls podName:e149ccac-29e4-4805-9c68-36fdcdd8a649 nodeName:}" failed. No retries permitted until 2026-09-08 10:56:49.4512525 +0000 UTC m=+50.083847960 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e149ccac-29e4-4805-9c68-36fdcdd8a649-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-s4z4b" (UID: "e149ccac-29e4-4805-9c68-36fdcdd8a649") : secret "cluster-monitoring-operator-tls" not found Sep 08 10:56:45.451512 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:45.451291 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dae2c429-76f0-472c-bd1e-ab2f6b9e96f1-samples-operator-tls podName:dae2c429-76f0-472c-bd1e-ab2f6b9e96f1 nodeName:}" failed. No retries permitted until 2026-09-08 10:56:49.45128079 +0000 UTC m=+50.083876245 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dae2c429-76f0-472c-bd1e-ab2f6b9e96f1-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-nsrxz" (UID: "dae2c429-76f0-472c-bd1e-ab2f6b9e96f1") : secret "samples-operator-tls" not found Sep 08 10:56:46.722209 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.722140 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:46.734710 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.734675 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-dmjqr"] Sep 08 10:56:46.752068 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.752036 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8tnt6"] Sep 08 10:56:46.752307 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.752137 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-dmjqr" Sep 08 10:56:46.755065 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.755036 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-8vj7l\"" Sep 08 10:56:46.755218 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.755135 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 08 10:56:46.755281 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.755036 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 08 10:56:46.773517 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.773486 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-dmjqr"] Sep 08 10:56:46.773693 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.773539 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8tnt6"] Sep 08 10:56:46.773693 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.773661 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8tnt6" Sep 08 10:56:46.776472 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.776448 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 08 10:56:46.776622 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.776609 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 08 10:56:46.776768 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.776757 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 08 10:56:46.776885 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.776875 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 08 10:56:46.777032 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.777021 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pjmvw\"" Sep 08 10:56:46.823852 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.823824 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:46.862840 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.862804 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/efaaf88d-bd00-40fe-830b-98c162d9972f-crio-socket\") pod \"insights-runtime-extractor-8tnt6\" (UID: \"efaaf88d-bd00-40fe-830b-98c162d9972f\") " pod="openshift-insights/insights-runtime-extractor-8tnt6" Sep 08 10:56:46.863036 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.862900 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/efaaf88d-bd00-40fe-830b-98c162d9972f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8tnt6\" (UID: \"efaaf88d-bd00-40fe-830b-98c162d9972f\") " pod="openshift-insights/insights-runtime-extractor-8tnt6" Sep 08 10:56:46.863036 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.862937 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/efaaf88d-bd00-40fe-830b-98c162d9972f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8tnt6\" (UID: \"efaaf88d-bd00-40fe-830b-98c162d9972f\") " pod="openshift-insights/insights-runtime-extractor-8tnt6" Sep 08 10:56:46.863036 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.863002 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcpbj\" (UniqueName: \"kubernetes.io/projected/efaaf88d-bd00-40fe-830b-98c162d9972f-kube-api-access-jcpbj\") pod \"insights-runtime-extractor-8tnt6\" (UID: \"efaaf88d-bd00-40fe-830b-98c162d9972f\") " pod="openshift-insights/insights-runtime-extractor-8tnt6" Sep 08 10:56:46.863158 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.863121 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pnh7\" (UniqueName: \"kubernetes.io/projected/02e5b88d-b3d5-4bd8-a6d0-c4c4e4fb4c95-kube-api-access-4pnh7\") pod \"migrator-fdbb8fdff-dmjqr\" (UID: \"02e5b88d-b3d5-4bd8-a6d0-c4c4e4fb4c95\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-dmjqr" Sep 08 10:56:46.863158 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.863143 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/efaaf88d-bd00-40fe-830b-98c162d9972f-data-volume\") pod \"insights-runtime-extractor-8tnt6\" (UID: \"efaaf88d-bd00-40fe-830b-98c162d9972f\") " pod="openshift-insights/insights-runtime-extractor-8tnt6" Sep 08 10:56:46.918963 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.918924 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:46.963908 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.963867 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcpbj\" (UniqueName: \"kubernetes.io/projected/efaaf88d-bd00-40fe-830b-98c162d9972f-kube-api-access-jcpbj\") pod \"insights-runtime-extractor-8tnt6\" (UID: \"efaaf88d-bd00-40fe-830b-98c162d9972f\") " pod="openshift-insights/insights-runtime-extractor-8tnt6" Sep 08 10:56:46.964095 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.963919 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pnh7\" (UniqueName: \"kubernetes.io/projected/02e5b88d-b3d5-4bd8-a6d0-c4c4e4fb4c95-kube-api-access-4pnh7\") pod \"migrator-fdbb8fdff-dmjqr\" (UID: \"02e5b88d-b3d5-4bd8-a6d0-c4c4e4fb4c95\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-dmjqr" Sep 08 10:56:46.964095 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.963943 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/efaaf88d-bd00-40fe-830b-98c162d9972f-data-volume\") pod \"insights-runtime-extractor-8tnt6\" (UID: \"efaaf88d-bd00-40fe-830b-98c162d9972f\") " pod="openshift-insights/insights-runtime-extractor-8tnt6" Sep 08 10:56:46.964095 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.963997 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/efaaf88d-bd00-40fe-830b-98c162d9972f-crio-socket\") pod \"insights-runtime-extractor-8tnt6\" (UID: \"efaaf88d-bd00-40fe-830b-98c162d9972f\") " pod="openshift-insights/insights-runtime-extractor-8tnt6" Sep 08 10:56:46.964095 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.964041 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/efaaf88d-bd00-40fe-830b-98c162d9972f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8tnt6\" (UID: \"efaaf88d-bd00-40fe-830b-98c162d9972f\") " pod="openshift-insights/insights-runtime-extractor-8tnt6" Sep 08 10:56:46.964095 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.964068 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/efaaf88d-bd00-40fe-830b-98c162d9972f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8tnt6\" (UID: \"efaaf88d-bd00-40fe-830b-98c162d9972f\") " pod="openshift-insights/insights-runtime-extractor-8tnt6" Sep 08 10:56:46.964354 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:46.964207 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 10:56:46.964354 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:46.964217 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 10:56:46.964354 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:46.964281 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/efaaf88d-bd00-40fe-830b-98c162d9972f-kube-rbac-proxy-cm podName:efaaf88d-bd00-40fe-830b-98c162d9972f nodeName:}" failed. No retries permitted until 2026-09-08 10:56:47.464260698 +0000 UTC m=+48.096856176 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/efaaf88d-bd00-40fe-830b-98c162d9972f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8tnt6" (UID: "efaaf88d-bd00-40fe-830b-98c162d9972f") : configmap "kube-rbac-proxy" not found Sep 08 10:56:46.964354 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.964280 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/efaaf88d-bd00-40fe-830b-98c162d9972f-crio-socket\") pod \"insights-runtime-extractor-8tnt6\" (UID: \"efaaf88d-bd00-40fe-830b-98c162d9972f\") " pod="openshift-insights/insights-runtime-extractor-8tnt6" Sep 08 10:56:46.964354 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:46.964300 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efaaf88d-bd00-40fe-830b-98c162d9972f-insights-runtime-extractor-tls podName:efaaf88d-bd00-40fe-830b-98c162d9972f nodeName:}" failed. No retries permitted until 2026-09-08 10:56:47.464290689 +0000 UTC m=+48.096886193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/efaaf88d-bd00-40fe-830b-98c162d9972f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8tnt6" (UID: "efaaf88d-bd00-40fe-830b-98c162d9972f") : secret "insights-runtime-extractor-tls" not found Sep 08 10:56:46.964515 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.964395 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/efaaf88d-bd00-40fe-830b-98c162d9972f-data-volume\") pod \"insights-runtime-extractor-8tnt6\" (UID: \"efaaf88d-bd00-40fe-830b-98c162d9972f\") " pod="openshift-insights/insights-runtime-extractor-8tnt6" Sep 08 10:56:46.973680 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.973612 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pnh7\" (UniqueName: \"kubernetes.io/projected/02e5b88d-b3d5-4bd8-a6d0-c4c4e4fb4c95-kube-api-access-4pnh7\") pod \"migrator-fdbb8fdff-dmjqr\" (UID: \"02e5b88d-b3d5-4bd8-a6d0-c4c4e4fb4c95\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-dmjqr" Sep 08 10:56:46.973680 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:46.973656 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcpbj\" (UniqueName: \"kubernetes.io/projected/efaaf88d-bd00-40fe-830b-98c162d9972f-kube-api-access-jcpbj\") pod \"insights-runtime-extractor-8tnt6\" (UID: \"efaaf88d-bd00-40fe-830b-98c162d9972f\") " pod="openshift-insights/insights-runtime-extractor-8tnt6" Sep 08 10:56:47.019183 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:47.019095 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:47.065253 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:47.065216 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-registry-tls\") pod \"image-registry-5b4f945f56-dwd8z\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:56:47.065430 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:47.065369 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-dmjqr" Sep 08 10:56:47.065430 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:47.065410 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 10:56:47.065505 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:47.065432 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b4f945f56-dwd8z: secret "image-registry-tls" not found Sep 08 10:56:47.065535 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:47.065508 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-registry-tls podName:84deda8f-2d13-4d89-88a2-1c6891b11d5a nodeName:}" failed. No retries permitted until 2026-09-08 10:56:51.065485513 +0000 UTC m=+51.698080973 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-registry-tls") pod "image-registry-5b4f945f56-dwd8z" (UID: "84deda8f-2d13-4d89-88a2-1c6891b11d5a") : secret "image-registry-tls" not found Sep 08 10:56:47.136205 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:47.136151 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-h8954" event={"ID":"dbb4fbf0-e68e-4657-bcc1-76eaa1ed729b","Type":"ContainerStarted","Data":"4010b3a317f25a12e4abe690455457b2af46c064f83b4089d5871d86ac80abfe"} Sep 08 10:56:47.137957 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:47.137940 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f285w_80be3338-ebb8-4dd1-8545-0fcdf56b9ef3/console-operator/0.log" Sep 08 10:56:47.138068 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:47.137977 2560 generic.go:356] "Generic (PLEG): container finished" podID="80be3338-ebb8-4dd1-8545-0fcdf56b9ef3" containerID="503b0e420592912eb39d4f97460be0c5fe16ed0e836d7cdb73c9770a513e5a0e" exitCode=255 Sep 08 10:56:47.138068 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:47.138010 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-f285w" event={"ID":"80be3338-ebb8-4dd1-8545-0fcdf56b9ef3","Type":"ContainerDied","Data":"503b0e420592912eb39d4f97460be0c5fe16ed0e836d7cdb73c9770a513e5a0e"} Sep 08 10:56:47.138246 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:47.138232 2560 scope.go:117] "RemoveContainer" containerID="503b0e420592912eb39d4f97460be0c5fe16ed0e836d7cdb73c9770a513e5a0e" Sep 08 10:56:47.155953 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:47.154948 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-h8954" podStartSLOduration=2.211442884 podStartE2EDuration="6.15492608s" totalImagesPullingTime="3.943483196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:56:47.153214537 +0000 UTC m=+47.785810018" watchObservedRunningTime="2026-09-08 10:56:47.15492608 +0000 UTC m=+47.787521560" Sep 08 10:56:47.365617 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:47.365583 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-dmjqr"] Sep 08 10:56:47.384258 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:56:47.384219 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02e5b88d_b3d5_4bd8_a6d0_c4c4e4fb4c95.slice/crio-4f421c2e5d300c79d481128b5b741e6e509c825da75a4ae2297d7732533a046b WatchSource:0}: Error finding container 4f421c2e5d300c79d481128b5b741e6e509c825da75a4ae2297d7732533a046b: Status 404 returned error can't find the container with id 4f421c2e5d300c79d481128b5b741e6e509c825da75a4ae2297d7732533a046b Sep 08 10:56:47.472661 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:47.472503 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/efaaf88d-bd00-40fe-830b-98c162d9972f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8tnt6\" (UID: \"efaaf88d-bd00-40fe-830b-98c162d9972f\") " pod="openshift-insights/insights-runtime-extractor-8tnt6" Sep 08 10:56:47.472661 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:47.472568 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/efaaf88d-bd00-40fe-830b-98c162d9972f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8tnt6\" (UID: \"efaaf88d-bd00-40fe-830b-98c162d9972f\") " pod="openshift-insights/insights-runtime-extractor-8tnt6" Sep 08 10:56:47.472661 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:47.472618 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 10:56:47.472929 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:47.472707 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/efaaf88d-bd00-40fe-830b-98c162d9972f-kube-rbac-proxy-cm podName:efaaf88d-bd00-40fe-830b-98c162d9972f nodeName:}" failed. No retries permitted until 2026-09-08 10:56:48.472684132 +0000 UTC m=+49.105279606 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/efaaf88d-bd00-40fe-830b-98c162d9972f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8tnt6" (UID: "efaaf88d-bd00-40fe-830b-98c162d9972f") : configmap "kube-rbac-proxy" not found Sep 08 10:56:47.472929 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:47.472737 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 10:56:47.472929 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:47.472791 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efaaf88d-bd00-40fe-830b-98c162d9972f-insights-runtime-extractor-tls podName:efaaf88d-bd00-40fe-830b-98c162d9972f nodeName:}" failed. No retries permitted until 2026-09-08 10:56:48.472772529 +0000 UTC m=+49.105368188 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/efaaf88d-bd00-40fe-830b-98c162d9972f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8tnt6" (UID: "efaaf88d-bd00-40fe-830b-98c162d9972f") : secret "insights-runtime-extractor-tls" not found Sep 08 10:56:48.142180 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:48.142126 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-dmjqr" event={"ID":"02e5b88d-b3d5-4bd8-a6d0-c4c4e4fb4c95","Type":"ContainerStarted","Data":"4f421c2e5d300c79d481128b5b741e6e509c825da75a4ae2297d7732533a046b"} Sep 08 10:56:48.143735 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:48.143718 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f285w_80be3338-ebb8-4dd1-8545-0fcdf56b9ef3/console-operator/1.log" Sep 08 10:56:48.144148 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:48.144134 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f285w_80be3338-ebb8-4dd1-8545-0fcdf56b9ef3/console-operator/0.log" Sep 08 10:56:48.144231 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:48.144185 2560 generic.go:356] "Generic (PLEG): container finished" podID="80be3338-ebb8-4dd1-8545-0fcdf56b9ef3" containerID="85a2236e3dab4e1272fea9f307f1408605356db08ff0cea3f0e41c25cee2cbb6" exitCode=255 Sep 08 10:56:48.144282 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:48.144247 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-f285w" event={"ID":"80be3338-ebb8-4dd1-8545-0fcdf56b9ef3","Type":"ContainerDied","Data":"85a2236e3dab4e1272fea9f307f1408605356db08ff0cea3f0e41c25cee2cbb6"} Sep 08 10:56:48.144335 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:48.144285 2560 scope.go:117] "RemoveContainer" containerID="503b0e420592912eb39d4f97460be0c5fe16ed0e836d7cdb73c9770a513e5a0e" Sep 08 10:56:48.144519 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:48.144500 2560 scope.go:117] "RemoveContainer" containerID="85a2236e3dab4e1272fea9f307f1408605356db08ff0cea3f0e41c25cee2cbb6" Sep 08 10:56:48.144693 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:48.144672 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-f285w_openshift-console-operator(80be3338-ebb8-4dd1-8545-0fcdf56b9ef3)\"" pod="openshift-console-operator/console-operator-85b454874b-f285w" podUID="80be3338-ebb8-4dd1-8545-0fcdf56b9ef3" Sep 08 10:56:48.461157 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:48.461132 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wfrtm_984def62-1940-433d-83c1-b241c0f5cfa5/dns-node-resolver/0.log" Sep 08 10:56:48.482558 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:48.482529 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/efaaf88d-bd00-40fe-830b-98c162d9972f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8tnt6\" (UID: \"efaaf88d-bd00-40fe-830b-98c162d9972f\") " pod="openshift-insights/insights-runtime-extractor-8tnt6" Sep 08 10:56:48.482558 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:48.482570 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/efaaf88d-bd00-40fe-830b-98c162d9972f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8tnt6\" (UID: \"efaaf88d-bd00-40fe-830b-98c162d9972f\") " pod="openshift-insights/insights-runtime-extractor-8tnt6" Sep 08 10:56:48.482761 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:48.482659 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 10:56:48.482761 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:48.482689 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 10:56:48.482761 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:48.482725 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/efaaf88d-bd00-40fe-830b-98c162d9972f-kube-rbac-proxy-cm podName:efaaf88d-bd00-40fe-830b-98c162d9972f nodeName:}" failed. No retries permitted until 2026-09-08 10:56:50.482706648 +0000 UTC m=+51.115302125 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/efaaf88d-bd00-40fe-830b-98c162d9972f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8tnt6" (UID: "efaaf88d-bd00-40fe-830b-98c162d9972f") : configmap "kube-rbac-proxy" not found Sep 08 10:56:48.482761 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:48.482742 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efaaf88d-bd00-40fe-830b-98c162d9972f-insights-runtime-extractor-tls podName:efaaf88d-bd00-40fe-830b-98c162d9972f nodeName:}" failed. No retries permitted until 2026-09-08 10:56:50.48273402 +0000 UTC m=+51.115329477 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/efaaf88d-bd00-40fe-830b-98c162d9972f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8tnt6" (UID: "efaaf88d-bd00-40fe-830b-98c162d9972f") : secret "insights-runtime-extractor-tls" not found Sep 08 10:56:49.151466 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:49.151440 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f285w_80be3338-ebb8-4dd1-8545-0fcdf56b9ef3/console-operator/1.log" Sep 08 10:56:49.151928 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:49.151873 2560 scope.go:117] "RemoveContainer" containerID="85a2236e3dab4e1272fea9f307f1408605356db08ff0cea3f0e41c25cee2cbb6" Sep 08 10:56:49.152078 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:49.152055 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-f285w_openshift-console-operator(80be3338-ebb8-4dd1-8545-0fcdf56b9ef3)\"" pod="openshift-console-operator/console-operator-85b454874b-f285w" podUID="80be3338-ebb8-4dd1-8545-0fcdf56b9ef3" Sep 08 10:56:49.153020 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:49.152997 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-z7dwr" event={"ID":"49f2f9b9-ad37-448a-bf04-ab22ff6b8fd3","Type":"ContainerStarted","Data":"f8e04fb080c67d58d6fcaa1e378f510dc993fbbe8fe5f6c18c5ace03f8c09111"} Sep 08 10:56:49.184518 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:49.184471 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-z7dwr" podStartSLOduration=2.072008152 podStartE2EDuration="8.184454246s" totalImagesPullingTime="6.112446094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:56:49.183584831 +0000 UTC m=+49.816180309" watchObservedRunningTime="2026-09-08 10:56:49.184454246 +0000 UTC m=+49.817049723" Sep 08 10:56:49.461346 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:49.461264 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wx4r8_eb5352bc-dbdc-4c6c-a20a-62c87a1e446f/node-ca/0.log" Sep 08 10:56:49.491826 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:49.491782 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e149ccac-29e4-4805-9c68-36fdcdd8a649-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-s4z4b\" (UID: \"e149ccac-29e4-4805-9c68-36fdcdd8a649\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-s4z4b" Sep 08 10:56:49.491980 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:49.491954 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 08 10:56:49.492022 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:49.492014 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e149ccac-29e4-4805-9c68-36fdcdd8a649-cluster-monitoring-operator-tls podName:e149ccac-29e4-4805-9c68-36fdcdd8a649 nodeName:}" failed. No retries permitted until 2026-09-08 10:56:57.491998197 +0000 UTC m=+58.124593658 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e149ccac-29e4-4805-9c68-36fdcdd8a649-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-s4z4b" (UID: "e149ccac-29e4-4805-9c68-36fdcdd8a649") : secret "cluster-monitoring-operator-tls" not found Sep 08 10:56:49.492077 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:49.491955 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dae2c429-76f0-472c-bd1e-ab2f6b9e96f1-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nsrxz\" (UID: \"dae2c429-76f0-472c-bd1e-ab2f6b9e96f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nsrxz" Sep 08 10:56:49.492077 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:49.492043 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 08 10:56:49.492145 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:49.492095 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dae2c429-76f0-472c-bd1e-ab2f6b9e96f1-samples-operator-tls podName:dae2c429-76f0-472c-bd1e-ab2f6b9e96f1 nodeName:}" failed. No retries permitted until 2026-09-08 10:56:57.492077868 +0000 UTC m=+58.124673348 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dae2c429-76f0-472c-bd1e-ab2f6b9e96f1-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-nsrxz" (UID: "dae2c429-76f0-472c-bd1e-ab2f6b9e96f1") : secret "samples-operator-tls" not found Sep 08 10:56:49.793866 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:49.793836 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:49.898406 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:49.898348 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:50.157872 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:50.157791 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-dmjqr" event={"ID":"02e5b88d-b3d5-4bd8-a6d0-c4c4e4fb4c95","Type":"ContainerStarted","Data":"4f7c5db5168be0a6a4845ee0add45caefce58bbf57377b18a7d8a01b258549ed"} Sep 08 10:56:50.157872 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:50.157852 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-dmjqr" event={"ID":"02e5b88d-b3d5-4bd8-a6d0-c4c4e4fb4c95","Type":"ContainerStarted","Data":"0297a089491dc2890c7f06dc9ddd7f0b8c74e5e26522e02b7a8464fd87238571"} Sep 08 10:56:50.176696 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:50.176643 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-dmjqr" podStartSLOduration=2.274995301 podStartE2EDuration="4.17662647s" totalImagesPullingTime="1.901631169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:56:50.175305373 +0000 UTC m=+50.807900850" watchObservedRunningTime="2026-09-08 10:56:50.17662647 +0000 UTC m=+50.809221947" Sep 08 10:56:50.238510 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:50.238469 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:50.261406 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:50.261377 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xm8x2_8317d8ea-1acd-4ad7-870b-7eb5476f4151/serve-healthcheck-canary/0.log" Sep 08 10:56:50.502111 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:50.502039 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/efaaf88d-bd00-40fe-830b-98c162d9972f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8tnt6\" (UID: \"efaaf88d-bd00-40fe-830b-98c162d9972f\") " pod="openshift-insights/insights-runtime-extractor-8tnt6" Sep 08 10:56:50.502111 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:50.502074 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/efaaf88d-bd00-40fe-830b-98c162d9972f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8tnt6\" (UID: \"efaaf88d-bd00-40fe-830b-98c162d9972f\") " pod="openshift-insights/insights-runtime-extractor-8tnt6" Sep 08 10:56:50.502325 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:50.502158 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 10:56:50.502325 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:50.502245 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/efaaf88d-bd00-40fe-830b-98c162d9972f-kube-rbac-proxy-cm podName:efaaf88d-bd00-40fe-830b-98c162d9972f nodeName:}" failed. No retries permitted until 2026-09-08 10:56:54.502228791 +0000 UTC m=+55.134824246 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/efaaf88d-bd00-40fe-830b-98c162d9972f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8tnt6" (UID: "efaaf88d-bd00-40fe-830b-98c162d9972f") : configmap "kube-rbac-proxy" not found Sep 08 10:56:50.502325 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:50.502268 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 10:56:50.502325 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:50.502319 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efaaf88d-bd00-40fe-830b-98c162d9972f-insights-runtime-extractor-tls podName:efaaf88d-bd00-40fe-830b-98c162d9972f nodeName:}" failed. No retries permitted until 2026-09-08 10:56:54.502302516 +0000 UTC m=+55.134897990 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/efaaf88d-bd00-40fe-830b-98c162d9972f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8tnt6" (UID: "efaaf88d-bd00-40fe-830b-98c162d9972f") : secret "insights-runtime-extractor-tls" not found Sep 08 10:56:51.105817 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:51.105782 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-registry-tls\") pod \"image-registry-5b4f945f56-dwd8z\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:56:51.106011 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:51.105957 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 10:56:51.106011 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:51.105980 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b4f945f56-dwd8z: secret "image-registry-tls" not found Sep 08 10:56:51.106143 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:51.106034 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-registry-tls podName:84deda8f-2d13-4d89-88a2-1c6891b11d5a nodeName:}" failed. No retries permitted until 2026-09-08 10:56:59.106018821 +0000 UTC m=+59.738614280 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-registry-tls") pod "image-registry-5b4f945f56-dwd8z" (UID: "84deda8f-2d13-4d89-88a2-1c6891b11d5a") : secret "image-registry-tls" not found Sep 08 10:56:52.062839 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:52.062797 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-f285w" Sep 08 10:56:52.063309 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:52.062862 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-f285w" Sep 08 10:56:52.063309 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:52.063199 2560 scope.go:117] "RemoveContainer" containerID="85a2236e3dab4e1272fea9f307f1408605356db08ff0cea3f0e41c25cee2cbb6" Sep 08 10:56:52.063377 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:52.063349 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-f285w_openshift-console-operator(80be3338-ebb8-4dd1-8545-0fcdf56b9ef3)\"" pod="openshift-console-operator/console-operator-85b454874b-f285w" podUID="80be3338-ebb8-4dd1-8545-0fcdf56b9ef3" Sep 08 10:56:52.113186 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:52.113140 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a72bab02-fa2c-499a-81be-8bf56c3db578-metrics-tls\") pod \"dns-default-zs2dr\" (UID: \"a72bab02-fa2c-499a-81be-8bf56c3db578\") " pod="openshift-dns/dns-default-zs2dr" Sep 08 10:56:52.113357 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:52.113305 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 10:56:52.113442 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:52.113376 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a72bab02-fa2c-499a-81be-8bf56c3db578-metrics-tls podName:a72bab02-fa2c-499a-81be-8bf56c3db578 nodeName:}" failed. No retries permitted until 2026-09-08 10:57:08.113359917 +0000 UTC m=+68.745955390 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a72bab02-fa2c-499a-81be-8bf56c3db578-metrics-tls") pod "dns-default-zs2dr" (UID: "a72bab02-fa2c-499a-81be-8bf56c3db578") : secret "dns-default-metrics-tls" not found Sep 08 10:56:53.756954 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:53.756901 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:53.855058 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:53.855010 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:54.536413 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:54.536377 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/efaaf88d-bd00-40fe-830b-98c162d9972f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8tnt6\" (UID: \"efaaf88d-bd00-40fe-830b-98c162d9972f\") " pod="openshift-insights/insights-runtime-extractor-8tnt6" Sep 08 10:56:54.536413 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:54.536420 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/efaaf88d-bd00-40fe-830b-98c162d9972f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8tnt6\" (UID: \"efaaf88d-bd00-40fe-830b-98c162d9972f\") " pod="openshift-insights/insights-runtime-extractor-8tnt6" Sep 08 10:56:54.536624 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:54.536504 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 10:56:54.536624 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:54.536545 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 10:56:54.536624 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:54.536582 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/efaaf88d-bd00-40fe-830b-98c162d9972f-kube-rbac-proxy-cm podName:efaaf88d-bd00-40fe-830b-98c162d9972f nodeName:}" failed. No retries permitted until 2026-09-08 10:57:02.536564805 +0000 UTC m=+63.169160261 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/efaaf88d-bd00-40fe-830b-98c162d9972f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8tnt6" (UID: "efaaf88d-bd00-40fe-830b-98c162d9972f") : configmap "kube-rbac-proxy" not found Sep 08 10:56:54.536624 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:54.536599 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efaaf88d-bd00-40fe-830b-98c162d9972f-insights-runtime-extractor-tls podName:efaaf88d-bd00-40fe-830b-98c162d9972f nodeName:}" failed. No retries permitted until 2026-09-08 10:57:02.536588362 +0000 UTC m=+63.169183818 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/efaaf88d-bd00-40fe-830b-98c162d9972f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8tnt6" (UID: "efaaf88d-bd00-40fe-830b-98c162d9972f") : secret "insights-runtime-extractor-tls" not found Sep 08 10:56:56.096530 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:56.096493 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:57.562733 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:57.562693 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e149ccac-29e4-4805-9c68-36fdcdd8a649-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-s4z4b\" (UID: \"e149ccac-29e4-4805-9c68-36fdcdd8a649\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-s4z4b" Sep 08 10:56:57.563267 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:57.562809 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dae2c429-76f0-472c-bd1e-ab2f6b9e96f1-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nsrxz\" (UID: \"dae2c429-76f0-472c-bd1e-ab2f6b9e96f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nsrxz" Sep 08 10:56:57.563267 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:57.562879 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 08 10:56:57.563267 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:57.562964 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e149ccac-29e4-4805-9c68-36fdcdd8a649-cluster-monitoring-operator-tls podName:e149ccac-29e4-4805-9c68-36fdcdd8a649 nodeName:}" failed. No retries permitted until 2026-09-08 10:57:13.562942004 +0000 UTC m=+74.195537474 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e149ccac-29e4-4805-9c68-36fdcdd8a649-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-s4z4b" (UID: "e149ccac-29e4-4805-9c68-36fdcdd8a649") : secret "cluster-monitoring-operator-tls" not found Sep 08 10:56:57.565313 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:57.565297 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dae2c429-76f0-472c-bd1e-ab2f6b9e96f1-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nsrxz\" (UID: \"dae2c429-76f0-472c-bd1e-ab2f6b9e96f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nsrxz" Sep 08 10:56:57.639454 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:57.639396 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nsrxz" Sep 08 10:56:57.909114 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:57.908995 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nsrxz"] Sep 08 10:56:58.186852 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:58.186762 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nsrxz" event={"ID":"dae2c429-76f0-472c-bd1e-ab2f6b9e96f1","Type":"ContainerStarted","Data":"8fa932133711eb992bb11ee651b09f60be83e51edb25f5c7e81d6549e1f5e19d"} Sep 08 10:56:59.177102 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:59.177066 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-registry-tls\") pod \"image-registry-5b4f945f56-dwd8z\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:56:59.177621 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:59.177249 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 10:56:59.177621 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:59.177267 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b4f945f56-dwd8z: secret "image-registry-tls" not found Sep 08 10:56:59.177621 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:56:59.177336 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-registry-tls podName:84deda8f-2d13-4d89-88a2-1c6891b11d5a nodeName:}" failed. No retries permitted until 2026-09-08 10:57:15.177316632 +0000 UTC m=+75.809912104 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-registry-tls") pod "image-registry-5b4f945f56-dwd8z" (UID: "84deda8f-2d13-4d89-88a2-1c6891b11d5a") : secret "image-registry-tls" not found Sep 08 10:56:59.313343 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:59.313307 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:59.414199 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:59.414147 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:59.514556 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:59.514481 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:59.795824 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:59.795789 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:56:59.898025 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:56:59.897987 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:00.070613 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:00.070535 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2fn2c" Sep 08 10:57:00.162518 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:00.162476 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:00.195861 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:00.195829 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nsrxz" event={"ID":"dae2c429-76f0-472c-bd1e-ab2f6b9e96f1","Type":"ContainerStarted","Data":"7921594387f2e8f51eb0288c880638d54f6664f9251e9ff3eee6c367644818e5"} Sep 08 10:57:00.196256 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:00.195886 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nsrxz" event={"ID":"dae2c429-76f0-472c-bd1e-ab2f6b9e96f1","Type":"ContainerStarted","Data":"729ce8c1ce4d3a73e1404b52ba1f11f14805efe4c67e87c0d027dd4b5234b2ca"} Sep 08 10:57:00.212531 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:00.212432 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nsrxz" podStartSLOduration=17.642540637 podStartE2EDuration="19.212412094s" totalImagesPullingTime="1.569871457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:57:00.212029168 +0000 UTC m=+60.844624867" watchObservedRunningTime="2026-09-08 10:57:00.212412094 +0000 UTC m=+60.845007572" Sep 08 10:57:00.292628 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:00.292594 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:00.400527 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:00.400442 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:00.719759 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:00.719660 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:02.603543 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:02.603501 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/efaaf88d-bd00-40fe-830b-98c162d9972f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8tnt6\" (UID: \"efaaf88d-bd00-40fe-830b-98c162d9972f\") " pod="openshift-insights/insights-runtime-extractor-8tnt6" Sep 08 10:57:02.603543 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:02.603543 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/efaaf88d-bd00-40fe-830b-98c162d9972f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8tnt6\" (UID: \"efaaf88d-bd00-40fe-830b-98c162d9972f\") " pod="openshift-insights/insights-runtime-extractor-8tnt6" Sep 08 10:57:02.604081 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:57:02.603658 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 10:57:02.604081 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:57:02.603731 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efaaf88d-bd00-40fe-830b-98c162d9972f-insights-runtime-extractor-tls podName:efaaf88d-bd00-40fe-830b-98c162d9972f nodeName:}" failed. No retries permitted until 2026-09-08 10:57:18.603714692 +0000 UTC m=+79.236310150 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/efaaf88d-bd00-40fe-830b-98c162d9972f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8tnt6" (UID: "efaaf88d-bd00-40fe-830b-98c162d9972f") : secret "insights-runtime-extractor-tls" not found Sep 08 10:57:02.604256 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:02.604234 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/efaaf88d-bd00-40fe-830b-98c162d9972f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8tnt6\" (UID: \"efaaf88d-bd00-40fe-830b-98c162d9972f\") " pod="openshift-insights/insights-runtime-extractor-8tnt6" Sep 08 10:57:04.110273 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:04.110237 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:04.211221 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:04.211187 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:04.313573 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:04.313538 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:04.412606 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:04.412517 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:04.720673 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:04.720580 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc69f433-ba6d-4fd6-ad22-29d26782f11d-metrics-certs\") pod \"network-metrics-daemon-msdpf\" (UID: \"dc69f433-ba6d-4fd6-ad22-29d26782f11d\") " pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:57:04.720835 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:04.720703 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30463b34-4ef7-4a59-8b30-dd4b1199e7a6-original-pull-secret\") pod \"global-pull-secret-syncer-vtxs2\" (UID: \"30463b34-4ef7-4a59-8b30-dd4b1199e7a6\") " pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:57:04.723705 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:04.723681 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 08 10:57:04.723824 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:04.723689 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 08 10:57:04.732999 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:04.732977 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc69f433-ba6d-4fd6-ad22-29d26782f11d-metrics-certs\") pod \"network-metrics-daemon-msdpf\" (UID: \"dc69f433-ba6d-4fd6-ad22-29d26782f11d\") " pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:57:04.733155 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:04.733134 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30463b34-4ef7-4a59-8b30-dd4b1199e7a6-original-pull-secret\") pod \"global-pull-secret-syncer-vtxs2\" (UID: \"30463b34-4ef7-4a59-8b30-dd4b1199e7a6\") " pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:57:04.798341 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:04.798302 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:04.804105 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:04.804085 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vtxs2" Sep 08 10:57:04.822054 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:04.822029 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvn89\" (UniqueName: \"kubernetes.io/projected/bd67d177-bc24-48be-acca-e3cd070e193e-kube-api-access-mvn89\") pod \"network-check-target-pdd9x\" (UID: \"bd67d177-bc24-48be-acca-e3cd070e193e\") " pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:57:04.824806 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:04.824775 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvn89\" (UniqueName: \"kubernetes.io/projected/bd67d177-bc24-48be-acca-e3cd070e193e-kube-api-access-mvn89\") pod \"network-check-target-pdd9x\" (UID: \"bd67d177-bc24-48be-acca-e3cd070e193e\") " pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:57:04.895993 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:04.895956 2560 scope.go:117] "RemoveContainer" containerID="85a2236e3dab4e1272fea9f307f1408605356db08ff0cea3f0e41c25cee2cbb6" Sep 08 10:57:04.910230 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:04.910207 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7d5p2\"" Sep 08 10:57:04.916384 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:04.916362 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fxwg7\"" Sep 08 10:57:04.918369 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:04.918351 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msdpf" Sep 08 10:57:04.924818 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:04.924796 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:57:05.008669 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:05.008624 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:05.073543 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:05.073497 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vtxs2"] Sep 08 10:57:05.077005 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:57:05.076978 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30463b34_4ef7_4a59_8b30_dd4b1199e7a6.slice/crio-f58498b1e4b6599eb6edecc627c7d22dc922f4b41e4ac50864579b24d2fb0d98 WatchSource:0}: Error finding container f58498b1e4b6599eb6edecc627c7d22dc922f4b41e4ac50864579b24d2fb0d98: Status 404 returned error can't find the container with id f58498b1e4b6599eb6edecc627c7d22dc922f4b41e4ac50864579b24d2fb0d98 Sep 08 10:57:05.206381 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:05.206353 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-msdpf"] Sep 08 10:57:05.209095 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:57:05.209065 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc69f433_ba6d_4fd6_ad22_29d26782f11d.slice/crio-31980a8e81cc924d340f71f74f16ed83becb27e66a325ced9c5e42fe36f005e7 WatchSource:0}: Error finding container 31980a8e81cc924d340f71f74f16ed83becb27e66a325ced9c5e42fe36f005e7: Status 404 returned error can't find the container with id 31980a8e81cc924d340f71f74f16ed83becb27e66a325ced9c5e42fe36f005e7 Sep 08 10:57:05.213893 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:05.213866 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f285w_80be3338-ebb8-4dd1-8545-0fcdf56b9ef3/console-operator/1.log" Sep 08 10:57:05.214033 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:05.213999 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-f285w" event={"ID":"80be3338-ebb8-4dd1-8545-0fcdf56b9ef3","Type":"ContainerStarted","Data":"b443c66ad58d6a6d3e7e542993b8e8e102d7fe8656ce35daabb67edfb4677fbc"} Sep 08 10:57:05.214391 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:05.214372 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-f285w" Sep 08 10:57:05.215812 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:05.215781 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vtxs2" event={"ID":"30463b34-4ef7-4a59-8b30-dd4b1199e7a6","Type":"ContainerStarted","Data":"f58498b1e4b6599eb6edecc627c7d22dc922f4b41e4ac50864579b24d2fb0d98"} Sep 08 10:57:05.234604 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:05.234484 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-f285w" podStartSLOduration=20.397715964 podStartE2EDuration="24.234466136s" totalImagesPullingTime="3.836750172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:57:05.233800176 +0000 UTC m=+65.866395656" watchObservedRunningTime="2026-09-08 10:57:05.234466136 +0000 UTC m=+65.867061647" Sep 08 10:57:05.236255 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:05.236236 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pdd9x"] Sep 08 10:57:05.238734 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:57:05.238707 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd67d177_bc24_48be_acca_e3cd070e193e.slice/crio-78cc0fbf5bd136ab453a6460e361e66584f1ebc70eb2ba633031e250d8ce0c24 WatchSource:0}: Error finding container 78cc0fbf5bd136ab453a6460e361e66584f1ebc70eb2ba633031e250d8ce0c24: Status 404 returned error can't find the container with id 78cc0fbf5bd136ab453a6460e361e66584f1ebc70eb2ba633031e250d8ce0c24 Sep 08 10:57:05.599282 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:05.599227 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:05.964949 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:05.964854 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-f285w" Sep 08 10:57:06.016860 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:06.016807 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:06.141462 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:06.141427 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:06.223308 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:06.223210 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pdd9x" event={"ID":"bd67d177-bc24-48be-acca-e3cd070e193e","Type":"ContainerStarted","Data":"00d69ccf1cf49f730c7e113f630d00559d3f7cc61b09b211c325a8b6e37b632c"} Sep 08 10:57:06.223671 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:06.223320 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:57:06.223671 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:06.223342 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pdd9x" event={"ID":"bd67d177-bc24-48be-acca-e3cd070e193e","Type":"ContainerStarted","Data":"78cc0fbf5bd136ab453a6460e361e66584f1ebc70eb2ba633031e250d8ce0c24"} Sep 08 10:57:06.225028 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:06.224993 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-msdpf" event={"ID":"dc69f433-ba6d-4fd6-ad22-29d26782f11d","Type":"ContainerStarted","Data":"31980a8e81cc924d340f71f74f16ed83becb27e66a325ced9c5e42fe36f005e7"} Sep 08 10:57:06.239546 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:06.239500 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pdd9x" podStartSLOduration=66.239479022 podStartE2EDuration="1m6.239479022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:56:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:57:06.238758939 +0000 UTC m=+66.871354420" watchObservedRunningTime="2026-09-08 10:57:06.239479022 +0000 UTC m=+66.872074502" Sep 08 10:57:06.244711 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:06.244682 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:06.342223 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:06.341584 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:06.441643 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:06.441607 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:06.542707 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:06.542675 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:06.645397 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:06.645356 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:06.742529 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:06.742494 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:06.842821 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:06.842701 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:06.920979 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:06.920936 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:07.023989 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:07.023908 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:07.125107 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:07.125014 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:07.231606 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:07.231568 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-msdpf" event={"ID":"dc69f433-ba6d-4fd6-ad22-29d26782f11d","Type":"ContainerStarted","Data":"a04f3e56bd64f6d4444b12efbb19f1ebc903ecd3686744b7dd0b8e278048c643"} Sep 08 10:57:07.232066 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:07.231633 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-msdpf" event={"ID":"dc69f433-ba6d-4fd6-ad22-29d26782f11d","Type":"ContainerStarted","Data":"3daf98dc376ab92b9d3cd798b6b8bfa9e26b3ff2472ce5b2c0af159ce0b49a7e"} Sep 08 10:57:07.248465 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:07.248420 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-msdpf" podStartSLOduration=66.21017064 podStartE2EDuration="1m7.248399908s" totalImagesPullingTime="1.038229268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:56:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:57:07.247505641 +0000 UTC m=+67.880101120" watchObservedRunningTime="2026-09-08 10:57:07.248399908 +0000 UTC m=+67.880995388" Sep 08 10:57:07.321999 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:07.321947 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:08.026764 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:08.026728 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:08.154006 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:08.153965 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a72bab02-fa2c-499a-81be-8bf56c3db578-metrics-tls\") pod \"dns-default-zs2dr\" (UID: \"a72bab02-fa2c-499a-81be-8bf56c3db578\") " pod="openshift-dns/dns-default-zs2dr" Sep 08 10:57:08.156803 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:08.156775 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a72bab02-fa2c-499a-81be-8bf56c3db578-metrics-tls\") pod \"dns-default-zs2dr\" (UID: \"a72bab02-fa2c-499a-81be-8bf56c3db578\") " pod="openshift-dns/dns-default-zs2dr" Sep 08 10:57:08.235384 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:08.235346 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:08.297810 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:08.297774 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:08.334059 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:08.334033 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7pklm\"" Sep 08 10:57:08.341334 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:08.341308 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zs2dr" Sep 08 10:57:08.445844 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:08.445811 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:09.287689 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:09.287666 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zs2dr"] Sep 08 10:57:09.363600 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:57:09.363565 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda72bab02_fa2c_499a_81be_8bf56c3db578.slice/crio-bbbae1c8029cbe64ef6e35c2cc8c37db10f1259fc99a09acc61edff692a2a6f4 WatchSource:0}: Error finding container bbbae1c8029cbe64ef6e35c2cc8c37db10f1259fc99a09acc61edff692a2a6f4: Status 404 returned error can't find the container with id bbbae1c8029cbe64ef6e35c2cc8c37db10f1259fc99a09acc61edff692a2a6f4 Sep 08 10:57:10.242572 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:10.242533 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vtxs2" event={"ID":"30463b34-4ef7-4a59-8b30-dd4b1199e7a6","Type":"ContainerStarted","Data":"8fd6d409b69012f4815a5cf2608aea8559cd8f6d025a6f614bdf035ae24c4626"} Sep 08 10:57:10.243652 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:10.243625 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zs2dr" event={"ID":"a72bab02-fa2c-499a-81be-8bf56c3db578","Type":"ContainerStarted","Data":"bbbae1c8029cbe64ef6e35c2cc8c37db10f1259fc99a09acc61edff692a2a6f4"} Sep 08 10:57:10.258862 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:10.258815 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vtxs2" podStartSLOduration=65.941196999 podStartE2EDuration="1m10.258801184s" totalImagesPullingTime="4.317604185s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:56:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:57:10.258696257 +0000 UTC m=+70.891291735" watchObservedRunningTime="2026-09-08 10:57:10.258801184 +0000 UTC m=+70.891396661" Sep 08 10:57:11.677769 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:11.677733 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:12.764733 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:12.764695 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b4f945f56-dwd8z"] Sep 08 10:57:12.765096 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:57:12.764904 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" podUID="84deda8f-2d13-4d89-88a2-1c6891b11d5a" Sep 08 10:57:12.810486 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:12.810454 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-84c5985848-9rztx"] Sep 08 10:57:12.812406 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:12.812391 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84c5985848-9rztx" Sep 08 10:57:12.832571 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:12.832540 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-84c5985848-9rztx"] Sep 08 10:57:12.888973 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:12.888940 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/db7580a8-8378-4b83-9160-855661f06a07-image-registry-private-configuration\") pod \"image-registry-84c5985848-9rztx\" (UID: \"db7580a8-8378-4b83-9160-855661f06a07\") " pod="openshift-image-registry/image-registry-84c5985848-9rztx" Sep 08 10:57:12.889152 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:12.888998 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67dsg\" (UniqueName: \"kubernetes.io/projected/db7580a8-8378-4b83-9160-855661f06a07-kube-api-access-67dsg\") pod \"image-registry-84c5985848-9rztx\" (UID: \"db7580a8-8378-4b83-9160-855661f06a07\") " pod="openshift-image-registry/image-registry-84c5985848-9rztx" Sep 08 10:57:12.889152 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:12.889022 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/db7580a8-8378-4b83-9160-855661f06a07-ca-trust-extracted\") pod \"image-registry-84c5985848-9rztx\" (UID: \"db7580a8-8378-4b83-9160-855661f06a07\") " pod="openshift-image-registry/image-registry-84c5985848-9rztx" Sep 08 10:57:12.889152 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:12.889061 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/db7580a8-8378-4b83-9160-855661f06a07-installation-pull-secrets\") pod \"image-registry-84c5985848-9rztx\" (UID: \"db7580a8-8378-4b83-9160-855661f06a07\") " pod="openshift-image-registry/image-registry-84c5985848-9rztx" Sep 08 10:57:12.889152 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:12.889099 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/db7580a8-8378-4b83-9160-855661f06a07-registry-certificates\") pod \"image-registry-84c5985848-9rztx\" (UID: \"db7580a8-8378-4b83-9160-855661f06a07\") " pod="openshift-image-registry/image-registry-84c5985848-9rztx" Sep 08 10:57:12.889152 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:12.889124 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db7580a8-8378-4b83-9160-855661f06a07-trusted-ca\") pod \"image-registry-84c5985848-9rztx\" (UID: \"db7580a8-8378-4b83-9160-855661f06a07\") " pod="openshift-image-registry/image-registry-84c5985848-9rztx" Sep 08 10:57:12.889365 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:12.889190 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db7580a8-8378-4b83-9160-855661f06a07-registry-tls\") pod \"image-registry-84c5985848-9rztx\" (UID: \"db7580a8-8378-4b83-9160-855661f06a07\") " pod="openshift-image-registry/image-registry-84c5985848-9rztx" Sep 08 10:57:12.889365 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:12.889212 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/db7580a8-8378-4b83-9160-855661f06a07-bound-sa-token\") pod \"image-registry-84c5985848-9rztx\" (UID: \"db7580a8-8378-4b83-9160-855661f06a07\") " pod="openshift-image-registry/image-registry-84c5985848-9rztx" Sep 08 10:57:12.989589 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:12.989552 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db7580a8-8378-4b83-9160-855661f06a07-trusted-ca\") pod \"image-registry-84c5985848-9rztx\" (UID: \"db7580a8-8378-4b83-9160-855661f06a07\") " pod="openshift-image-registry/image-registry-84c5985848-9rztx" Sep 08 10:57:12.989783 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:12.989604 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db7580a8-8378-4b83-9160-855661f06a07-registry-tls\") pod \"image-registry-84c5985848-9rztx\" (UID: \"db7580a8-8378-4b83-9160-855661f06a07\") " pod="openshift-image-registry/image-registry-84c5985848-9rztx" Sep 08 10:57:12.989783 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:12.989623 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/db7580a8-8378-4b83-9160-855661f06a07-bound-sa-token\") pod \"image-registry-84c5985848-9rztx\" (UID: \"db7580a8-8378-4b83-9160-855661f06a07\") " pod="openshift-image-registry/image-registry-84c5985848-9rztx" Sep 08 10:57:12.989783 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:12.989644 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/db7580a8-8378-4b83-9160-855661f06a07-image-registry-private-configuration\") pod \"image-registry-84c5985848-9rztx\" (UID: \"db7580a8-8378-4b83-9160-855661f06a07\") " pod="openshift-image-registry/image-registry-84c5985848-9rztx" Sep 08 10:57:12.989783 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:12.989670 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67dsg\" (UniqueName: \"kubernetes.io/projected/db7580a8-8378-4b83-9160-855661f06a07-kube-api-access-67dsg\") pod \"image-registry-84c5985848-9rztx\" (UID: \"db7580a8-8378-4b83-9160-855661f06a07\") " pod="openshift-image-registry/image-registry-84c5985848-9rztx" Sep 08 10:57:12.989783 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:12.989705 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/db7580a8-8378-4b83-9160-855661f06a07-ca-trust-extracted\") pod \"image-registry-84c5985848-9rztx\" (UID: \"db7580a8-8378-4b83-9160-855661f06a07\") " pod="openshift-image-registry/image-registry-84c5985848-9rztx" Sep 08 10:57:12.990052 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:12.989928 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/db7580a8-8378-4b83-9160-855661f06a07-installation-pull-secrets\") pod \"image-registry-84c5985848-9rztx\" (UID: \"db7580a8-8378-4b83-9160-855661f06a07\") " pod="openshift-image-registry/image-registry-84c5985848-9rztx" Sep 08 10:57:12.990052 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:12.990007 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/db7580a8-8378-4b83-9160-855661f06a07-registry-certificates\") pod \"image-registry-84c5985848-9rztx\" (UID: \"db7580a8-8378-4b83-9160-855661f06a07\") " pod="openshift-image-registry/image-registry-84c5985848-9rztx" Sep 08 10:57:12.990190 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:12.990139 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/db7580a8-8378-4b83-9160-855661f06a07-ca-trust-extracted\") pod \"image-registry-84c5985848-9rztx\" (UID: \"db7580a8-8378-4b83-9160-855661f06a07\") " pod="openshift-image-registry/image-registry-84c5985848-9rztx" Sep 08 10:57:12.990813 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:12.990769 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/db7580a8-8378-4b83-9160-855661f06a07-registry-certificates\") pod \"image-registry-84c5985848-9rztx\" (UID: \"db7580a8-8378-4b83-9160-855661f06a07\") " pod="openshift-image-registry/image-registry-84c5985848-9rztx" Sep 08 10:57:12.990992 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:12.990972 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db7580a8-8378-4b83-9160-855661f06a07-trusted-ca\") pod \"image-registry-84c5985848-9rztx\" (UID: \"db7580a8-8378-4b83-9160-855661f06a07\") " pod="openshift-image-registry/image-registry-84c5985848-9rztx" Sep 08 10:57:12.992620 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:12.992595 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/db7580a8-8378-4b83-9160-855661f06a07-installation-pull-secrets\") pod \"image-registry-84c5985848-9rztx\" (UID: \"db7580a8-8378-4b83-9160-855661f06a07\") " pod="openshift-image-registry/image-registry-84c5985848-9rztx" Sep 08 10:57:12.992749 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:12.992727 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/db7580a8-8378-4b83-9160-855661f06a07-image-registry-private-configuration\") pod \"image-registry-84c5985848-9rztx\" (UID: \"db7580a8-8378-4b83-9160-855661f06a07\") " pod="openshift-image-registry/image-registry-84c5985848-9rztx" Sep 08 10:57:12.992816 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:12.992794 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db7580a8-8378-4b83-9160-855661f06a07-registry-tls\") pod \"image-registry-84c5985848-9rztx\" (UID: \"db7580a8-8378-4b83-9160-855661f06a07\") " pod="openshift-image-registry/image-registry-84c5985848-9rztx" Sep 08 10:57:13.006272 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.006245 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/db7580a8-8378-4b83-9160-855661f06a07-bound-sa-token\") pod \"image-registry-84c5985848-9rztx\" (UID: \"db7580a8-8378-4b83-9160-855661f06a07\") " pod="openshift-image-registry/image-registry-84c5985848-9rztx" Sep 08 10:57:13.006393 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.006357 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67dsg\" (UniqueName: \"kubernetes.io/projected/db7580a8-8378-4b83-9160-855661f06a07-kube-api-access-67dsg\") pod \"image-registry-84c5985848-9rztx\" (UID: \"db7580a8-8378-4b83-9160-855661f06a07\") " pod="openshift-image-registry/image-registry-84c5985848-9rztx" Sep 08 10:57:13.125864 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.125832 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7lxng\"" Sep 08 10:57:13.133893 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.133863 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84c5985848-9rztx" Sep 08 10:57:13.254340 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.254308 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:57:13.261987 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.261959 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:57:13.401095 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.401016 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwqxs\" (UniqueName: \"kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-kube-api-access-rwqxs\") pod \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " Sep 08 10:57:13.401095 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.401088 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/84deda8f-2d13-4d89-88a2-1c6891b11d5a-installation-pull-secrets\") pod \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " Sep 08 10:57:13.401347 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.401140 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/84deda8f-2d13-4d89-88a2-1c6891b11d5a-registry-certificates\") pod \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " Sep 08 10:57:13.401347 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.401190 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/84deda8f-2d13-4d89-88a2-1c6891b11d5a-trusted-ca\") pod \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " Sep 08 10:57:13.401347 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.401218 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-bound-sa-token\") pod \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " Sep 08 10:57:13.401347 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.401242 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/84deda8f-2d13-4d89-88a2-1c6891b11d5a-image-registry-private-configuration\") pod \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " Sep 08 10:57:13.401347 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.401279 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/84deda8f-2d13-4d89-88a2-1c6891b11d5a-ca-trust-extracted\") pod \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\" (UID: \"84deda8f-2d13-4d89-88a2-1c6891b11d5a\") " Sep 08 10:57:13.401962 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.401801 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84deda8f-2d13-4d89-88a2-1c6891b11d5a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "84deda8f-2d13-4d89-88a2-1c6891b11d5a" (UID: "84deda8f-2d13-4d89-88a2-1c6891b11d5a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 10:57:13.401962 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.401817 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84deda8f-2d13-4d89-88a2-1c6891b11d5a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "84deda8f-2d13-4d89-88a2-1c6891b11d5a" (UID: "84deda8f-2d13-4d89-88a2-1c6891b11d5a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 10:57:13.401962 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.401881 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84deda8f-2d13-4d89-88a2-1c6891b11d5a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "84deda8f-2d13-4d89-88a2-1c6891b11d5a" (UID: "84deda8f-2d13-4d89-88a2-1c6891b11d5a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 10:57:13.404016 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.403979 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84deda8f-2d13-4d89-88a2-1c6891b11d5a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "84deda8f-2d13-4d89-88a2-1c6891b11d5a" (UID: "84deda8f-2d13-4d89-88a2-1c6891b11d5a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:57:13.404255 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.404223 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-kube-api-access-rwqxs" (OuterVolumeSpecName: "kube-api-access-rwqxs") pod "84deda8f-2d13-4d89-88a2-1c6891b11d5a" (UID: "84deda8f-2d13-4d89-88a2-1c6891b11d5a"). InnerVolumeSpecName "kube-api-access-rwqxs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 10:57:13.404760 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.404733 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84deda8f-2d13-4d89-88a2-1c6891b11d5a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "84deda8f-2d13-4d89-88a2-1c6891b11d5a" (UID: "84deda8f-2d13-4d89-88a2-1c6891b11d5a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:57:13.405061 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.405042 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "84deda8f-2d13-4d89-88a2-1c6891b11d5a" (UID: "84deda8f-2d13-4d89-88a2-1c6891b11d5a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 10:57:13.422553 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.422511 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-84c5985848-9rztx"] Sep 08 10:57:13.425981 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:57:13.425951 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb7580a8_8378_4b83_9160_855661f06a07.slice/crio-fa35ccb1470297420316a7b75d6f1fa33fc798cae5b8a8e00b3a5398d154ea97 WatchSource:0}: Error finding container fa35ccb1470297420316a7b75d6f1fa33fc798cae5b8a8e00b3a5398d154ea97: Status 404 returned error can't find the container with id fa35ccb1470297420316a7b75d6f1fa33fc798cae5b8a8e00b3a5398d154ea97 Sep 08 10:57:13.502251 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.502220 2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/84deda8f-2d13-4d89-88a2-1c6891b11d5a-installation-pull-secrets\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:57:13.502251 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.502249 2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/84deda8f-2d13-4d89-88a2-1c6891b11d5a-registry-certificates\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:57:13.502251 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.502260 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/84deda8f-2d13-4d89-88a2-1c6891b11d5a-trusted-ca\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:57:13.502474 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.502268 2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-bound-sa-token\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:57:13.502474 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.502277 2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/84deda8f-2d13-4d89-88a2-1c6891b11d5a-image-registry-private-configuration\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:57:13.502474 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.502285 2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/84deda8f-2d13-4d89-88a2-1c6891b11d5a-ca-trust-extracted\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:57:13.502474 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.502293 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwqxs\" (UniqueName: \"kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-kube-api-access-rwqxs\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:57:13.602758 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.602719 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e149ccac-29e4-4805-9c68-36fdcdd8a649-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-s4z4b\" (UID: \"e149ccac-29e4-4805-9c68-36fdcdd8a649\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-s4z4b" Sep 08 10:57:13.605574 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.605549 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e149ccac-29e4-4805-9c68-36fdcdd8a649-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-s4z4b\" (UID: \"e149ccac-29e4-4805-9c68-36fdcdd8a649\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-s4z4b" Sep 08 10:57:13.798508 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.798474 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6d7np\"" Sep 08 10:57:13.806388 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:13.806352 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-s4z4b" Sep 08 10:57:14.163746 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:14.163710 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-s4z4b"] Sep 08 10:57:14.166650 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:57:14.166620 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode149ccac_29e4_4805_9c68_36fdcdd8a649.slice/crio-8b37f3edc626c45eb8aaf06d096ef8238563bcd9d14d428ee1c53bc5d62d5c08 WatchSource:0}: Error finding container 8b37f3edc626c45eb8aaf06d096ef8238563bcd9d14d428ee1c53bc5d62d5c08: Status 404 returned error can't find the container with id 8b37f3edc626c45eb8aaf06d096ef8238563bcd9d14d428ee1c53bc5d62d5c08 Sep 08 10:57:14.261120 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:14.261085 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-s4z4b" event={"ID":"e149ccac-29e4-4805-9c68-36fdcdd8a649","Type":"ContainerStarted","Data":"8b37f3edc626c45eb8aaf06d096ef8238563bcd9d14d428ee1c53bc5d62d5c08"} Sep 08 10:57:14.262810 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:14.262775 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84c5985848-9rztx" event={"ID":"db7580a8-8378-4b83-9160-855661f06a07","Type":"ContainerStarted","Data":"212159fbc1c4d70b82df891b6335973cfff0983811dd057d4c1d4ba2f2d2171c"} Sep 08 10:57:14.262996 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:14.262825 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84c5985848-9rztx" event={"ID":"db7580a8-8378-4b83-9160-855661f06a07","Type":"ContainerStarted","Data":"fa35ccb1470297420316a7b75d6f1fa33fc798cae5b8a8e00b3a5398d154ea97"} Sep 08 10:57:14.262996 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:14.262892 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-84c5985848-9rztx" Sep 08 10:57:14.264705 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:14.264685 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b4f945f56-dwd8z" Sep 08 10:57:14.264828 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:14.264688 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zs2dr" event={"ID":"a72bab02-fa2c-499a-81be-8bf56c3db578","Type":"ContainerStarted","Data":"11cb6d5f0b1952ff83ffd00116b4f9eebbc85c4a7f67a91f8c854beb7c135167"} Sep 08 10:57:14.264886 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:14.264852 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zs2dr" event={"ID":"a72bab02-fa2c-499a-81be-8bf56c3db578","Type":"ContainerStarted","Data":"f330c98929b98b475427314af36340ba6398a74b576b81decd563e4c6c9553af"} Sep 08 10:57:14.264886 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:14.264873 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zs2dr" Sep 08 10:57:14.290645 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:14.290589 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-84c5985848-9rztx" podStartSLOduration=2.290571117 podStartE2EDuration="2.290571117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:57:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:57:14.288721977 +0000 UTC m=+74.921317456" watchObservedRunningTime="2026-09-08 10:57:14.290571117 +0000 UTC m=+74.923166594" Sep 08 10:57:14.326338 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:14.326265 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b4f945f56-dwd8z"] Sep 08 10:57:14.333612 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:14.333585 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5b4f945f56-dwd8z"] Sep 08 10:57:14.356025 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:14.355967 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zs2dr" podStartSLOduration=33.826413935 podStartE2EDuration="38.355949581s" totalImagesPullingTime="4.529535646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:56:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:57:14.355056497 +0000 UTC m=+74.987651974" watchObservedRunningTime="2026-09-08 10:57:14.355949581 +0000 UTC m=+74.988545058" Sep 08 10:57:14.409601 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:14.409561 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84deda8f-2d13-4d89-88a2-1c6891b11d5a-registry-tls\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:57:14.875612 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:14.875569 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:14.977743 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:14.977707 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:15.086378 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:15.086344 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:15.162406 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:15.162318 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:15.901391 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:15.901351 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84deda8f-2d13-4d89-88a2-1c6891b11d5a" path="/var/lib/kubelet/pods/84deda8f-2d13-4d89-88a2-1c6891b11d5a/volumes" Sep 08 10:57:16.278595 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:16.278560 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-s4z4b" event={"ID":"e149ccac-29e4-4805-9c68-36fdcdd8a649","Type":"ContainerStarted","Data":"70d27d2a280d4907f40a5f6ddcbc4c1259ca059aba99deba03d28349da6170ff"} Sep 08 10:57:16.506524 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:16.506434 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:16.611288 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:16.611241 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:16.697691 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:16.697643 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:16.895536 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:16.895507 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:17.251697 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:17.251618 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:17.326967 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:17.326927 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:18.643273 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:18.643242 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/efaaf88d-bd00-40fe-830b-98c162d9972f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8tnt6\" (UID: \"efaaf88d-bd00-40fe-830b-98c162d9972f\") " pod="openshift-insights/insights-runtime-extractor-8tnt6" Sep 08 10:57:18.645525 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:18.645503 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/efaaf88d-bd00-40fe-830b-98c162d9972f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8tnt6\" (UID: \"efaaf88d-bd00-40fe-830b-98c162d9972f\") " pod="openshift-insights/insights-runtime-extractor-8tnt6" Sep 08 10:57:18.889348 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:18.889311 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pjmvw\"" Sep 08 10:57:18.897872 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:18.897798 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8tnt6" Sep 08 10:57:19.182781 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:19.182665 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-s4z4b" podStartSLOduration=36.165353026 podStartE2EDuration="38.182642063s" totalImagesPullingTime="2.017289037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:57:16.294743882 +0000 UTC m=+76.927339362" watchObservedRunningTime="2026-09-08 10:57:19.182642063 +0000 UTC m=+79.815237542" Sep 08 10:57:19.183741 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:19.183684 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8tnt6"] Sep 08 10:57:19.187576 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:57:19.187545 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefaaf88d_bd00_40fe_830b_98c162d9972f.slice/crio-39789291a468bf157c6c4a3558fafc8e437a18748bcc8933b7e142b74cd74219 WatchSource:0}: Error finding container 39789291a468bf157c6c4a3558fafc8e437a18748bcc8933b7e142b74cd74219: Status 404 returned error can't find the container with id 39789291a468bf157c6c4a3558fafc8e437a18748bcc8933b7e142b74cd74219 Sep 08 10:57:19.291563 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:19.291522 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8tnt6" event={"ID":"efaaf88d-bd00-40fe-830b-98c162d9972f","Type":"ContainerStarted","Data":"39789291a468bf157c6c4a3558fafc8e437a18748bcc8933b7e142b74cd74219"} Sep 08 10:57:19.467512 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:19.467418 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:19.537888 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:19.537848 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:20.301153 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:20.301123 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8tnt6" event={"ID":"efaaf88d-bd00-40fe-830b-98c162d9972f","Type":"ContainerStarted","Data":"abbe5621bdb5de767da3df075cf940f7ad57dafedd431e9bef7f9d8c35a934cc"} Sep 08 10:57:20.301533 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:20.301218 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8tnt6" event={"ID":"efaaf88d-bd00-40fe-830b-98c162d9972f","Type":"ContainerStarted","Data":"d03cc465534b9173984039fb2ba308f0dbd7091645c88f9f3af2290f45475f66"} Sep 08 10:57:21.420850 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:21.420812 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:21.520902 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:21.520862 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:21.655673 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:21.655641 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:21.744869 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:21.744835 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:21.828748 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:21.828713 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:21.900036 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:21.900004 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:22.310506 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:22.310472 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8tnt6" event={"ID":"efaaf88d-bd00-40fe-830b-98c162d9972f","Type":"ContainerStarted","Data":"6a9c281d83e0bdc0dc5edb0fcf097e388f42baf90080ab12f46a0b8d9c61d636"} Sep 08 10:57:22.330667 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:22.330617 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8tnt6" podStartSLOduration=34.08033127 podStartE2EDuration="36.330596661s" totalImagesPullingTime="2.250265391s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:56:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:57:22.329631235 +0000 UTC m=+82.962226713" watchObservedRunningTime="2026-09-08 10:57:22.330596661 +0000 UTC m=+82.963192143" Sep 08 10:57:22.979510 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:22.979469 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:23.078822 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:23.078786 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:23.146225 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:23.146181 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:23.886625 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:23.886588 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:23.954424 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:23.954391 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:24.271080 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:24.271001 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zs2dr" Sep 08 10:57:25.975805 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:25.975762 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:26.075782 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:26.075738 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:27.253706 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:27.253668 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:27.352501 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:27.352457 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:28.920387 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:28.920349 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84f64cf968-n7vfq"] Sep 08 10:57:28.924788 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:28.924766 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f64cf968-n7vfq" Sep 08 10:57:28.927100 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:28.927066 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:28.928820 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:28.928798 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 08 10:57:28.928906 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:28.928852 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 08 10:57:28.929097 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:28.929079 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 08 10:57:28.929221 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:28.929100 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 08 10:57:28.929221 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:28.929108 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 08 10:57:28.929221 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:28.929111 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 08 10:57:28.929399 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:28.929231 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-s652j\"" Sep 08 10:57:28.929399 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:28.929236 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 08 10:57:28.934948 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:28.934929 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 08 10:57:28.941030 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:28.941007 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84f64cf968-n7vfq"] Sep 08 10:57:29.023771 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:29.023725 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j7rn\" (UniqueName: \"kubernetes.io/projected/7933eb8f-b728-4eac-8d90-228e3472cdad-kube-api-access-4j7rn\") pod \"console-84f64cf968-n7vfq\" (UID: \"7933eb8f-b728-4eac-8d90-228e3472cdad\") " pod="openshift-console/console-84f64cf968-n7vfq" Sep 08 10:57:29.023959 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:29.023816 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7933eb8f-b728-4eac-8d90-228e3472cdad-oauth-serving-cert\") pod \"console-84f64cf968-n7vfq\" (UID: \"7933eb8f-b728-4eac-8d90-228e3472cdad\") " pod="openshift-console/console-84f64cf968-n7vfq" Sep 08 10:57:29.023959 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:29.023861 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:29.023959 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:29.023879 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7933eb8f-b728-4eac-8d90-228e3472cdad-console-config\") pod \"console-84f64cf968-n7vfq\" (UID: \"7933eb8f-b728-4eac-8d90-228e3472cdad\") " pod="openshift-console/console-84f64cf968-n7vfq" Sep 08 10:57:29.023959 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:29.023912 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7933eb8f-b728-4eac-8d90-228e3472cdad-console-oauth-config\") pod \"console-84f64cf968-n7vfq\" (UID: \"7933eb8f-b728-4eac-8d90-228e3472cdad\") " pod="openshift-console/console-84f64cf968-n7vfq" Sep 08 10:57:29.023959 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:29.023950 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7933eb8f-b728-4eac-8d90-228e3472cdad-trusted-ca-bundle\") pod \"console-84f64cf968-n7vfq\" (UID: \"7933eb8f-b728-4eac-8d90-228e3472cdad\") " pod="openshift-console/console-84f64cf968-n7vfq" Sep 08 10:57:29.024190 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:29.023977 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7933eb8f-b728-4eac-8d90-228e3472cdad-service-ca\") pod \"console-84f64cf968-n7vfq\" (UID: \"7933eb8f-b728-4eac-8d90-228e3472cdad\") " pod="openshift-console/console-84f64cf968-n7vfq" Sep 08 10:57:29.024190 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:29.024076 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7933eb8f-b728-4eac-8d90-228e3472cdad-console-serving-cert\") pod \"console-84f64cf968-n7vfq\" (UID: \"7933eb8f-b728-4eac-8d90-228e3472cdad\") " pod="openshift-console/console-84f64cf968-n7vfq" Sep 08 10:57:29.125141 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:29.125095 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7933eb8f-b728-4eac-8d90-228e3472cdad-oauth-serving-cert\") pod \"console-84f64cf968-n7vfq\" (UID: \"7933eb8f-b728-4eac-8d90-228e3472cdad\") " pod="openshift-console/console-84f64cf968-n7vfq" Sep 08 10:57:29.125141 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:29.125147 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7933eb8f-b728-4eac-8d90-228e3472cdad-console-config\") pod \"console-84f64cf968-n7vfq\" (UID: \"7933eb8f-b728-4eac-8d90-228e3472cdad\") " pod="openshift-console/console-84f64cf968-n7vfq" Sep 08 10:57:29.125418 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:29.125203 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7933eb8f-b728-4eac-8d90-228e3472cdad-console-oauth-config\") pod \"console-84f64cf968-n7vfq\" (UID: \"7933eb8f-b728-4eac-8d90-228e3472cdad\") " pod="openshift-console/console-84f64cf968-n7vfq" Sep 08 10:57:29.125418 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:29.125223 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7933eb8f-b728-4eac-8d90-228e3472cdad-trusted-ca-bundle\") pod \"console-84f64cf968-n7vfq\" (UID: \"7933eb8f-b728-4eac-8d90-228e3472cdad\") " pod="openshift-console/console-84f64cf968-n7vfq" Sep 08 10:57:29.125418 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:29.125253 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7933eb8f-b728-4eac-8d90-228e3472cdad-service-ca\") pod \"console-84f64cf968-n7vfq\" (UID: \"7933eb8f-b728-4eac-8d90-228e3472cdad\") " pod="openshift-console/console-84f64cf968-n7vfq" Sep 08 10:57:29.125418 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:29.125306 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7933eb8f-b728-4eac-8d90-228e3472cdad-console-serving-cert\") pod \"console-84f64cf968-n7vfq\" (UID: \"7933eb8f-b728-4eac-8d90-228e3472cdad\") " pod="openshift-console/console-84f64cf968-n7vfq" Sep 08 10:57:29.125418 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:29.125335 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j7rn\" (UniqueName: \"kubernetes.io/projected/7933eb8f-b728-4eac-8d90-228e3472cdad-kube-api-access-4j7rn\") pod \"console-84f64cf968-n7vfq\" (UID: \"7933eb8f-b728-4eac-8d90-228e3472cdad\") " pod="openshift-console/console-84f64cf968-n7vfq" Sep 08 10:57:29.125962 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:29.125936 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7933eb8f-b728-4eac-8d90-228e3472cdad-oauth-serving-cert\") pod \"console-84f64cf968-n7vfq\" (UID: \"7933eb8f-b728-4eac-8d90-228e3472cdad\") " pod="openshift-console/console-84f64cf968-n7vfq" Sep 08 10:57:29.126092 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:29.125980 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7933eb8f-b728-4eac-8d90-228e3472cdad-console-config\") pod \"console-84f64cf968-n7vfq\" (UID: \"7933eb8f-b728-4eac-8d90-228e3472cdad\") " pod="openshift-console/console-84f64cf968-n7vfq" Sep 08 10:57:29.126184 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:29.126151 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7933eb8f-b728-4eac-8d90-228e3472cdad-trusted-ca-bundle\") pod \"console-84f64cf968-n7vfq\" (UID: \"7933eb8f-b728-4eac-8d90-228e3472cdad\") " pod="openshift-console/console-84f64cf968-n7vfq" Sep 08 10:57:29.126257 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:29.126236 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7933eb8f-b728-4eac-8d90-228e3472cdad-service-ca\") pod \"console-84f64cf968-n7vfq\" (UID: \"7933eb8f-b728-4eac-8d90-228e3472cdad\") " pod="openshift-console/console-84f64cf968-n7vfq" Sep 08 10:57:29.127764 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:29.127734 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7933eb8f-b728-4eac-8d90-228e3472cdad-console-oauth-config\") pod \"console-84f64cf968-n7vfq\" (UID: \"7933eb8f-b728-4eac-8d90-228e3472cdad\") " pod="openshift-console/console-84f64cf968-n7vfq" Sep 08 10:57:29.127860 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:29.127834 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7933eb8f-b728-4eac-8d90-228e3472cdad-console-serving-cert\") pod \"console-84f64cf968-n7vfq\" (UID: \"7933eb8f-b728-4eac-8d90-228e3472cdad\") " pod="openshift-console/console-84f64cf968-n7vfq" Sep 08 10:57:29.134082 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:29.134061 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j7rn\" (UniqueName: \"kubernetes.io/projected/7933eb8f-b728-4eac-8d90-228e3472cdad-kube-api-access-4j7rn\") pod \"console-84f64cf968-n7vfq\" (UID: \"7933eb8f-b728-4eac-8d90-228e3472cdad\") " pod="openshift-console/console-84f64cf968-n7vfq" Sep 08 10:57:29.235249 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:29.235145 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f64cf968-n7vfq" Sep 08 10:57:29.507236 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:29.507152 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84f64cf968-n7vfq"] Sep 08 10:57:29.510130 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:57:29.510099 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7933eb8f_b728_4eac_8d90_228e3472cdad.slice/crio-024e16930c8431fe432853d0c9749a8c9ad4252d9423bc6f3ab6495c380a0a83 WatchSource:0}: Error finding container 024e16930c8431fe432853d0c9749a8c9ad4252d9423bc6f3ab6495c380a0a83: Status 404 returned error can't find the container with id 024e16930c8431fe432853d0c9749a8c9ad4252d9423bc6f3ab6495c380a0a83 Sep 08 10:57:30.341941 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:30.341906 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f64cf968-n7vfq" event={"ID":"7933eb8f-b728-4eac-8d90-228e3472cdad","Type":"ContainerStarted","Data":"024e16930c8431fe432853d0c9749a8c9ad4252d9423bc6f3ab6495c380a0a83"} Sep 08 10:57:31.718274 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:31.718141 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:32.063951 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:32.063911 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:32.132726 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:32.132652 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:32.897244 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:32.897211 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:33.354139 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:33.354106 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f64cf968-n7vfq" event={"ID":"7933eb8f-b728-4eac-8d90-228e3472cdad","Type":"ContainerStarted","Data":"9ff1124ac475ebe3347141739c9d90a308f5b26224659b63a5ee0c469cb9e4e0"} Sep 08 10:57:34.126670 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.126613 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84f64cf968-n7vfq" podStartSLOduration=3.308506167 podStartE2EDuration="6.126593429s" totalImagesPullingTime="2.818087262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:57:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:57:33.375515377 +0000 UTC m=+94.008110854" watchObservedRunningTime="2026-09-08 10:57:34.126593429 +0000 UTC m=+94.759188907" Sep 08 10:57:34.127059 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.126800 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-8x767"] Sep 08 10:57:34.130205 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.130184 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8x767" Sep 08 10:57:34.133141 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.133117 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 08 10:57:34.133273 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.133154 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-g55hc\"" Sep 08 10:57:34.134209 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.134193 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 08 10:57:34.134478 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.134464 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 08 10:57:34.139526 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.139505 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pvp4n"] Sep 08 10:57:34.142785 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.142767 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pvp4n" Sep 08 10:57:34.144302 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.144281 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-8x767"] Sep 08 10:57:34.146535 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.146478 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 08 10:57:34.146655 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.146562 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 08 10:57:34.146796 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.146780 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 08 10:57:34.147008 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.146988 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-75gfc\"" Sep 08 10:57:34.152068 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.152048 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-l97qz"] Sep 08 10:57:34.155150 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.155134 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-l97qz" Sep 08 10:57:34.158085 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.158056 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 08 10:57:34.158085 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.158065 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 08 10:57:34.158331 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.158316 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-k9m29\"" Sep 08 10:57:34.158534 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.158515 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 08 10:57:34.170423 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.170400 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-l97qz"] Sep 08 10:57:34.264233 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.264197 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9621f8a4-0b41-438c-b45d-0e0d46cc0d6d-sys\") pod \"node-exporter-pvp4n\" (UID: \"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d\") " pod="openshift-monitoring/node-exporter-pvp4n" Sep 08 10:57:34.264233 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.264235 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c3882461-2186-4fe5-851f-6cc5a04d7825-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-l97qz\" (UID: \"c3882461-2186-4fe5-851f-6cc5a04d7825\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l97qz" Sep 08 10:57:34.264440 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.264263 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9621f8a4-0b41-438c-b45d-0e0d46cc0d6d-root\") pod \"node-exporter-pvp4n\" (UID: \"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d\") " pod="openshift-monitoring/node-exporter-pvp4n" Sep 08 10:57:34.264440 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.264285 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab4fc548-56fe-41f1-81e3-f0edefc94eed-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-8x767\" (UID: \"ab4fc548-56fe-41f1-81e3-f0edefc94eed\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8x767" Sep 08 10:57:34.264440 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.264326 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3882461-2186-4fe5-851f-6cc5a04d7825-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-l97qz\" (UID: \"c3882461-2186-4fe5-851f-6cc5a04d7825\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l97qz" Sep 08 10:57:34.264440 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.264353 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9621f8a4-0b41-438c-b45d-0e0d46cc0d6d-node-exporter-tls\") pod \"node-exporter-pvp4n\" (UID: \"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d\") " pod="openshift-monitoring/node-exporter-pvp4n" Sep 08 10:57:34.264440 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.264368 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwrpg\" (UniqueName: \"kubernetes.io/projected/9621f8a4-0b41-438c-b45d-0e0d46cc0d6d-kube-api-access-jwrpg\") pod \"node-exporter-pvp4n\" (UID: \"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d\") " pod="openshift-monitoring/node-exporter-pvp4n" Sep 08 10:57:34.264440 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.264384 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab4fc548-56fe-41f1-81e3-f0edefc94eed-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-8x767\" (UID: \"ab4fc548-56fe-41f1-81e3-f0edefc94eed\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8x767" Sep 08 10:57:34.264440 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.264405 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9621f8a4-0b41-438c-b45d-0e0d46cc0d6d-node-exporter-textfile\") pod \"node-exporter-pvp4n\" (UID: \"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d\") " pod="openshift-monitoring/node-exporter-pvp4n" Sep 08 10:57:34.264650 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.264443 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c3882461-2186-4fe5-851f-6cc5a04d7825-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-l97qz\" (UID: \"c3882461-2186-4fe5-851f-6cc5a04d7825\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l97qz" Sep 08 10:57:34.264650 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.264468 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9621f8a4-0b41-438c-b45d-0e0d46cc0d6d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pvp4n\" (UID: \"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d\") " pod="openshift-monitoring/node-exporter-pvp4n" Sep 08 10:57:34.268655 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.265053 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9621f8a4-0b41-438c-b45d-0e0d46cc0d6d-node-exporter-wtmp\") pod \"node-exporter-pvp4n\" (UID: \"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d\") " pod="openshift-monitoring/node-exporter-pvp4n" Sep 08 10:57:34.268655 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.265108 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cvx7\" (UniqueName: \"kubernetes.io/projected/c3882461-2186-4fe5-851f-6cc5a04d7825-kube-api-access-5cvx7\") pod \"kube-state-metrics-74cb57df7-l97qz\" (UID: \"c3882461-2186-4fe5-851f-6cc5a04d7825\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l97qz" Sep 08 10:57:34.268655 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.265221 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab4fc548-56fe-41f1-81e3-f0edefc94eed-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-8x767\" (UID: \"ab4fc548-56fe-41f1-81e3-f0edefc94eed\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8x767" Sep 08 10:57:34.268655 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.265256 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9621f8a4-0b41-438c-b45d-0e0d46cc0d6d-metrics-client-ca\") pod \"node-exporter-pvp4n\" (UID: \"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d\") " pod="openshift-monitoring/node-exporter-pvp4n" Sep 08 10:57:34.268655 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.265289 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9621f8a4-0b41-438c-b45d-0e0d46cc0d6d-node-exporter-accelerators-collector-config\") pod \"node-exporter-pvp4n\" (UID: \"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d\") " pod="openshift-monitoring/node-exporter-pvp4n" Sep 08 10:57:34.268655 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.265329 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3882461-2186-4fe5-851f-6cc5a04d7825-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-l97qz\" (UID: \"c3882461-2186-4fe5-851f-6cc5a04d7825\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l97qz" Sep 08 10:57:34.268655 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.265363 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3882461-2186-4fe5-851f-6cc5a04d7825-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-l97qz\" (UID: \"c3882461-2186-4fe5-851f-6cc5a04d7825\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l97qz" Sep 08 10:57:34.268655 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.265432 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncr9l\" (UniqueName: \"kubernetes.io/projected/ab4fc548-56fe-41f1-81e3-f0edefc94eed-kube-api-access-ncr9l\") pod \"openshift-state-metrics-657fd6c54-8x767\" (UID: \"ab4fc548-56fe-41f1-81e3-f0edefc94eed\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8x767" Sep 08 10:57:34.366412 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.366381 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3882461-2186-4fe5-851f-6cc5a04d7825-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-l97qz\" (UID: \"c3882461-2186-4fe5-851f-6cc5a04d7825\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l97qz" Sep 08 10:57:34.366603 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.366420 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9621f8a4-0b41-438c-b45d-0e0d46cc0d6d-node-exporter-tls\") pod \"node-exporter-pvp4n\" (UID: \"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d\") " pod="openshift-monitoring/node-exporter-pvp4n" Sep 08 10:57:34.366603 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.366445 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwrpg\" (UniqueName: \"kubernetes.io/projected/9621f8a4-0b41-438c-b45d-0e0d46cc0d6d-kube-api-access-jwrpg\") pod \"node-exporter-pvp4n\" (UID: \"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d\") " pod="openshift-monitoring/node-exporter-pvp4n" Sep 08 10:57:34.366603 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.366581 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab4fc548-56fe-41f1-81e3-f0edefc94eed-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-8x767\" (UID: \"ab4fc548-56fe-41f1-81e3-f0edefc94eed\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8x767" Sep 08 10:57:34.366765 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.366628 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9621f8a4-0b41-438c-b45d-0e0d46cc0d6d-node-exporter-textfile\") pod \"node-exporter-pvp4n\" (UID: \"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d\") " pod="openshift-monitoring/node-exporter-pvp4n" Sep 08 10:57:34.366765 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.366657 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c3882461-2186-4fe5-851f-6cc5a04d7825-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-l97qz\" (UID: \"c3882461-2186-4fe5-851f-6cc5a04d7825\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l97qz" Sep 08 10:57:34.366765 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.366685 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9621f8a4-0b41-438c-b45d-0e0d46cc0d6d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pvp4n\" (UID: \"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d\") " pod="openshift-monitoring/node-exporter-pvp4n" Sep 08 10:57:34.366765 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.366721 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9621f8a4-0b41-438c-b45d-0e0d46cc0d6d-node-exporter-wtmp\") pod \"node-exporter-pvp4n\" (UID: \"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d\") " pod="openshift-monitoring/node-exporter-pvp4n" Sep 08 10:57:34.366765 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.366748 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cvx7\" (UniqueName: \"kubernetes.io/projected/c3882461-2186-4fe5-851f-6cc5a04d7825-kube-api-access-5cvx7\") pod \"kube-state-metrics-74cb57df7-l97qz\" (UID: \"c3882461-2186-4fe5-851f-6cc5a04d7825\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l97qz" Sep 08 10:57:34.367024 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.366775 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab4fc548-56fe-41f1-81e3-f0edefc94eed-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-8x767\" (UID: \"ab4fc548-56fe-41f1-81e3-f0edefc94eed\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8x767" Sep 08 10:57:34.367024 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.366804 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9621f8a4-0b41-438c-b45d-0e0d46cc0d6d-metrics-client-ca\") pod \"node-exporter-pvp4n\" (UID: \"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d\") " pod="openshift-monitoring/node-exporter-pvp4n" Sep 08 10:57:34.367024 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.366829 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9621f8a4-0b41-438c-b45d-0e0d46cc0d6d-node-exporter-accelerators-collector-config\") pod \"node-exporter-pvp4n\" (UID: \"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d\") " pod="openshift-monitoring/node-exporter-pvp4n" Sep 08 10:57:34.367024 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.366869 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3882461-2186-4fe5-851f-6cc5a04d7825-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-l97qz\" (UID: \"c3882461-2186-4fe5-851f-6cc5a04d7825\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l97qz" Sep 08 10:57:34.367024 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.366900 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3882461-2186-4fe5-851f-6cc5a04d7825-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-l97qz\" (UID: \"c3882461-2186-4fe5-851f-6cc5a04d7825\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l97qz" Sep 08 10:57:34.367024 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.366942 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncr9l\" (UniqueName: \"kubernetes.io/projected/ab4fc548-56fe-41f1-81e3-f0edefc94eed-kube-api-access-ncr9l\") pod \"openshift-state-metrics-657fd6c54-8x767\" (UID: \"ab4fc548-56fe-41f1-81e3-f0edefc94eed\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8x767" Sep 08 10:57:34.367024 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.367002 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9621f8a4-0b41-438c-b45d-0e0d46cc0d6d-sys\") pod \"node-exporter-pvp4n\" (UID: \"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d\") " pod="openshift-monitoring/node-exporter-pvp4n" Sep 08 10:57:34.367432 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.367016 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9621f8a4-0b41-438c-b45d-0e0d46cc0d6d-node-exporter-textfile\") pod \"node-exporter-pvp4n\" (UID: \"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d\") " pod="openshift-monitoring/node-exporter-pvp4n" Sep 08 10:57:34.367432 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.367036 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c3882461-2186-4fe5-851f-6cc5a04d7825-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-l97qz\" (UID: \"c3882461-2186-4fe5-851f-6cc5a04d7825\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l97qz" Sep 08 10:57:34.367432 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.367065 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9621f8a4-0b41-438c-b45d-0e0d46cc0d6d-root\") pod \"node-exporter-pvp4n\" (UID: \"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d\") " pod="openshift-monitoring/node-exporter-pvp4n" Sep 08 10:57:34.367432 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.367092 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab4fc548-56fe-41f1-81e3-f0edefc94eed-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-8x767\" (UID: \"ab4fc548-56fe-41f1-81e3-f0edefc94eed\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8x767" Sep 08 10:57:34.367432 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.367235 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9621f8a4-0b41-438c-b45d-0e0d46cc0d6d-node-exporter-wtmp\") pod \"node-exporter-pvp4n\" (UID: \"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d\") " pod="openshift-monitoring/node-exporter-pvp4n" Sep 08 10:57:34.367657 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:57:34.367445 2560 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 08 10:57:34.367657 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:57:34.367517 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab4fc548-56fe-41f1-81e3-f0edefc94eed-openshift-state-metrics-tls podName:ab4fc548-56fe-41f1-81e3-f0edefc94eed nodeName:}" failed. No retries permitted until 2026-09-08 10:57:34.867492078 +0000 UTC m=+95.500087557 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ab4fc548-56fe-41f1-81e3-f0edefc94eed-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-8x767" (UID: "ab4fc548-56fe-41f1-81e3-f0edefc94eed") : secret "openshift-state-metrics-tls" not found Sep 08 10:57:34.368614 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.367838 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c3882461-2186-4fe5-851f-6cc5a04d7825-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-l97qz\" (UID: \"c3882461-2186-4fe5-851f-6cc5a04d7825\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l97qz" Sep 08 10:57:34.368614 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.368152 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c3882461-2186-4fe5-851f-6cc5a04d7825-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-l97qz\" (UID: \"c3882461-2186-4fe5-851f-6cc5a04d7825\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l97qz" Sep 08 10:57:34.368614 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.368262 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3882461-2186-4fe5-851f-6cc5a04d7825-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-l97qz\" (UID: \"c3882461-2186-4fe5-851f-6cc5a04d7825\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l97qz" Sep 08 10:57:34.368614 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.368327 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9621f8a4-0b41-438c-b45d-0e0d46cc0d6d-root\") pod \"node-exporter-pvp4n\" (UID: \"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d\") " pod="openshift-monitoring/node-exporter-pvp4n" Sep 08 10:57:34.368614 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.368359 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9621f8a4-0b41-438c-b45d-0e0d46cc0d6d-metrics-client-ca\") pod \"node-exporter-pvp4n\" (UID: \"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d\") " pod="openshift-monitoring/node-exporter-pvp4n" Sep 08 10:57:34.368614 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.368465 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab4fc548-56fe-41f1-81e3-f0edefc94eed-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-8x767\" (UID: \"ab4fc548-56fe-41f1-81e3-f0edefc94eed\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8x767" Sep 08 10:57:34.368614 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.368540 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9621f8a4-0b41-438c-b45d-0e0d46cc0d6d-sys\") pod \"node-exporter-pvp4n\" (UID: \"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d\") " pod="openshift-monitoring/node-exporter-pvp4n" Sep 08 10:57:34.369053 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.368737 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9621f8a4-0b41-438c-b45d-0e0d46cc0d6d-node-exporter-accelerators-collector-config\") pod \"node-exporter-pvp4n\" (UID: \"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d\") " pod="openshift-monitoring/node-exporter-pvp4n" Sep 08 10:57:34.369523 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.369495 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab4fc548-56fe-41f1-81e3-f0edefc94eed-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-8x767\" (UID: \"ab4fc548-56fe-41f1-81e3-f0edefc94eed\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8x767" Sep 08 10:57:34.369628 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.369569 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9621f8a4-0b41-438c-b45d-0e0d46cc0d6d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pvp4n\" (UID: \"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d\") " pod="openshift-monitoring/node-exporter-pvp4n" Sep 08 10:57:34.369766 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.369743 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9621f8a4-0b41-438c-b45d-0e0d46cc0d6d-node-exporter-tls\") pod \"node-exporter-pvp4n\" (UID: \"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d\") " pod="openshift-monitoring/node-exporter-pvp4n" Sep 08 10:57:34.369837 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.369753 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3882461-2186-4fe5-851f-6cc5a04d7825-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-l97qz\" (UID: \"c3882461-2186-4fe5-851f-6cc5a04d7825\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l97qz" Sep 08 10:57:34.370641 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.370620 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3882461-2186-4fe5-851f-6cc5a04d7825-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-l97qz\" (UID: \"c3882461-2186-4fe5-851f-6cc5a04d7825\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l97qz" Sep 08 10:57:34.378548 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.378482 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cvx7\" (UniqueName: \"kubernetes.io/projected/c3882461-2186-4fe5-851f-6cc5a04d7825-kube-api-access-5cvx7\") pod \"kube-state-metrics-74cb57df7-l97qz\" (UID: \"c3882461-2186-4fe5-851f-6cc5a04d7825\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l97qz" Sep 08 10:57:34.378653 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.378566 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwrpg\" (UniqueName: \"kubernetes.io/projected/9621f8a4-0b41-438c-b45d-0e0d46cc0d6d-kube-api-access-jwrpg\") pod \"node-exporter-pvp4n\" (UID: \"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d\") " pod="openshift-monitoring/node-exporter-pvp4n" Sep 08 10:57:34.379870 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.379850 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncr9l\" (UniqueName: \"kubernetes.io/projected/ab4fc548-56fe-41f1-81e3-f0edefc94eed-kube-api-access-ncr9l\") pod \"openshift-state-metrics-657fd6c54-8x767\" (UID: \"ab4fc548-56fe-41f1-81e3-f0edefc94eed\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8x767" Sep 08 10:57:34.453524 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.453480 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pvp4n" Sep 08 10:57:34.463876 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.463848 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-l97qz" Sep 08 10:57:34.465656 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:57:34.465622 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9621f8a4_0b41_438c_b45d_0e0d46cc0d6d.slice/crio-bd5c38b5ee5b42235f28aa33bcbe2734a46f6b7b209473afb247cb5d546dd1ab WatchSource:0}: Error finding container bd5c38b5ee5b42235f28aa33bcbe2734a46f6b7b209473afb247cb5d546dd1ab: Status 404 returned error can't find the container with id bd5c38b5ee5b42235f28aa33bcbe2734a46f6b7b209473afb247cb5d546dd1ab Sep 08 10:57:34.740236 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.740211 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-l97qz"] Sep 08 10:57:34.742649 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:57:34.742622 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3882461_2186_4fe5_851f_6cc5a04d7825.slice/crio-30ba6c8b084f9c0bff20b56a0c2421610dfac6ee7a476c756cb9eb5010b337fb WatchSource:0}: Error finding container 30ba6c8b084f9c0bff20b56a0c2421610dfac6ee7a476c756cb9eb5010b337fb: Status 404 returned error can't find the container with id 30ba6c8b084f9c0bff20b56a0c2421610dfac6ee7a476c756cb9eb5010b337fb Sep 08 10:57:34.871321 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.871272 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab4fc548-56fe-41f1-81e3-f0edefc94eed-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-8x767\" (UID: \"ab4fc548-56fe-41f1-81e3-f0edefc94eed\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8x767" Sep 08 10:57:34.873803 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:34.873775 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab4fc548-56fe-41f1-81e3-f0edefc94eed-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-8x767\" (UID: \"ab4fc548-56fe-41f1-81e3-f0edefc94eed\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8x767" Sep 08 10:57:35.039481 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.039455 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8x767" Sep 08 10:57:35.267544 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.267503 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 08 10:57:35.272594 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.272548 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.273273 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.273253 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-84c5985848-9rztx" Sep 08 10:57:35.277261 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.277233 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 08 10:57:35.277416 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.277284 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 08 10:57:35.277416 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.277388 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 08 10:57:35.277530 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.277445 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 08 10:57:35.277947 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.277929 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 08 10:57:35.278202 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.278155 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 08 10:57:35.278276 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.278194 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qzfxp\"" Sep 08 10:57:35.278329 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.278300 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 08 10:57:35.278672 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.278657 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 08 10:57:35.278844 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.278823 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 08 10:57:35.291532 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.291458 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 08 10:57:35.321837 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.321808 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-8x767"] Sep 08 10:57:35.325837 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:57:35.325813 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab4fc548_56fe_41f1_81e3_f0edefc94eed.slice/crio-a57050bd2b1d14fc9094c4e545707fbbd90ac826cd30a77edc358fc76c18dd86 WatchSource:0}: Error finding container a57050bd2b1d14fc9094c4e545707fbbd90ac826cd30a77edc358fc76c18dd86: Status 404 returned error can't find the container with id a57050bd2b1d14fc9094c4e545707fbbd90ac826cd30a77edc358fc76c18dd86 Sep 08 10:57:35.364493 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.364462 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pvp4n" event={"ID":"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d","Type":"ContainerStarted","Data":"bd5c38b5ee5b42235f28aa33bcbe2734a46f6b7b209473afb247cb5d546dd1ab"} Sep 08 10:57:35.365788 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.365759 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-l97qz" event={"ID":"c3882461-2186-4fe5-851f-6cc5a04d7825","Type":"ContainerStarted","Data":"30ba6c8b084f9c0bff20b56a0c2421610dfac6ee7a476c756cb9eb5010b337fb"} Sep 08 10:57:35.367061 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.367025 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8x767" event={"ID":"ab4fc548-56fe-41f1-81e3-f0edefc94eed","Type":"ContainerStarted","Data":"a57050bd2b1d14fc9094c4e545707fbbd90ac826cd30a77edc358fc76c18dd86"} Sep 08 10:57:35.376150 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.376108 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.376277 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.376157 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6fa28949-a2f6-424b-9d5f-8c736ec119a3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.376335 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.376308 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.376380 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.376365 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.376420 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.376402 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6fa28949-a2f6-424b-9d5f-8c736ec119a3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.376479 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.376464 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-config-volume\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.376512 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.376492 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.376554 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.376521 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6fa28949-a2f6-424b-9d5f-8c736ec119a3-config-out\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.376554 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.376543 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqjfw\" (UniqueName: \"kubernetes.io/projected/6fa28949-a2f6-424b-9d5f-8c736ec119a3-kube-api-access-kqjfw\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.376637 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.376573 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.376637 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.376613 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fa28949-a2f6-424b-9d5f-8c736ec119a3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.376740 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.376656 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fa28949-a2f6-424b-9d5f-8c736ec119a3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.376740 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.376726 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-web-config\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.477406 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.477379 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-web-config\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.477928 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.477909 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.478098 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.478083 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6fa28949-a2f6-424b-9d5f-8c736ec119a3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.478258 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.478242 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.478402 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.478388 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.478507 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.478493 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6fa28949-a2f6-424b-9d5f-8c736ec119a3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.478602 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.478591 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-config-volume\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.478692 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.478679 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.478796 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.478782 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6fa28949-a2f6-424b-9d5f-8c736ec119a3-config-out\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.478908 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.478895 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqjfw\" (UniqueName: \"kubernetes.io/projected/6fa28949-a2f6-424b-9d5f-8c736ec119a3-kube-api-access-kqjfw\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.479020 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.479005 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.480335 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.479203 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fa28949-a2f6-424b-9d5f-8c736ec119a3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.481151 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.478899 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6fa28949-a2f6-424b-9d5f-8c736ec119a3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.481151 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:57:35.478603 2560 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 08 10:57:35.481151 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.480283 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fa28949-a2f6-424b-9d5f-8c736ec119a3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.481151 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.480835 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-web-config\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.481151 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:57:35.480858 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-secret-alertmanager-main-tls podName:6fa28949-a2f6-424b-9d5f-8c736ec119a3 nodeName:}" failed. No retries permitted until 2026-09-08 10:57:35.980834089 +0000 UTC m=+96.613429550 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "6fa28949-a2f6-424b-9d5f-8c736ec119a3") : secret "alertmanager-main-tls" not found Sep 08 10:57:35.481151 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.480901 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fa28949-a2f6-424b-9d5f-8c736ec119a3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.481533 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.481447 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.481676 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.481649 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.481769 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.481747 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fa28949-a2f6-424b-9d5f-8c736ec119a3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.482402 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.482364 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-config-volume\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.483482 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.483459 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6fa28949-a2f6-424b-9d5f-8c736ec119a3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.483587 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.483570 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6fa28949-a2f6-424b-9d5f-8c736ec119a3-config-out\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.483738 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.483720 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.484569 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.484549 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.488010 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.487987 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqjfw\" (UniqueName: \"kubernetes.io/projected/6fa28949-a2f6-424b-9d5f-8c736ec119a3-kube-api-access-kqjfw\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.931505 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.931467 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:35.984874 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.984838 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:35.987896 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:35.987871 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:36.031085 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:36.031048 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:36.131811 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:36.131778 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:36.183645 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:36.183556 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:57:36.374802 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:36.374768 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8x767" event={"ID":"ab4fc548-56fe-41f1-81e3-f0edefc94eed","Type":"ContainerStarted","Data":"38e82bc5e35e6607300a9fa4f215eb441a1061910e3b8765e35ee51f030984a0"} Sep 08 10:57:36.375137 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:36.374831 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8x767" event={"ID":"ab4fc548-56fe-41f1-81e3-f0edefc94eed","Type":"ContainerStarted","Data":"b8367a36217e40d67eae8c5b2f94d8820c0cd37579474529bcafbe219e22428c"} Sep 08 10:57:36.588894 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:36.588726 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 08 10:57:36.591768 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:57:36.591743 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fa28949_a2f6_424b_9d5f_8c736ec119a3.slice/crio-8ce62569172a57a03f389692fed621da870a12bb6d17ac1018ebb2ade35676c9 WatchSource:0}: Error finding container 8ce62569172a57a03f389692fed621da870a12bb6d17ac1018ebb2ade35676c9: Status 404 returned error can't find the container with id 8ce62569172a57a03f389692fed621da870a12bb6d17ac1018ebb2ade35676c9 Sep 08 10:57:36.690202 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:36.690090 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:36.759296 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:36.759254 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:37.155993 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.155956 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5b765d77d5-9svtb"] Sep 08 10:57:37.159676 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.159659 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" Sep 08 10:57:37.162513 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.162483 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6z9x5\"" Sep 08 10:57:37.162731 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.162709 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-e6tp53c9e4slk\"" Sep 08 10:57:37.162808 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.162728 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 08 10:57:37.162808 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.162797 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 08 10:57:37.162915 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.162802 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 08 10:57:37.162915 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.162848 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 08 10:57:37.162915 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.162889 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 08 10:57:37.174791 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.174768 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5b765d77d5-9svtb"] Sep 08 10:57:37.234230 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.234204 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pdd9x" Sep 08 10:57:37.295281 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.295253 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5a16da84-2c59-40b5-81ba-c1cccca048cf-secret-grpc-tls\") pod \"thanos-querier-5b765d77d5-9svtb\" (UID: \"5a16da84-2c59-40b5-81ba-c1cccca048cf\") " pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" Sep 08 10:57:37.295459 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.295305 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5a16da84-2c59-40b5-81ba-c1cccca048cf-secret-thanos-querier-tls\") pod \"thanos-querier-5b765d77d5-9svtb\" (UID: \"5a16da84-2c59-40b5-81ba-c1cccca048cf\") " pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" Sep 08 10:57:37.295459 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.295324 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7dzx\" (UniqueName: \"kubernetes.io/projected/5a16da84-2c59-40b5-81ba-c1cccca048cf-kube-api-access-z7dzx\") pod \"thanos-querier-5b765d77d5-9svtb\" (UID: \"5a16da84-2c59-40b5-81ba-c1cccca048cf\") " pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" Sep 08 10:57:37.295459 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.295371 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a16da84-2c59-40b5-81ba-c1cccca048cf-metrics-client-ca\") pod \"thanos-querier-5b765d77d5-9svtb\" (UID: \"5a16da84-2c59-40b5-81ba-c1cccca048cf\") " pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" Sep 08 10:57:37.295609 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.295478 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5a16da84-2c59-40b5-81ba-c1cccca048cf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b765d77d5-9svtb\" (UID: \"5a16da84-2c59-40b5-81ba-c1cccca048cf\") " pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" Sep 08 10:57:37.295609 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.295522 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5a16da84-2c59-40b5-81ba-c1cccca048cf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b765d77d5-9svtb\" (UID: \"5a16da84-2c59-40b5-81ba-c1cccca048cf\") " pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" Sep 08 10:57:37.295609 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.295560 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a16da84-2c59-40b5-81ba-c1cccca048cf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b765d77d5-9svtb\" (UID: \"5a16da84-2c59-40b5-81ba-c1cccca048cf\") " pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" Sep 08 10:57:37.295609 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.295580 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a16da84-2c59-40b5-81ba-c1cccca048cf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b765d77d5-9svtb\" (UID: \"5a16da84-2c59-40b5-81ba-c1cccca048cf\") " pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" Sep 08 10:57:37.379798 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.379761 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6fa28949-a2f6-424b-9d5f-8c736ec119a3","Type":"ContainerStarted","Data":"8ce62569172a57a03f389692fed621da870a12bb6d17ac1018ebb2ade35676c9"} Sep 08 10:57:37.381825 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.381800 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8x767" event={"ID":"ab4fc548-56fe-41f1-81e3-f0edefc94eed","Type":"ContainerStarted","Data":"0618325dfcceba8f7c5ad7474f11bba718bdbfd33b383cecb69a625b35ccbf10"} Sep 08 10:57:37.396271 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.396242 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5a16da84-2c59-40b5-81ba-c1cccca048cf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b765d77d5-9svtb\" (UID: \"5a16da84-2c59-40b5-81ba-c1cccca048cf\") " pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" Sep 08 10:57:37.396387 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.396279 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5a16da84-2c59-40b5-81ba-c1cccca048cf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b765d77d5-9svtb\" (UID: \"5a16da84-2c59-40b5-81ba-c1cccca048cf\") " pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" Sep 08 10:57:37.396387 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.396314 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a16da84-2c59-40b5-81ba-c1cccca048cf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b765d77d5-9svtb\" (UID: \"5a16da84-2c59-40b5-81ba-c1cccca048cf\") " pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" Sep 08 10:57:37.396387 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.396332 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a16da84-2c59-40b5-81ba-c1cccca048cf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b765d77d5-9svtb\" (UID: \"5a16da84-2c59-40b5-81ba-c1cccca048cf\") " pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" Sep 08 10:57:37.396387 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.396365 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5a16da84-2c59-40b5-81ba-c1cccca048cf-secret-grpc-tls\") pod \"thanos-querier-5b765d77d5-9svtb\" (UID: \"5a16da84-2c59-40b5-81ba-c1cccca048cf\") " pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" Sep 08 10:57:37.396596 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.396425 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5a16da84-2c59-40b5-81ba-c1cccca048cf-secret-thanos-querier-tls\") pod \"thanos-querier-5b765d77d5-9svtb\" (UID: \"5a16da84-2c59-40b5-81ba-c1cccca048cf\") " pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" Sep 08 10:57:37.396596 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.396450 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7dzx\" (UniqueName: \"kubernetes.io/projected/5a16da84-2c59-40b5-81ba-c1cccca048cf-kube-api-access-z7dzx\") pod \"thanos-querier-5b765d77d5-9svtb\" (UID: \"5a16da84-2c59-40b5-81ba-c1cccca048cf\") " pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" Sep 08 10:57:37.396596 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.396472 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a16da84-2c59-40b5-81ba-c1cccca048cf-metrics-client-ca\") pod \"thanos-querier-5b765d77d5-9svtb\" (UID: \"5a16da84-2c59-40b5-81ba-c1cccca048cf\") " pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" Sep 08 10:57:37.397517 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.397384 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a16da84-2c59-40b5-81ba-c1cccca048cf-metrics-client-ca\") pod \"thanos-querier-5b765d77d5-9svtb\" (UID: \"5a16da84-2c59-40b5-81ba-c1cccca048cf\") " pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" Sep 08 10:57:37.399377 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.399083 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a16da84-2c59-40b5-81ba-c1cccca048cf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b765d77d5-9svtb\" (UID: \"5a16da84-2c59-40b5-81ba-c1cccca048cf\") " pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" Sep 08 10:57:37.399377 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.399324 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5a16da84-2c59-40b5-81ba-c1cccca048cf-secret-thanos-querier-tls\") pod \"thanos-querier-5b765d77d5-9svtb\" (UID: \"5a16da84-2c59-40b5-81ba-c1cccca048cf\") " pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" Sep 08 10:57:37.399650 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.399627 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a16da84-2c59-40b5-81ba-c1cccca048cf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b765d77d5-9svtb\" (UID: \"5a16da84-2c59-40b5-81ba-c1cccca048cf\") " pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" Sep 08 10:57:37.399867 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.399843 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5a16da84-2c59-40b5-81ba-c1cccca048cf-secret-grpc-tls\") pod \"thanos-querier-5b765d77d5-9svtb\" (UID: \"5a16da84-2c59-40b5-81ba-c1cccca048cf\") " pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" Sep 08 10:57:37.400425 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.400402 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5a16da84-2c59-40b5-81ba-c1cccca048cf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b765d77d5-9svtb\" (UID: \"5a16da84-2c59-40b5-81ba-c1cccca048cf\") " pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" Sep 08 10:57:37.400543 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.400522 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5a16da84-2c59-40b5-81ba-c1cccca048cf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b765d77d5-9svtb\" (UID: \"5a16da84-2c59-40b5-81ba-c1cccca048cf\") " pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" Sep 08 10:57:37.400650 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.400616 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8x767" podStartSLOduration=2.504937035 podStartE2EDuration="3.40060336s" totalImagesPullingTime="895.666325ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:57:37.399749563 +0000 UTC m=+98.032345054" watchObservedRunningTime="2026-09-08 10:57:37.40060336 +0000 UTC m=+98.033198837" Sep 08 10:57:37.405608 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.405585 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7dzx\" (UniqueName: \"kubernetes.io/projected/5a16da84-2c59-40b5-81ba-c1cccca048cf-kube-api-access-z7dzx\") pod \"thanos-querier-5b765d77d5-9svtb\" (UID: \"5a16da84-2c59-40b5-81ba-c1cccca048cf\") " pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" Sep 08 10:57:37.469577 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.469491 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" Sep 08 10:57:37.748675 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:37.748553 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5b765d77d5-9svtb"] Sep 08 10:57:37.750838 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:57:37.750810 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a16da84_2c59_40b5_81ba_c1cccca048cf.slice/crio-6b0565611e163351e964f59285802e577a0de29965281984e2180a8775e13a2f WatchSource:0}: Error finding container 6b0565611e163351e964f59285802e577a0de29965281984e2180a8775e13a2f: Status 404 returned error can't find the container with id 6b0565611e163351e964f59285802e577a0de29965281984e2180a8775e13a2f Sep 08 10:57:38.388950 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:38.388902 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" event={"ID":"5a16da84-2c59-40b5-81ba-c1cccca048cf","Type":"ContainerStarted","Data":"6b0565611e163351e964f59285802e577a0de29965281984e2180a8775e13a2f"} Sep 08 10:57:39.235953 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:39.235861 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84f64cf968-n7vfq" Sep 08 10:57:39.235953 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:39.235924 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84f64cf968-n7vfq" Sep 08 10:57:39.241844 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:39.241817 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84f64cf968-n7vfq" Sep 08 10:57:39.398006 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:39.397975 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-l97qz" event={"ID":"c3882461-2186-4fe5-851f-6cc5a04d7825","Type":"ContainerStarted","Data":"c85c39f23ced0d8dbac226ec58655fa9a98b43859bec465862d0879004ed54fa"} Sep 08 10:57:39.402109 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:39.402074 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pvp4n" event={"ID":"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d","Type":"ContainerStarted","Data":"960aacd8e5537068ab69a280708abbbb8b18fb496c00abaae873185f61062293"} Sep 08 10:57:39.409138 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:39.409109 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84f64cf968-n7vfq" Sep 08 10:57:40.408398 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.408357 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-l97qz" event={"ID":"c3882461-2186-4fe5-851f-6cc5a04d7825","Type":"ContainerStarted","Data":"1304787b3a629c045424ae6e323e007e2552db894d2e4a9dbee64a061dc6e26a"} Sep 08 10:57:40.408874 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.408428 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-l97qz" event={"ID":"c3882461-2186-4fe5-851f-6cc5a04d7825","Type":"ContainerStarted","Data":"801042d40bbb0ca81234e288cc54de4aa227c3f6a59ece66080d4094e489c63e"} Sep 08 10:57:40.410829 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.410802 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" event={"ID":"5a16da84-2c59-40b5-81ba-c1cccca048cf","Type":"ContainerStarted","Data":"6aa73e2d4f4cb6b156ae13e7a3060016758f2db0d3b7bc2dc44f622b1cce2874"} Sep 08 10:57:40.410960 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.410859 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" event={"ID":"5a16da84-2c59-40b5-81ba-c1cccca048cf","Type":"ContainerStarted","Data":"ba65df8c9264ee8c6bb54d311bfd3fc514d397ff822e2249d6f6b76d591a92d1"} Sep 08 10:57:40.410960 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.410899 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" event={"ID":"5a16da84-2c59-40b5-81ba-c1cccca048cf","Type":"ContainerStarted","Data":"198a75696da207d30d53dba5fb1430585d697b18f8a60c219ffd8598c05688a2"} Sep 08 10:57:40.412577 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.412552 2560 generic.go:356] "Generic (PLEG): container finished" podID="9621f8a4-0b41-438c-b45d-0e0d46cc0d6d" containerID="960aacd8e5537068ab69a280708abbbb8b18fb496c00abaae873185f61062293" exitCode=0 Sep 08 10:57:40.412666 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.412632 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pvp4n" event={"ID":"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d","Type":"ContainerDied","Data":"960aacd8e5537068ab69a280708abbbb8b18fb496c00abaae873185f61062293"} Sep 08 10:57:40.421504 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.421483 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 08 10:57:40.425658 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.425639 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.428459 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.428437 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 08 10:57:40.428704 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.428674 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 08 10:57:40.429032 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.429013 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 08 10:57:40.429113 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.429015 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 08 10:57:40.429190 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.429117 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-58ekot3m9ftb1\"" Sep 08 10:57:40.429420 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.429403 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 08 10:57:40.429721 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.429702 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 08 10:57:40.429867 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.429849 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 08 10:57:40.429931 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.429873 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9292k\"" Sep 08 10:57:40.429931 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.429889 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 08 10:57:40.430021 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.429813 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 08 10:57:40.430021 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.429779 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 08 10:57:40.430021 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.429824 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 08 10:57:40.430021 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.429830 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 08 10:57:40.430249 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.429736 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 08 10:57:40.430249 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.430238 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 08 10:57:40.439554 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.439123 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 08 10:57:40.439956 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.439911 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-l97qz" podStartSLOduration=1.86541023 podStartE2EDuration="6.439896297s" totalImagesPullingTime="4.574486067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:57:40.439419078 +0000 UTC m=+101.072014556" watchObservedRunningTime="2026-09-08 10:57:40.439896297 +0000 UTC m=+101.072491774" Sep 08 10:57:40.455654 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.455624 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 08 10:57:40.485406 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.485374 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:40.527871 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.527848 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.527988 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.527894 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-web-config\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.527988 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.527919 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.528101 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.528070 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-config\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.528153 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.528105 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.528153 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.528145 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.528322 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.528296 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-config-out\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.528426 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.528401 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.528499 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.528480 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.528558 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.528541 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.528619 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.528572 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grtzj\" (UniqueName: \"kubernetes.io/projected/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-kube-api-access-grtzj\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.528619 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.528606 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.528718 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.528632 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.528718 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.528658 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.528718 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.528684 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.528866 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.528847 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.528969 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.528916 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.529052 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.529022 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.529210 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.529068 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.529210 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.529111 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.593717 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.593677 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:40.629827 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.629792 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.630025 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.629835 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.630025 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.629855 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.630025 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.629965 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.630025 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.630001 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.630265 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.630122 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-web-config\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.630265 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.630191 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.630265 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.630255 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-config\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.630427 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.630282 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.630427 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.630314 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.630427 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.630343 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-config-out\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.630427 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.630387 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.630617 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.630440 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.630617 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.630473 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.630617 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.630500 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grtzj\" (UniqueName: \"kubernetes.io/projected/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-kube-api-access-grtzj\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.630617 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.630531 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.630617 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.630570 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.630617 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.630598 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.630617 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.630623 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.631122 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.630666 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.631122 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.631012 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.632546 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.631400 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.632546 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.631870 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.632546 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.631928 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.632546 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.632248 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.632546 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.632351 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.634398 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.633222 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.634398 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.633414 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.634398 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.633701 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.634398 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.634359 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.634398 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.634379 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.634921 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.634883 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.635325 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.635237 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-web-config\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.635560 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.635538 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.635671 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.635650 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.635938 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.635918 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-config-out\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.636390 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.636364 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.636781 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.636763 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.636923 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.636906 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-config\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.645304 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.645280 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grtzj\" (UniqueName: \"kubernetes.io/projected/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-kube-api-access-grtzj\") pod \"prometheus-k8s-0\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:40.695457 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.695365 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:40.763140 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:40.763097 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:57:41.053898 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:41.053875 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 08 10:57:41.056174 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:57:41.056131 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf61e5d61_60ab_4fb6_8227_8f14f8680ca1.slice/crio-96b59c0c98832ff5940fab5bde60cc69a6bba8b42bc99f08973565a415d50061 WatchSource:0}: Error finding container 96b59c0c98832ff5940fab5bde60cc69a6bba8b42bc99f08973565a415d50061: Status 404 returned error can't find the container with id 96b59c0c98832ff5940fab5bde60cc69a6bba8b42bc99f08973565a415d50061 Sep 08 10:57:41.420779 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:41.420682 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f61e5d61-60ab-4fb6-8227-8f14f8680ca1","Type":"ContainerStarted","Data":"96b59c0c98832ff5940fab5bde60cc69a6bba8b42bc99f08973565a415d50061"} Sep 08 10:57:41.422805 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:41.422780 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pvp4n" event={"ID":"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d","Type":"ContainerStarted","Data":"f9cfc6b3cf75fefdbb8d9a157dc81c070657492c0d3c4a9d7f5f7045473de26b"} Sep 08 10:57:41.422916 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:41.422825 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pvp4n" event={"ID":"9621f8a4-0b41-438c-b45d-0e0d46cc0d6d","Type":"ContainerStarted","Data":"74c33e962dd9aa035f51fe08fe82fcb223d07ae28bb71cf8f7b081853fa5a79e"} Sep 08 10:57:41.445354 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:41.445305 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pvp4n" podStartSLOduration=2.91383322 podStartE2EDuration="7.445290143s" totalImagesPullingTime="4.444980972s" totalInitContainerRuntime="86.475951ms" isStatefulPod=true podCreationTimestamp="2026-09-08 10:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:57:41.444901961 +0000 UTC m=+102.077497441" watchObservedRunningTime="2026-09-08 10:57:41.445290143 +0000 UTC m=+102.077885612" Sep 08 10:57:42.949929 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:42.949836 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:43.030664 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:43.030628 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:43.431947 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:43.431915 2560 generic.go:356] "Generic (PLEG): container finished" podID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerID="a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2" exitCode=0 Sep 08 10:57:43.432113 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:43.432005 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f61e5d61-60ab-4fb6-8227-8f14f8680ca1","Type":"ContainerDied","Data":"a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2"} Sep 08 10:57:44.440373 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:44.440330 2560 generic.go:356] "Generic (PLEG): container finished" podID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerID="b4a1bb28f45653456316023186b4892398f31cb3740dfb31458eade6d63805ab" exitCode=0 Sep 08 10:57:44.440823 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:44.440381 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6fa28949-a2f6-424b-9d5f-8c736ec119a3","Type":"ContainerDied","Data":"b4a1bb28f45653456316023186b4892398f31cb3740dfb31458eade6d63805ab"} Sep 08 10:57:45.153377 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:45.153337 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:45.450231 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:45.450136 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" event={"ID":"5a16da84-2c59-40b5-81ba-c1cccca048cf","Type":"ContainerStarted","Data":"c0fd8118a73df267b8dca4f6b2771b07b953348f87d688bdaeb37cfee7216eae"} Sep 08 10:57:45.450604 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:45.450238 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" event={"ID":"5a16da84-2c59-40b5-81ba-c1cccca048cf","Type":"ContainerStarted","Data":"02b2169b4a68f804ddd07050014d409953ece0b34ca22a761336409d678f1398"} Sep 08 10:57:45.450604 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:45.450282 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" event={"ID":"5a16da84-2c59-40b5-81ba-c1cccca048cf","Type":"ContainerStarted","Data":"a96d618fa7a086567247e18524ba2aadbb6046eedd5269f3a91964e6f679799e"} Sep 08 10:57:45.450753 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:45.450736 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" Sep 08 10:57:45.458966 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:45.458918 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" Sep 08 10:57:45.478464 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:45.478410 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5b765d77d5-9svtb" podStartSLOduration=1.815780535 podStartE2EDuration="8.478388282s" totalImagesPullingTime="6.662607747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:57:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:57:45.47548602 +0000 UTC m=+106.108081502" watchObservedRunningTime="2026-09-08 10:57:45.478388282 +0000 UTC m=+106.110983764" Sep 08 10:57:47.465233 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:47.465199 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6fa28949-a2f6-424b-9d5f-8c736ec119a3","Type":"ContainerStarted","Data":"56f77235c7afc60d31265a31a5f5aaaf2abdcdbeefd97a84546a00ebf0b44e5f"} Sep 08 10:57:47.465575 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:47.465282 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6fa28949-a2f6-424b-9d5f-8c736ec119a3","Type":"ContainerStarted","Data":"bed00f1a2210548ca4753e5967fca939c9d29937e16eafd7dd55a646da58c568"} Sep 08 10:57:47.465575 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:47.465323 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6fa28949-a2f6-424b-9d5f-8c736ec119a3","Type":"ContainerStarted","Data":"10b19b1b1f4d9b4f9d6aa0235f6a5bef3ea8a5fed185b1fff9fd61a8b27d6f79"} Sep 08 10:57:47.468721 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:47.468694 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f61e5d61-60ab-4fb6-8227-8f14f8680ca1","Type":"ContainerStarted","Data":"c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e"} Sep 08 10:57:47.468798 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:47.468759 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f61e5d61-60ab-4fb6-8227-8f14f8680ca1","Type":"ContainerStarted","Data":"feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e"} Sep 08 10:57:47.468798 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:47.468785 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f61e5d61-60ab-4fb6-8227-8f14f8680ca1","Type":"ContainerStarted","Data":"70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea"} Sep 08 10:57:48.477094 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:48.477058 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f61e5d61-60ab-4fb6-8227-8f14f8680ca1","Type":"ContainerStarted","Data":"c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab"} Sep 08 10:57:48.477620 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:48.477140 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f61e5d61-60ab-4fb6-8227-8f14f8680ca1","Type":"ContainerStarted","Data":"7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb"} Sep 08 10:57:48.477620 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:48.477211 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f61e5d61-60ab-4fb6-8227-8f14f8680ca1","Type":"ContainerStarted","Data":"df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61"} Sep 08 10:57:48.480319 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:48.480272 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6fa28949-a2f6-424b-9d5f-8c736ec119a3","Type":"ContainerStarted","Data":"4997fe13d5744715b799cc809445dd3544c7ffe08d07de6ef47ec10c262c30ec"} Sep 08 10:57:48.480453 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:48.480338 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6fa28949-a2f6-424b-9d5f-8c736ec119a3","Type":"ContainerStarted","Data":"83e71536491f3f01507da2e1bd8344320fb3aa13f6ccaa76804d16244928a95e"} Sep 08 10:57:48.480453 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:48.480365 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6fa28949-a2f6-424b-9d5f-8c736ec119a3","Type":"ContainerStarted","Data":"9f365f6b114fd950bee023b7b38d96fa3a667ef085883ccf0eebb198ec730c52"} Sep 08 10:57:48.508686 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:48.508638 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.201007126 podStartE2EDuration="8.508623963s" totalImagesPullingTime="5.284843028s" totalInitContainerRuntime="22.773809ms" isStatefulPod=false podCreationTimestamp="2026-09-08 10:57:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:57:48.507107372 +0000 UTC m=+109.139702867" watchObservedRunningTime="2026-09-08 10:57:48.508623963 +0000 UTC m=+109.141219440" Sep 08 10:57:48.542206 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:48.541519 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.602538643 podStartE2EDuration="13.541496016s" totalImagesPullingTime="9.923652357s" totalInitContainerRuntime="15.305016ms" isStatefulPod=false podCreationTimestamp="2026-09-08 10:57:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:57:48.537434913 +0000 UTC m=+109.170030392" watchObservedRunningTime="2026-09-08 10:57:48.541496016 +0000 UTC m=+109.174091495" Sep 08 10:57:48.667010 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:48.666976 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:48.766799 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:48.766682 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:50.444039 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:50.444009 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84f64cf968-n7vfq"] Sep 08 10:57:50.557732 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:50.557672 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:50.664543 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:50.664501 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:50.759881 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:50.759792 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:57:50.763695 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:57:50.763678 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:58:03.092515 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:03.092476 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:58:03.167479 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:03.167447 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:58:06.270469 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:06.270435 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:58:06.344761 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:06.344725 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:58:15.465662 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:15.465594 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-84f64cf968-n7vfq" podUID="7933eb8f-b728-4eac-8d90-228e3472cdad" containerName="console" containerID="cri-o://9ff1124ac475ebe3347141739c9d90a308f5b26224659b63a5ee0c469cb9e4e0" gracePeriod=15 Sep 08 10:58:15.598220 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:15.598179 2560 generic.go:356] "Generic (PLEG): container finished" podID="7933eb8f-b728-4eac-8d90-228e3472cdad" containerID="9ff1124ac475ebe3347141739c9d90a308f5b26224659b63a5ee0c469cb9e4e0" exitCode=0 Sep 08 10:58:15.598220 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:15.598201 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f64cf968-n7vfq" event={"ID":"7933eb8f-b728-4eac-8d90-228e3472cdad","Type":"ContainerDied","Data":"9ff1124ac475ebe3347141739c9d90a308f5b26224659b63a5ee0c469cb9e4e0"} Sep 08 10:58:15.714678 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:15.714655 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f64cf968-n7vfq" Sep 08 10:58:15.855951 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:15.855920 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7933eb8f-b728-4eac-8d90-228e3472cdad-console-serving-cert\") pod \"7933eb8f-b728-4eac-8d90-228e3472cdad\" (UID: \"7933eb8f-b728-4eac-8d90-228e3472cdad\") " Sep 08 10:58:15.856139 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:15.855971 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7933eb8f-b728-4eac-8d90-228e3472cdad-oauth-serving-cert\") pod \"7933eb8f-b728-4eac-8d90-228e3472cdad\" (UID: \"7933eb8f-b728-4eac-8d90-228e3472cdad\") " Sep 08 10:58:15.856139 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:15.856021 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7933eb8f-b728-4eac-8d90-228e3472cdad-trusted-ca-bundle\") pod \"7933eb8f-b728-4eac-8d90-228e3472cdad\" (UID: \"7933eb8f-b728-4eac-8d90-228e3472cdad\") " Sep 08 10:58:15.856139 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:15.856043 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4j7rn\" (UniqueName: \"kubernetes.io/projected/7933eb8f-b728-4eac-8d90-228e3472cdad-kube-api-access-4j7rn\") pod \"7933eb8f-b728-4eac-8d90-228e3472cdad\" (UID: \"7933eb8f-b728-4eac-8d90-228e3472cdad\") " Sep 08 10:58:15.856139 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:15.856067 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7933eb8f-b728-4eac-8d90-228e3472cdad-console-config\") pod \"7933eb8f-b728-4eac-8d90-228e3472cdad\" (UID: \"7933eb8f-b728-4eac-8d90-228e3472cdad\") " Sep 08 10:58:15.856139 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:15.856092 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7933eb8f-b728-4eac-8d90-228e3472cdad-console-oauth-config\") pod \"7933eb8f-b728-4eac-8d90-228e3472cdad\" (UID: \"7933eb8f-b728-4eac-8d90-228e3472cdad\") " Sep 08 10:58:15.856139 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:15.856126 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7933eb8f-b728-4eac-8d90-228e3472cdad-service-ca\") pod \"7933eb8f-b728-4eac-8d90-228e3472cdad\" (UID: \"7933eb8f-b728-4eac-8d90-228e3472cdad\") " Sep 08 10:58:15.856621 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:15.856575 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7933eb8f-b728-4eac-8d90-228e3472cdad-console-config" (OuterVolumeSpecName: "console-config") pod "7933eb8f-b728-4eac-8d90-228e3472cdad" (UID: "7933eb8f-b728-4eac-8d90-228e3472cdad"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 10:58:15.856621 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:15.856595 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7933eb8f-b728-4eac-8d90-228e3472cdad-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7933eb8f-b728-4eac-8d90-228e3472cdad" (UID: "7933eb8f-b728-4eac-8d90-228e3472cdad"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 10:58:15.856728 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:15.856615 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7933eb8f-b728-4eac-8d90-228e3472cdad-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7933eb8f-b728-4eac-8d90-228e3472cdad" (UID: "7933eb8f-b728-4eac-8d90-228e3472cdad"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 10:58:15.856728 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:15.856713 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7933eb8f-b728-4eac-8d90-228e3472cdad-service-ca" (OuterVolumeSpecName: "service-ca") pod "7933eb8f-b728-4eac-8d90-228e3472cdad" (UID: "7933eb8f-b728-4eac-8d90-228e3472cdad"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 10:58:15.858458 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:15.858427 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7933eb8f-b728-4eac-8d90-228e3472cdad-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7933eb8f-b728-4eac-8d90-228e3472cdad" (UID: "7933eb8f-b728-4eac-8d90-228e3472cdad"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:58:15.858458 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:15.858440 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7933eb8f-b728-4eac-8d90-228e3472cdad-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7933eb8f-b728-4eac-8d90-228e3472cdad" (UID: "7933eb8f-b728-4eac-8d90-228e3472cdad"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:58:15.858590 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:15.858457 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7933eb8f-b728-4eac-8d90-228e3472cdad-kube-api-access-4j7rn" (OuterVolumeSpecName: "kube-api-access-4j7rn") pod "7933eb8f-b728-4eac-8d90-228e3472cdad" (UID: "7933eb8f-b728-4eac-8d90-228e3472cdad"). InnerVolumeSpecName "kube-api-access-4j7rn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 10:58:15.957743 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:15.957709 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7933eb8f-b728-4eac-8d90-228e3472cdad-trusted-ca-bundle\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:15.957743 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:15.957738 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4j7rn\" (UniqueName: \"kubernetes.io/projected/7933eb8f-b728-4eac-8d90-228e3472cdad-kube-api-access-4j7rn\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:15.957743 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:15.957748 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7933eb8f-b728-4eac-8d90-228e3472cdad-console-config\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:15.957961 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:15.957757 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7933eb8f-b728-4eac-8d90-228e3472cdad-console-oauth-config\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:15.957961 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:15.957765 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7933eb8f-b728-4eac-8d90-228e3472cdad-service-ca\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:15.957961 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:15.957775 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7933eb8f-b728-4eac-8d90-228e3472cdad-console-serving-cert\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:15.957961 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:15.957783 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7933eb8f-b728-4eac-8d90-228e3472cdad-oauth-serving-cert\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:16.603585 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:16.603554 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f64cf968-n7vfq" event={"ID":"7933eb8f-b728-4eac-8d90-228e3472cdad","Type":"ContainerDied","Data":"024e16930c8431fe432853d0c9749a8c9ad4252d9423bc6f3ab6495c380a0a83"} Sep 08 10:58:16.603585 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:16.603585 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f64cf968-n7vfq" Sep 08 10:58:16.604124 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:16.603614 2560 scope.go:117] "RemoveContainer" containerID="9ff1124ac475ebe3347141739c9d90a308f5b26224659b63a5ee0c469cb9e4e0" Sep 08 10:58:16.621914 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:16.621888 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84f64cf968-n7vfq"] Sep 08 10:58:16.627689 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:16.627665 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84f64cf968-n7vfq"] Sep 08 10:58:17.900806 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:17.900758 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7933eb8f-b728-4eac-8d90-228e3472cdad" path="/var/lib/kubelet/pods/7933eb8f-b728-4eac-8d90-228e3472cdad/volumes" Sep 08 10:58:18.090086 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:18.090054 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:58:18.152267 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:18.152147 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:58:24.644431 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:24.644394 2560 generic.go:356] "Generic (PLEG): container finished" podID="49f2f9b9-ad37-448a-bf04-ab22ff6b8fd3" containerID="f8e04fb080c67d58d6fcaa1e378f510dc993fbbe8fe5f6c18c5ace03f8c09111" exitCode=0 Sep 08 10:58:24.644821 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:24.644439 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-z7dwr" event={"ID":"49f2f9b9-ad37-448a-bf04-ab22ff6b8fd3","Type":"ContainerDied","Data":"f8e04fb080c67d58d6fcaa1e378f510dc993fbbe8fe5f6c18c5ace03f8c09111"} Sep 08 10:58:24.644821 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:24.644730 2560 scope.go:117] "RemoveContainer" containerID="f8e04fb080c67d58d6fcaa1e378f510dc993fbbe8fe5f6c18c5ace03f8c09111" Sep 08 10:58:25.650835 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:25.650796 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-z7dwr" event={"ID":"49f2f9b9-ad37-448a-bf04-ab22ff6b8fd3","Type":"ContainerStarted","Data":"95c0d067c885d29692dbd76b30a85dc962e8f374d9fea37ee0c55282e4afef96"} Sep 08 10:58:40.763871 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:40.763836 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:58:40.783612 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:40.783588 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:58:41.741486 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:41.741457 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:58:44.027287 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:44.027239 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:58:54.564863 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:54.564770 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 08 10:58:54.565421 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:54.565137 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerName="alertmanager" containerID="cri-o://10b19b1b1f4d9b4f9d6aa0235f6a5bef3ea8a5fed185b1fff9fd61a8b27d6f79" gracePeriod=120 Sep 08 10:58:54.565421 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:54.565205 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerName="kube-rbac-proxy-metric" containerID="cri-o://83e71536491f3f01507da2e1bd8344320fb3aa13f6ccaa76804d16244928a95e" gracePeriod=120 Sep 08 10:58:54.565421 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:54.565233 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerName="kube-rbac-proxy-web" containerID="cri-o://56f77235c7afc60d31265a31a5f5aaaf2abdcdbeefd97a84546a00ebf0b44e5f" gracePeriod=120 Sep 08 10:58:54.565421 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:54.565275 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerName="config-reloader" containerID="cri-o://bed00f1a2210548ca4753e5967fca939c9d29937e16eafd7dd55a646da58c568" gracePeriod=120 Sep 08 10:58:54.565421 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:54.565275 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerName="kube-rbac-proxy" containerID="cri-o://9f365f6b114fd950bee023b7b38d96fa3a667ef085883ccf0eebb198ec730c52" gracePeriod=120 Sep 08 10:58:54.565678 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:54.565288 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerName="prom-label-proxy" containerID="cri-o://4997fe13d5744715b799cc809445dd3544c7ffe08d07de6ef47ec10c262c30ec" gracePeriod=120 Sep 08 10:58:54.784303 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:54.784267 2560 generic.go:356] "Generic (PLEG): container finished" podID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerID="4997fe13d5744715b799cc809445dd3544c7ffe08d07de6ef47ec10c262c30ec" exitCode=0 Sep 08 10:58:54.784303 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:54.784294 2560 generic.go:356] "Generic (PLEG): container finished" podID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerID="83e71536491f3f01507da2e1bd8344320fb3aa13f6ccaa76804d16244928a95e" exitCode=0 Sep 08 10:58:54.784303 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:54.784301 2560 generic.go:356] "Generic (PLEG): container finished" podID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerID="9f365f6b114fd950bee023b7b38d96fa3a667ef085883ccf0eebb198ec730c52" exitCode=0 Sep 08 10:58:54.784303 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:54.784307 2560 generic.go:356] "Generic (PLEG): container finished" podID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerID="bed00f1a2210548ca4753e5967fca939c9d29937e16eafd7dd55a646da58c568" exitCode=0 Sep 08 10:58:54.784303 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:54.784312 2560 generic.go:356] "Generic (PLEG): container finished" podID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerID="10b19b1b1f4d9b4f9d6aa0235f6a5bef3ea8a5fed185b1fff9fd61a8b27d6f79" exitCode=0 Sep 08 10:58:54.784656 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:54.784337 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6fa28949-a2f6-424b-9d5f-8c736ec119a3","Type":"ContainerDied","Data":"4997fe13d5744715b799cc809445dd3544c7ffe08d07de6ef47ec10c262c30ec"} Sep 08 10:58:54.784656 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:54.784415 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6fa28949-a2f6-424b-9d5f-8c736ec119a3","Type":"ContainerDied","Data":"83e71536491f3f01507da2e1bd8344320fb3aa13f6ccaa76804d16244928a95e"} Sep 08 10:58:54.784656 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:54.784456 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6fa28949-a2f6-424b-9d5f-8c736ec119a3","Type":"ContainerDied","Data":"9f365f6b114fd950bee023b7b38d96fa3a667ef085883ccf0eebb198ec730c52"} Sep 08 10:58:54.784656 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:54.784492 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6fa28949-a2f6-424b-9d5f-8c736ec119a3","Type":"ContainerDied","Data":"bed00f1a2210548ca4753e5967fca939c9d29937e16eafd7dd55a646da58c568"} Sep 08 10:58:54.784656 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:54.784530 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6fa28949-a2f6-424b-9d5f-8c736ec119a3","Type":"ContainerDied","Data":"10b19b1b1f4d9b4f9d6aa0235f6a5bef3ea8a5fed185b1fff9fd61a8b27d6f79"} Sep 08 10:58:55.367757 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.367720 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:58:55.473276 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.473229 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:58:55.793188 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.793140 2560 generic.go:356] "Generic (PLEG): container finished" podID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerID="56f77235c7afc60d31265a31a5f5aaaf2abdcdbeefd97a84546a00ebf0b44e5f" exitCode=0 Sep 08 10:58:55.793465 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.793204 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6fa28949-a2f6-424b-9d5f-8c736ec119a3","Type":"ContainerDied","Data":"56f77235c7afc60d31265a31a5f5aaaf2abdcdbeefd97a84546a00ebf0b44e5f"} Sep 08 10:58:55.806699 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.806680 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:55.925721 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.925653 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-web-config\") pod \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " Sep 08 10:58:55.925721 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.925706 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fa28949-a2f6-424b-9d5f-8c736ec119a3-metrics-client-ca\") pod \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " Sep 08 10:58:55.925915 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.925737 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-secret-alertmanager-kube-rbac-proxy\") pod \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " Sep 08 10:58:55.925915 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.925760 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-cluster-tls-config\") pod \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " Sep 08 10:58:55.925915 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.925787 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fa28949-a2f6-424b-9d5f-8c736ec119a3-alertmanager-trusted-ca-bundle\") pod \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " Sep 08 10:58:55.925915 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.925805 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqjfw\" (UniqueName: \"kubernetes.io/projected/6fa28949-a2f6-424b-9d5f-8c736ec119a3-kube-api-access-kqjfw\") pod \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " Sep 08 10:58:55.925915 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.925831 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-config-volume\") pod \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " Sep 08 10:58:55.925915 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.925857 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6fa28949-a2f6-424b-9d5f-8c736ec119a3-alertmanager-main-db\") pod \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " Sep 08 10:58:55.925915 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.925891 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " Sep 08 10:58:55.926292 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.925926 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-secret-alertmanager-kube-rbac-proxy-web\") pod \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " Sep 08 10:58:55.926292 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.925953 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-secret-alertmanager-main-tls\") pod \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " Sep 08 10:58:55.926292 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.925980 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6fa28949-a2f6-424b-9d5f-8c736ec119a3-tls-assets\") pod \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " Sep 08 10:58:55.926292 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.926025 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6fa28949-a2f6-424b-9d5f-8c736ec119a3-config-out\") pod \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\" (UID: \"6fa28949-a2f6-424b-9d5f-8c736ec119a3\") " Sep 08 10:58:55.926292 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.926190 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fa28949-a2f6-424b-9d5f-8c736ec119a3-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "6fa28949-a2f6-424b-9d5f-8c736ec119a3" (UID: "6fa28949-a2f6-424b-9d5f-8c736ec119a3"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 10:58:55.926292 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.926207 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fa28949-a2f6-424b-9d5f-8c736ec119a3-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "6fa28949-a2f6-424b-9d5f-8c736ec119a3" (UID: "6fa28949-a2f6-424b-9d5f-8c736ec119a3"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 10:58:55.926292 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.926219 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fa28949-a2f6-424b-9d5f-8c736ec119a3-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "6fa28949-a2f6-424b-9d5f-8c736ec119a3" (UID: "6fa28949-a2f6-424b-9d5f-8c736ec119a3"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 10:58:55.926640 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.926353 2560 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fa28949-a2f6-424b-9d5f-8c736ec119a3-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:55.926640 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.926372 2560 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6fa28949-a2f6-424b-9d5f-8c736ec119a3-alertmanager-main-db\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:55.926640 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.926387 2560 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fa28949-a2f6-424b-9d5f-8c736ec119a3-metrics-client-ca\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:55.929220 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.929190 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "6fa28949-a2f6-424b-9d5f-8c736ec119a3" (UID: "6fa28949-a2f6-424b-9d5f-8c736ec119a3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:58:55.929220 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.929191 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fa28949-a2f6-424b-9d5f-8c736ec119a3-config-out" (OuterVolumeSpecName: "config-out") pod "6fa28949-a2f6-424b-9d5f-8c736ec119a3" (UID: "6fa28949-a2f6-424b-9d5f-8c736ec119a3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 10:58:55.929619 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.929248 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fa28949-a2f6-424b-9d5f-8c736ec119a3-kube-api-access-kqjfw" (OuterVolumeSpecName: "kube-api-access-kqjfw") pod "6fa28949-a2f6-424b-9d5f-8c736ec119a3" (UID: "6fa28949-a2f6-424b-9d5f-8c736ec119a3"). InnerVolumeSpecName "kube-api-access-kqjfw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 10:58:55.929619 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.929539 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-config-volume" (OuterVolumeSpecName: "config-volume") pod "6fa28949-a2f6-424b-9d5f-8c736ec119a3" (UID: "6fa28949-a2f6-424b-9d5f-8c736ec119a3"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:58:55.929735 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.929643 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "6fa28949-a2f6-424b-9d5f-8c736ec119a3" (UID: "6fa28949-a2f6-424b-9d5f-8c736ec119a3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:58:55.929794 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.929741 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "6fa28949-a2f6-424b-9d5f-8c736ec119a3" (UID: "6fa28949-a2f6-424b-9d5f-8c736ec119a3"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:58:55.930130 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.930108 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "6fa28949-a2f6-424b-9d5f-8c736ec119a3" (UID: "6fa28949-a2f6-424b-9d5f-8c736ec119a3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:58:55.930951 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.930932 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fa28949-a2f6-424b-9d5f-8c736ec119a3-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6fa28949-a2f6-424b-9d5f-8c736ec119a3" (UID: "6fa28949-a2f6-424b-9d5f-8c736ec119a3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 10:58:55.933756 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.933730 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "6fa28949-a2f6-424b-9d5f-8c736ec119a3" (UID: "6fa28949-a2f6-424b-9d5f-8c736ec119a3"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:58:55.941216 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:55.941187 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-web-config" (OuterVolumeSpecName: "web-config") pod "6fa28949-a2f6-424b-9d5f-8c736ec119a3" (UID: "6fa28949-a2f6-424b-9d5f-8c736ec119a3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:58:56.027846 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.027794 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:56.027846 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.027837 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:56.027846 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.027847 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-secret-alertmanager-main-tls\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:56.027846 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.027858 2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6fa28949-a2f6-424b-9d5f-8c736ec119a3-tls-assets\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:56.027846 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.027866 2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6fa28949-a2f6-424b-9d5f-8c736ec119a3-config-out\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:56.028140 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.027874 2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-web-config\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:56.028140 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.027881 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:56.028140 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.027889 2560 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-cluster-tls-config\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:56.028140 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.027897 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqjfw\" (UniqueName: \"kubernetes.io/projected/6fa28949-a2f6-424b-9d5f-8c736ec119a3-kube-api-access-kqjfw\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:56.028140 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.027907 2560 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6fa28949-a2f6-424b-9d5f-8c736ec119a3-config-volume\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:56.800571 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.800539 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6fa28949-a2f6-424b-9d5f-8c736ec119a3","Type":"ContainerDied","Data":"8ce62569172a57a03f389692fed621da870a12bb6d17ac1018ebb2ade35676c9"} Sep 08 10:58:56.800937 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.800577 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:56.800937 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.800616 2560 scope.go:117] "RemoveContainer" containerID="4997fe13d5744715b799cc809445dd3544c7ffe08d07de6ef47ec10c262c30ec" Sep 08 10:58:56.809878 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.809861 2560 scope.go:117] "RemoveContainer" containerID="83e71536491f3f01507da2e1bd8344320fb3aa13f6ccaa76804d16244928a95e" Sep 08 10:58:56.817958 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.817929 2560 scope.go:117] "RemoveContainer" containerID="9f365f6b114fd950bee023b7b38d96fa3a667ef085883ccf0eebb198ec730c52" Sep 08 10:58:56.825105 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.825088 2560 scope.go:117] "RemoveContainer" containerID="56f77235c7afc60d31265a31a5f5aaaf2abdcdbeefd97a84546a00ebf0b44e5f" Sep 08 10:58:56.837011 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.833504 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 08 10:58:56.837011 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.836379 2560 scope.go:117] "RemoveContainer" containerID="bed00f1a2210548ca4753e5967fca939c9d29937e16eafd7dd55a646da58c568" Sep 08 10:58:56.838373 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.838351 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 08 10:58:56.845871 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.845850 2560 scope.go:117] "RemoveContainer" containerID="10b19b1b1f4d9b4f9d6aa0235f6a5bef3ea8a5fed185b1fff9fd61a8b27d6f79" Sep 08 10:58:56.854008 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.853985 2560 scope.go:117] "RemoveContainer" containerID="b4a1bb28f45653456316023186b4892398f31cb3740dfb31458eade6d63805ab" Sep 08 10:58:56.877498 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.877468 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 08 10:58:56.877834 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.877821 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerName="alertmanager" Sep 08 10:58:56.877895 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.877836 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerName="alertmanager" Sep 08 10:58:56.877895 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.877852 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerName="init-config-reloader" Sep 08 10:58:56.877895 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.877857 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerName="init-config-reloader" Sep 08 10:58:56.877895 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.877869 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerName="kube-rbac-proxy-metric" Sep 08 10:58:56.877895 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.877875 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerName="kube-rbac-proxy-metric" Sep 08 10:58:56.877895 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.877880 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerName="prom-label-proxy" Sep 08 10:58:56.877895 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.877885 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerName="prom-label-proxy" Sep 08 10:58:56.877895 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.877892 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerName="config-reloader" Sep 08 10:58:56.877895 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.877897 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerName="config-reloader" Sep 08 10:58:56.878201 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.877904 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerName="kube-rbac-proxy" Sep 08 10:58:56.878201 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.877909 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerName="kube-rbac-proxy" Sep 08 10:58:56.878201 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.877917 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerName="kube-rbac-proxy-web" Sep 08 10:58:56.878201 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.877922 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerName="kube-rbac-proxy-web" Sep 08 10:58:56.878201 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.877929 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7933eb8f-b728-4eac-8d90-228e3472cdad" containerName="console" Sep 08 10:58:56.878201 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.877933 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7933eb8f-b728-4eac-8d90-228e3472cdad" containerName="console" Sep 08 10:58:56.878201 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.877984 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerName="config-reloader" Sep 08 10:58:56.878201 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.877990 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerName="alertmanager" Sep 08 10:58:56.878201 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.877997 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerName="kube-rbac-proxy-metric" Sep 08 10:58:56.878201 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.878003 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerName="kube-rbac-proxy" Sep 08 10:58:56.878201 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.878008 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7933eb8f-b728-4eac-8d90-228e3472cdad" containerName="console" Sep 08 10:58:56.878201 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.878014 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerName="prom-label-proxy" Sep 08 10:58:56.878201 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.878019 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" containerName="kube-rbac-proxy-web" Sep 08 10:58:56.883487 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.883468 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:56.886977 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.886959 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 08 10:58:56.887507 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.887484 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 08 10:58:56.887629 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.887484 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 08 10:58:56.887629 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.887495 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 08 10:58:56.887629 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.887616 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qzfxp\"" Sep 08 10:58:56.887793 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.887719 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 08 10:58:56.887989 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.887972 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 08 10:58:56.888038 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.888013 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 08 10:58:56.888207 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.888195 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 08 10:58:56.896066 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.896049 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 08 10:58:56.911259 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:56.911181 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 08 10:58:57.037000 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.036966 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/18e278cb-1945-4ba1-a2ca-9de9e0051def-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.037222 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.037029 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18e278cb-1945-4ba1-a2ca-9de9e0051def-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.037222 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.037113 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18e278cb-1945-4ba1-a2ca-9de9e0051def-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.037222 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.037146 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18e278cb-1945-4ba1-a2ca-9de9e0051def-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.037222 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.037206 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/18e278cb-1945-4ba1-a2ca-9de9e0051def-config-volume\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.037385 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.037227 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18e278cb-1945-4ba1-a2ca-9de9e0051def-config-out\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.037385 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.037243 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18e278cb-1945-4ba1-a2ca-9de9e0051def-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.037385 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.037300 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/18e278cb-1945-4ba1-a2ca-9de9e0051def-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.037385 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.037336 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tknss\" (UniqueName: \"kubernetes.io/projected/18e278cb-1945-4ba1-a2ca-9de9e0051def-kube-api-access-tknss\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.037385 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.037358 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18e278cb-1945-4ba1-a2ca-9de9e0051def-web-config\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.037385 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.037377 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18e278cb-1945-4ba1-a2ca-9de9e0051def-tls-assets\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.037660 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.037395 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/18e278cb-1945-4ba1-a2ca-9de9e0051def-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.037660 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.037460 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/18e278cb-1945-4ba1-a2ca-9de9e0051def-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.138412 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.138374 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18e278cb-1945-4ba1-a2ca-9de9e0051def-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.138412 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.138419 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18e278cb-1945-4ba1-a2ca-9de9e0051def-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.138674 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.138436 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18e278cb-1945-4ba1-a2ca-9de9e0051def-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.138674 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.138457 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/18e278cb-1945-4ba1-a2ca-9de9e0051def-config-volume\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.138674 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.138581 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18e278cb-1945-4ba1-a2ca-9de9e0051def-config-out\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.138674 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.138613 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18e278cb-1945-4ba1-a2ca-9de9e0051def-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.138674 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.138642 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/18e278cb-1945-4ba1-a2ca-9de9e0051def-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.138930 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.138771 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tknss\" (UniqueName: \"kubernetes.io/projected/18e278cb-1945-4ba1-a2ca-9de9e0051def-kube-api-access-tknss\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.138930 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.138825 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18e278cb-1945-4ba1-a2ca-9de9e0051def-web-config\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.138930 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.138862 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18e278cb-1945-4ba1-a2ca-9de9e0051def-tls-assets\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.138930 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.138895 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/18e278cb-1945-4ba1-a2ca-9de9e0051def-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.139145 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.138931 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/18e278cb-1945-4ba1-a2ca-9de9e0051def-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.139145 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.138990 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/18e278cb-1945-4ba1-a2ca-9de9e0051def-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.139739 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.139403 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18e278cb-1945-4ba1-a2ca-9de9e0051def-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.139739 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.139688 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18e278cb-1945-4ba1-a2ca-9de9e0051def-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.141045 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.140970 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/18e278cb-1945-4ba1-a2ca-9de9e0051def-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.141917 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.141523 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18e278cb-1945-4ba1-a2ca-9de9e0051def-config-out\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.141917 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.141822 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/18e278cb-1945-4ba1-a2ca-9de9e0051def-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.142071 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.141949 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/18e278cb-1945-4ba1-a2ca-9de9e0051def-config-volume\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.142426 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.142400 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18e278cb-1945-4ba1-a2ca-9de9e0051def-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.142594 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.142573 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/18e278cb-1945-4ba1-a2ca-9de9e0051def-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.142754 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.142738 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/18e278cb-1945-4ba1-a2ca-9de9e0051def-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.142817 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.142736 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18e278cb-1945-4ba1-a2ca-9de9e0051def-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.143284 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.143267 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18e278cb-1945-4ba1-a2ca-9de9e0051def-tls-assets\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.143487 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.143471 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18e278cb-1945-4ba1-a2ca-9de9e0051def-web-config\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.148948 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.148926 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tknss\" (UniqueName: \"kubernetes.io/projected/18e278cb-1945-4ba1-a2ca-9de9e0051def-kube-api-access-tknss\") pod \"alertmanager-main-0\" (UID: \"18e278cb-1945-4ba1-a2ca-9de9e0051def\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.194134 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.194044 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 08 10:58:57.479437 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.479411 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 08 10:58:57.481216 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:58:57.481188 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18e278cb_1945_4ba1_a2ca_9de9e0051def.slice/crio-6f8f9fc6dcb67a8df1aa2b3f2269f391a0bc50092bb221808b5579c1fcd71b9c WatchSource:0}: Error finding container 6f8f9fc6dcb67a8df1aa2b3f2269f391a0bc50092bb221808b5579c1fcd71b9c: Status 404 returned error can't find the container with id 6f8f9fc6dcb67a8df1aa2b3f2269f391a0bc50092bb221808b5579c1fcd71b9c Sep 08 10:58:57.806281 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.806248 2560 generic.go:356] "Generic (PLEG): container finished" podID="18e278cb-1945-4ba1-a2ca-9de9e0051def" containerID="17ac20dade894b205744cd8bab1edd22b2d1eb0ce71bdec06753545092e669e7" exitCode=0 Sep 08 10:58:57.806659 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.806338 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18e278cb-1945-4ba1-a2ca-9de9e0051def","Type":"ContainerDied","Data":"17ac20dade894b205744cd8bab1edd22b2d1eb0ce71bdec06753545092e669e7"} Sep 08 10:58:57.806659 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.806413 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18e278cb-1945-4ba1-a2ca-9de9e0051def","Type":"ContainerStarted","Data":"6f8f9fc6dcb67a8df1aa2b3f2269f391a0bc50092bb221808b5579c1fcd71b9c"} Sep 08 10:58:57.900978 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:57.900944 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fa28949-a2f6-424b-9d5f-8c736ec119a3" path="/var/lib/kubelet/pods/6fa28949-a2f6-424b-9d5f-8c736ec119a3/volumes" Sep 08 10:58:58.820058 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:58.820025 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18e278cb-1945-4ba1-a2ca-9de9e0051def","Type":"ContainerStarted","Data":"e1faec3fa2b188076471b42c87152634a14e8efc16c0daeba6f74679be03f4ce"} Sep 08 10:58:58.820466 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:58.820111 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18e278cb-1945-4ba1-a2ca-9de9e0051def","Type":"ContainerStarted","Data":"a16f76559b8d0b742c58fd882247bd58ee08365cd9eab44bde3732d4a31bff76"} Sep 08 10:58:58.820466 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:58.820137 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18e278cb-1945-4ba1-a2ca-9de9e0051def","Type":"ContainerStarted","Data":"e1f30afb75d0efad05246cdd89c7e543ed1ff27c353d5e8aadb542fe1922e279"} Sep 08 10:58:58.820466 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:58.820178 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18e278cb-1945-4ba1-a2ca-9de9e0051def","Type":"ContainerStarted","Data":"09b210e4e9591c5d7fd9ada346350ab74dafa80823bf1cb77713e91111912d02"} Sep 08 10:58:58.820466 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:58.820205 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18e278cb-1945-4ba1-a2ca-9de9e0051def","Type":"ContainerStarted","Data":"5fa65d568161d2a887cce9bf46f0cb501a5fa4bf4e8b72d7c86a3967a05283ca"} Sep 08 10:58:58.820466 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:58.820228 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18e278cb-1945-4ba1-a2ca-9de9e0051def","Type":"ContainerStarted","Data":"7786ae7e2dc8987372bca86c68027e9699b0bc24dea18377fd896127f93426da"} Sep 08 10:58:58.853136 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:58.853077 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.837232142 podStartE2EDuration="2.853057179s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.825037ms" isStatefulPod=false podCreationTimestamp="2026-09-08 10:58:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:58:58.850938228 +0000 UTC m=+179.483533707" watchObservedRunningTime="2026-09-08 10:58:58.853057179 +0000 UTC m=+179.485652657" Sep 08 10:58:58.933266 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:58.933232 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 08 10:58:58.933594 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:58.933560 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerName="prometheus" containerID="cri-o://70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea" gracePeriod=600 Sep 08 10:58:58.933693 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:58.933588 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab" gracePeriod=600 Sep 08 10:58:58.933693 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:58.933615 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerName="kube-rbac-proxy" containerID="cri-o://7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb" gracePeriod=600 Sep 08 10:58:58.933804 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:58.933600 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerName="config-reloader" containerID="cri-o://feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e" gracePeriod=600 Sep 08 10:58:58.933804 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:58.933583 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerName="kube-rbac-proxy-web" containerID="cri-o://df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61" gracePeriod=600 Sep 08 10:58:58.933910 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:58.933802 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerName="thanos-sidecar" containerID="cri-o://c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e" gracePeriod=600 Sep 08 10:58:59.180542 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.180516 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:58:59.361216 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.361103 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-prometheus-k8s-rulefiles-0\") pod \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " Sep 08 10:58:59.361216 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.361143 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-prometheus-k8s-tls\") pod \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " Sep 08 10:58:59.361216 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.361189 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grtzj\" (UniqueName: \"kubernetes.io/projected/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-kube-api-access-grtzj\") pod \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " Sep 08 10:58:59.361216 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.361211 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-metrics-client-certs\") pod \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " Sep 08 10:58:59.361579 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.361237 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-configmap-serving-certs-ca-bundle\") pod \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " Sep 08 10:58:59.361579 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.361269 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " Sep 08 10:58:59.361579 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.361291 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-grpc-tls\") pod \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " Sep 08 10:58:59.361579 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.361319 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-web-config\") pod \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " Sep 08 10:58:59.361579 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.361348 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-configmap-metrics-client-ca\") pod \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " Sep 08 10:58:59.361579 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.361377 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-kube-rbac-proxy\") pod \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " Sep 08 10:58:59.361579 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.361425 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-thanos-prometheus-http-client-file\") pod \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " Sep 08 10:58:59.361579 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.361453 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-prometheus-trusted-ca-bundle\") pod \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " Sep 08 10:58:59.361579 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.361477 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " Sep 08 10:58:59.361579 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.361524 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-configmap-kubelet-serving-ca-bundle\") pod \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " Sep 08 10:58:59.361579 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.361584 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-config\") pod \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " Sep 08 10:58:59.362323 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.361612 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-tls-assets\") pod \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " Sep 08 10:58:59.362323 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.361636 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-prometheus-k8s-rulefiles-1\") pod \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " Sep 08 10:58:59.362323 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.361663 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-config-out\") pod \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " Sep 08 10:58:59.362323 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.361685 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-prometheus-k8s-rulefiles-2\") pod \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " Sep 08 10:58:59.362323 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.361715 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-prometheus-k8s-db\") pod \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\" (UID: \"f61e5d61-60ab-4fb6-8227-8f14f8680ca1\") " Sep 08 10:58:59.362323 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.362022 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "f61e5d61-60ab-4fb6-8227-8f14f8680ca1" (UID: "f61e5d61-60ab-4fb6-8227-8f14f8680ca1"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 10:58:59.362812 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.362774 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "f61e5d61-60ab-4fb6-8227-8f14f8680ca1" (UID: "f61e5d61-60ab-4fb6-8227-8f14f8680ca1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 10:58:59.363455 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.363425 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "f61e5d61-60ab-4fb6-8227-8f14f8680ca1" (UID: "f61e5d61-60ab-4fb6-8227-8f14f8680ca1"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 10:58:59.363553 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.363532 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "f61e5d61-60ab-4fb6-8227-8f14f8680ca1" (UID: "f61e5d61-60ab-4fb6-8227-8f14f8680ca1"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 10:58:59.363698 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.363658 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "f61e5d61-60ab-4fb6-8227-8f14f8680ca1" (UID: "f61e5d61-60ab-4fb6-8227-8f14f8680ca1"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 10:58:59.363923 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.363898 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "f61e5d61-60ab-4fb6-8227-8f14f8680ca1" (UID: "f61e5d61-60ab-4fb6-8227-8f14f8680ca1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 10:58:59.363996 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.363940 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "f61e5d61-60ab-4fb6-8227-8f14f8680ca1" (UID: "f61e5d61-60ab-4fb6-8227-8f14f8680ca1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 10:58:59.364054 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.364015 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "f61e5d61-60ab-4fb6-8227-8f14f8680ca1" (UID: "f61e5d61-60ab-4fb6-8227-8f14f8680ca1"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 10:58:59.364054 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.364028 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-kube-api-access-grtzj" (OuterVolumeSpecName: "kube-api-access-grtzj") pod "f61e5d61-60ab-4fb6-8227-8f14f8680ca1" (UID: "f61e5d61-60ab-4fb6-8227-8f14f8680ca1"). InnerVolumeSpecName "kube-api-access-grtzj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 10:58:59.364292 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.364085 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "f61e5d61-60ab-4fb6-8227-8f14f8680ca1" (UID: "f61e5d61-60ab-4fb6-8227-8f14f8680ca1"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:58:59.364292 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.364104 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "f61e5d61-60ab-4fb6-8227-8f14f8680ca1" (UID: "f61e5d61-60ab-4fb6-8227-8f14f8680ca1"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:58:59.365101 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.365064 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "f61e5d61-60ab-4fb6-8227-8f14f8680ca1" (UID: "f61e5d61-60ab-4fb6-8227-8f14f8680ca1"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:58:59.366056 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.366013 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "f61e5d61-60ab-4fb6-8227-8f14f8680ca1" (UID: "f61e5d61-60ab-4fb6-8227-8f14f8680ca1"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:58:59.366056 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.366037 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "f61e5d61-60ab-4fb6-8227-8f14f8680ca1" (UID: "f61e5d61-60ab-4fb6-8227-8f14f8680ca1"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:58:59.366315 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.366258 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "f61e5d61-60ab-4fb6-8227-8f14f8680ca1" (UID: "f61e5d61-60ab-4fb6-8227-8f14f8680ca1"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:58:59.366315 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.366300 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-config-out" (OuterVolumeSpecName: "config-out") pod "f61e5d61-60ab-4fb6-8227-8f14f8680ca1" (UID: "f61e5d61-60ab-4fb6-8227-8f14f8680ca1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 10:58:59.366410 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.366362 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "f61e5d61-60ab-4fb6-8227-8f14f8680ca1" (UID: "f61e5d61-60ab-4fb6-8227-8f14f8680ca1"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:58:59.366455 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.366437 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-config" (OuterVolumeSpecName: "config") pod "f61e5d61-60ab-4fb6-8227-8f14f8680ca1" (UID: "f61e5d61-60ab-4fb6-8227-8f14f8680ca1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:58:59.366542 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.366529 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f61e5d61-60ab-4fb6-8227-8f14f8680ca1" (UID: "f61e5d61-60ab-4fb6-8227-8f14f8680ca1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 10:58:59.378284 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.378260 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-web-config" (OuterVolumeSpecName: "web-config") pod "f61e5d61-60ab-4fb6-8227-8f14f8680ca1" (UID: "f61e5d61-60ab-4fb6-8227-8f14f8680ca1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:58:59.462371 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.462338 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:59.462371 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.462365 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:59.462371 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.462374 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grtzj\" (UniqueName: \"kubernetes.io/projected/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-kube-api-access-grtzj\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:59.462580 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.462383 2560 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-metrics-client-certs\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:59.462580 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.462391 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:59.462580 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.462401 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:59.462580 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.462410 2560 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-grpc-tls\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:59.462580 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.462419 2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-web-config\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:59.462580 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.462427 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-configmap-metrics-client-ca\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:59.462580 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.462435 2560 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-kube-rbac-proxy\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:59.462580 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.462443 2560 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:59.462580 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.462451 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:59.462580 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.462459 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:59.462580 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.462468 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:59.462580 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.462476 2560 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-config\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:59.462580 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.462483 2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-tls-assets\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:59.462580 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.462491 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:59.462580 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.462499 2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-config-out\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:59.462580 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.462506 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:59.462580 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.462514 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f61e5d61-60ab-4fb6-8227-8f14f8680ca1-prometheus-k8s-db\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 10:58:59.826981 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.826946 2560 generic.go:356] "Generic (PLEG): container finished" podID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerID="c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab" exitCode=0 Sep 08 10:58:59.826981 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.826970 2560 generic.go:356] "Generic (PLEG): container finished" podID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerID="7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb" exitCode=0 Sep 08 10:58:59.826981 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.826977 2560 generic.go:356] "Generic (PLEG): container finished" podID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerID="df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61" exitCode=0 Sep 08 10:58:59.826981 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.826982 2560 generic.go:356] "Generic (PLEG): container finished" podID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerID="c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e" exitCode=0 Sep 08 10:58:59.826981 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.826988 2560 generic.go:356] "Generic (PLEG): container finished" podID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerID="feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e" exitCode=0 Sep 08 10:58:59.827512 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.826993 2560 generic.go:356] "Generic (PLEG): container finished" podID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerID="70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea" exitCode=0 Sep 08 10:58:59.827512 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.827023 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:58:59.827512 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.827021 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f61e5d61-60ab-4fb6-8227-8f14f8680ca1","Type":"ContainerDied","Data":"c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab"} Sep 08 10:58:59.827512 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.827109 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f61e5d61-60ab-4fb6-8227-8f14f8680ca1","Type":"ContainerDied","Data":"7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb"} Sep 08 10:58:59.827512 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.827140 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f61e5d61-60ab-4fb6-8227-8f14f8680ca1","Type":"ContainerDied","Data":"df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61"} Sep 08 10:58:59.827512 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.827181 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f61e5d61-60ab-4fb6-8227-8f14f8680ca1","Type":"ContainerDied","Data":"c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e"} Sep 08 10:58:59.827512 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.827194 2560 scope.go:117] "RemoveContainer" containerID="c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab" Sep 08 10:58:59.827512 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.827210 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f61e5d61-60ab-4fb6-8227-8f14f8680ca1","Type":"ContainerDied","Data":"feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e"} Sep 08 10:58:59.827512 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.827234 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f61e5d61-60ab-4fb6-8227-8f14f8680ca1","Type":"ContainerDied","Data":"70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea"} Sep 08 10:58:59.827512 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.827257 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f61e5d61-60ab-4fb6-8227-8f14f8680ca1","Type":"ContainerDied","Data":"96b59c0c98832ff5940fab5bde60cc69a6bba8b42bc99f08973565a415d50061"} Sep 08 10:58:59.835193 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.835154 2560 scope.go:117] "RemoveContainer" containerID="7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb" Sep 08 10:58:59.842050 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.842035 2560 scope.go:117] "RemoveContainer" containerID="df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61" Sep 08 10:58:59.848781 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.848761 2560 scope.go:117] "RemoveContainer" containerID="c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e" Sep 08 10:58:59.851638 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.851606 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 08 10:58:59.855966 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.855941 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 08 10:58:59.856415 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.856402 2560 scope.go:117] "RemoveContainer" containerID="feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e" Sep 08 10:58:59.863555 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.863541 2560 scope.go:117] "RemoveContainer" containerID="70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea" Sep 08 10:58:59.870634 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.870617 2560 scope.go:117] "RemoveContainer" containerID="a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2" Sep 08 10:58:59.877990 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.877972 2560 scope.go:117] "RemoveContainer" containerID="c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab" Sep 08 10:58:59.878293 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:58:59.878273 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab\": container with ID starting with c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab not found: ID does not exist" containerID="c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab" Sep 08 10:58:59.878371 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.878305 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab"} err="failed to get container status \"c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab\": rpc error: code = NotFound desc = could not find container \"c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab\": container with ID starting with c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab not found: ID does not exist" Sep 08 10:58:59.878371 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.878352 2560 scope.go:117] "RemoveContainer" containerID="7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb" Sep 08 10:58:59.878619 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:58:59.878602 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb\": container with ID starting with 7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb not found: ID does not exist" containerID="7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb" Sep 08 10:58:59.878663 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.878625 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb"} err="failed to get container status \"7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb\": rpc error: code = NotFound desc = could not find container \"7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb\": container with ID starting with 7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb not found: ID does not exist" Sep 08 10:58:59.878663 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.878640 2560 scope.go:117] "RemoveContainer" containerID="df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61" Sep 08 10:58:59.878881 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:58:59.878865 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61\": container with ID starting with df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61 not found: ID does not exist" containerID="df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61" Sep 08 10:58:59.878940 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.878888 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61"} err="failed to get container status \"df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61\": rpc error: code = NotFound desc = could not find container \"df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61\": container with ID starting with df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61 not found: ID does not exist" Sep 08 10:58:59.878940 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.878908 2560 scope.go:117] "RemoveContainer" containerID="c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e" Sep 08 10:58:59.879134 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:58:59.879114 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e\": container with ID starting with c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e not found: ID does not exist" containerID="c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e" Sep 08 10:58:59.879274 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.879139 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e"} err="failed to get container status \"c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e\": rpc error: code = NotFound desc = could not find container \"c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e\": container with ID starting with c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e not found: ID does not exist" Sep 08 10:58:59.879274 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.879159 2560 scope.go:117] "RemoveContainer" containerID="feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e" Sep 08 10:58:59.879498 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:58:59.879483 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e\": container with ID starting with feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e not found: ID does not exist" containerID="feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e" Sep 08 10:58:59.879533 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.879511 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e"} err="failed to get container status \"feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e\": rpc error: code = NotFound desc = could not find container \"feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e\": container with ID starting with feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e not found: ID does not exist" Sep 08 10:58:59.879533 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.879525 2560 scope.go:117] "RemoveContainer" containerID="70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea" Sep 08 10:58:59.879770 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:58:59.879753 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea\": container with ID starting with 70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea not found: ID does not exist" containerID="70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea" Sep 08 10:58:59.879813 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.879775 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea"} err="failed to get container status \"70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea\": rpc error: code = NotFound desc = could not find container \"70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea\": container with ID starting with 70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea not found: ID does not exist" Sep 08 10:58:59.879813 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.879790 2560 scope.go:117] "RemoveContainer" containerID="a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2" Sep 08 10:58:59.880013 ip-10-0-139-80 kubenswrapper[2560]: E0908 10:58:59.879997 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2\": container with ID starting with a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2 not found: ID does not exist" containerID="a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2" Sep 08 10:58:59.880077 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.880019 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2"} err="failed to get container status \"a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2\": rpc error: code = NotFound desc = could not find container \"a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2\": container with ID starting with a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2 not found: ID does not exist" Sep 08 10:58:59.880077 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.880038 2560 scope.go:117] "RemoveContainer" containerID="c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab" Sep 08 10:58:59.880316 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.880295 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab"} err="failed to get container status \"c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab\": rpc error: code = NotFound desc = could not find container \"c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab\": container with ID starting with c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab not found: ID does not exist" Sep 08 10:58:59.880359 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.880317 2560 scope.go:117] "RemoveContainer" containerID="7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb" Sep 08 10:58:59.880554 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.880534 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb"} err="failed to get container status \"7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb\": rpc error: code = NotFound desc = could not find container \"7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb\": container with ID starting with 7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb not found: ID does not exist" Sep 08 10:58:59.880554 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.880552 2560 scope.go:117] "RemoveContainer" containerID="df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61" Sep 08 10:58:59.880819 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.880800 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61"} err="failed to get container status \"df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61\": rpc error: code = NotFound desc = could not find container \"df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61\": container with ID starting with df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61 not found: ID does not exist" Sep 08 10:58:59.880865 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.880823 2560 scope.go:117] "RemoveContainer" containerID="c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e" Sep 08 10:58:59.881180 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.881129 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e"} err="failed to get container status \"c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e\": rpc error: code = NotFound desc = could not find container \"c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e\": container with ID starting with c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e not found: ID does not exist" Sep 08 10:58:59.881275 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.881192 2560 scope.go:117] "RemoveContainer" containerID="feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e" Sep 08 10:58:59.881542 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.881505 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e"} err="failed to get container status \"feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e\": rpc error: code = NotFound desc = could not find container \"feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e\": container with ID starting with feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e not found: ID does not exist" Sep 08 10:58:59.881622 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.881544 2560 scope.go:117] "RemoveContainer" containerID="70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea" Sep 08 10:58:59.881899 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.881854 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea"} err="failed to get container status \"70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea\": rpc error: code = NotFound desc = could not find container \"70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea\": container with ID starting with 70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea not found: ID does not exist" Sep 08 10:58:59.881899 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.881878 2560 scope.go:117] "RemoveContainer" containerID="a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2" Sep 08 10:58:59.882208 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.882157 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2"} err="failed to get container status \"a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2\": rpc error: code = NotFound desc = could not find container \"a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2\": container with ID starting with a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2 not found: ID does not exist" Sep 08 10:58:59.882280 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.882212 2560 scope.go:117] "RemoveContainer" containerID="c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab" Sep 08 10:58:59.882474 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.882455 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab"} err="failed to get container status \"c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab\": rpc error: code = NotFound desc = could not find container \"c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab\": container with ID starting with c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab not found: ID does not exist" Sep 08 10:58:59.882556 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.882476 2560 scope.go:117] "RemoveContainer" containerID="7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb" Sep 08 10:58:59.882738 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.882719 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb"} err="failed to get container status \"7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb\": rpc error: code = NotFound desc = could not find container \"7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb\": container with ID starting with 7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb not found: ID does not exist" Sep 08 10:58:59.882809 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.882741 2560 scope.go:117] "RemoveContainer" containerID="df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61" Sep 08 10:58:59.882976 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.882952 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61"} err="failed to get container status \"df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61\": rpc error: code = NotFound desc = could not find container \"df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61\": container with ID starting with df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61 not found: ID does not exist" Sep 08 10:58:59.883015 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.882978 2560 scope.go:117] "RemoveContainer" containerID="c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e" Sep 08 10:58:59.883281 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.883260 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e"} err="failed to get container status \"c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e\": rpc error: code = NotFound desc = could not find container \"c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e\": container with ID starting with c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e not found: ID does not exist" Sep 08 10:58:59.883281 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.883279 2560 scope.go:117] "RemoveContainer" containerID="feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e" Sep 08 10:58:59.883499 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.883476 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e"} err="failed to get container status \"feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e\": rpc error: code = NotFound desc = could not find container \"feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e\": container with ID starting with feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e not found: ID does not exist" Sep 08 10:58:59.883563 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.883500 2560 scope.go:117] "RemoveContainer" containerID="70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea" Sep 08 10:58:59.883563 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.883551 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 08 10:58:59.883712 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.883696 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea"} err="failed to get container status \"70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea\": rpc error: code = NotFound desc = could not find container \"70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea\": container with ID starting with 70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea not found: ID does not exist" Sep 08 10:58:59.883773 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.883712 2560 scope.go:117] "RemoveContainer" containerID="a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2" Sep 08 10:58:59.883904 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.883884 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2"} err="failed to get container status \"a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2\": rpc error: code = NotFound desc = could not find container \"a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2\": container with ID starting with a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2 not found: ID does not exist" Sep 08 10:58:59.883964 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.883904 2560 scope.go:117] "RemoveContainer" containerID="c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab" Sep 08 10:58:59.883964 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.883938 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerName="kube-rbac-proxy-web" Sep 08 10:58:59.883964 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.883954 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerName="kube-rbac-proxy-web" Sep 08 10:58:59.884113 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.883972 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerName="config-reloader" Sep 08 10:58:59.884113 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.883982 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerName="config-reloader" Sep 08 10:58:59.884113 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.884003 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerName="kube-rbac-proxy-thanos" Sep 08 10:58:59.884113 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.884012 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerName="kube-rbac-proxy-thanos" Sep 08 10:58:59.884113 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.884030 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerName="kube-rbac-proxy" Sep 08 10:58:59.884113 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.884038 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerName="kube-rbac-proxy" Sep 08 10:58:59.884113 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.884056 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerName="init-config-reloader" Sep 08 10:58:59.884113 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.884064 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerName="init-config-reloader" Sep 08 10:58:59.884113 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.884074 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerName="prometheus" Sep 08 10:58:59.884113 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.884077 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab"} err="failed to get container status \"c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab\": rpc error: code = NotFound desc = could not find container \"c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab\": container with ID starting with c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab not found: ID does not exist" Sep 08 10:58:59.884113 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.884083 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerName="prometheus" Sep 08 10:58:59.884113 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.884088 2560 scope.go:117] "RemoveContainer" containerID="7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb" Sep 08 10:58:59.884113 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.884095 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerName="thanos-sidecar" Sep 08 10:58:59.884113 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.884104 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerName="thanos-sidecar" Sep 08 10:58:59.884773 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.884202 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerName="kube-rbac-proxy-thanos" Sep 08 10:58:59.884773 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.884214 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerName="prometheus" Sep 08 10:58:59.884773 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.884226 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerName="kube-rbac-proxy" Sep 08 10:58:59.884773 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.884234 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerName="config-reloader" Sep 08 10:58:59.884773 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.884244 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerName="kube-rbac-proxy-web" Sep 08 10:58:59.884773 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.884252 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" containerName="thanos-sidecar" Sep 08 10:58:59.884773 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.884324 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb"} err="failed to get container status \"7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb\": rpc error: code = NotFound desc = could not find container \"7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb\": container with ID starting with 7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb not found: ID does not exist" Sep 08 10:58:59.884773 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.884342 2560 scope.go:117] "RemoveContainer" containerID="df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61" Sep 08 10:58:59.884773 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.884537 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61"} err="failed to get container status \"df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61\": rpc error: code = NotFound desc = could not find container \"df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61\": container with ID starting with df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61 not found: ID does not exist" Sep 08 10:58:59.884773 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.884549 2560 scope.go:117] "RemoveContainer" containerID="c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e" Sep 08 10:58:59.884773 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.884738 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e"} err="failed to get container status \"c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e\": rpc error: code = NotFound desc = could not find container \"c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e\": container with ID starting with c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e not found: ID does not exist" Sep 08 10:58:59.884773 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.884751 2560 scope.go:117] "RemoveContainer" containerID="feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e" Sep 08 10:58:59.885329 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.884946 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e"} err="failed to get container status \"feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e\": rpc error: code = NotFound desc = could not find container \"feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e\": container with ID starting with feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e not found: ID does not exist" Sep 08 10:58:59.885329 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.884958 2560 scope.go:117] "RemoveContainer" containerID="70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea" Sep 08 10:58:59.885329 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.885147 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea"} err="failed to get container status \"70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea\": rpc error: code = NotFound desc = could not find container \"70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea\": container with ID starting with 70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea not found: ID does not exist" Sep 08 10:58:59.885329 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.885180 2560 scope.go:117] "RemoveContainer" containerID="a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2" Sep 08 10:58:59.885520 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.885384 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2"} err="failed to get container status \"a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2\": rpc error: code = NotFound desc = could not find container \"a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2\": container with ID starting with a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2 not found: ID does not exist" Sep 08 10:58:59.885520 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.885396 2560 scope.go:117] "RemoveContainer" containerID="c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab" Sep 08 10:58:59.885614 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.885577 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab"} err="failed to get container status \"c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab\": rpc error: code = NotFound desc = could not find container \"c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab\": container with ID starting with c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab not found: ID does not exist" Sep 08 10:58:59.885614 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.885588 2560 scope.go:117] "RemoveContainer" containerID="7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb" Sep 08 10:58:59.885789 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.885755 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb"} err="failed to get container status \"7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb\": rpc error: code = NotFound desc = could not find container \"7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb\": container with ID starting with 7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb not found: ID does not exist" Sep 08 10:58:59.885789 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.885770 2560 scope.go:117] "RemoveContainer" containerID="df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61" Sep 08 10:58:59.886033 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.886004 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61"} err="failed to get container status \"df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61\": rpc error: code = NotFound desc = could not find container \"df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61\": container with ID starting with df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61 not found: ID does not exist" Sep 08 10:58:59.886033 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.886033 2560 scope.go:117] "RemoveContainer" containerID="c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e" Sep 08 10:58:59.886315 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.886296 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e"} err="failed to get container status \"c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e\": rpc error: code = NotFound desc = could not find container \"c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e\": container with ID starting with c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e not found: ID does not exist" Sep 08 10:58:59.886315 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.886316 2560 scope.go:117] "RemoveContainer" containerID="feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e" Sep 08 10:58:59.886544 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.886527 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e"} err="failed to get container status \"feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e\": rpc error: code = NotFound desc = could not find container \"feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e\": container with ID starting with feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e not found: ID does not exist" Sep 08 10:58:59.886585 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.886544 2560 scope.go:117] "RemoveContainer" containerID="70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea" Sep 08 10:58:59.886796 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.886756 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea"} err="failed to get container status \"70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea\": rpc error: code = NotFound desc = could not find container \"70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea\": container with ID starting with 70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea not found: ID does not exist" Sep 08 10:58:59.886796 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.886777 2560 scope.go:117] "RemoveContainer" containerID="a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2" Sep 08 10:58:59.886985 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.886967 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2"} err="failed to get container status \"a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2\": rpc error: code = NotFound desc = could not find container \"a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2\": container with ID starting with a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2 not found: ID does not exist" Sep 08 10:58:59.886985 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.886984 2560 scope.go:117] "RemoveContainer" containerID="c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab" Sep 08 10:58:59.887250 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.887229 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab"} err="failed to get container status \"c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab\": rpc error: code = NotFound desc = could not find container \"c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab\": container with ID starting with c1b8a06fb757e75967ce6f0f23c546bd3de6d108a8516079ec3e4af51afa03ab not found: ID does not exist" Sep 08 10:58:59.887291 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.887253 2560 scope.go:117] "RemoveContainer" containerID="7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb" Sep 08 10:58:59.887507 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.887491 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb"} err="failed to get container status \"7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb\": rpc error: code = NotFound desc = could not find container \"7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb\": container with ID starting with 7cb218664780588f2b8877c09a97b2e5826ff4270e1c7b2c39df179ce80ceedb not found: ID does not exist" Sep 08 10:58:59.887545 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.887508 2560 scope.go:117] "RemoveContainer" containerID="df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61" Sep 08 10:58:59.887718 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.887702 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61"} err="failed to get container status \"df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61\": rpc error: code = NotFound desc = could not find container \"df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61\": container with ID starting with df5f3b45a7f8771caf885547db92b59c75b880e48e55056a7dc3bc43ecec8c61 not found: ID does not exist" Sep 08 10:58:59.887761 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.887719 2560 scope.go:117] "RemoveContainer" containerID="c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e" Sep 08 10:58:59.887953 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.887937 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e"} err="failed to get container status \"c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e\": rpc error: code = NotFound desc = could not find container \"c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e\": container with ID starting with c8f2770b9047fd50c29f6ff5f752c1c37d42a65e2ef3458873c527ec3745e00e not found: ID does not exist" Sep 08 10:58:59.888024 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.887954 2560 scope.go:117] "RemoveContainer" containerID="feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e" Sep 08 10:58:59.888198 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.888181 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e"} err="failed to get container status \"feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e\": rpc error: code = NotFound desc = could not find container \"feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e\": container with ID starting with feb28625ae7a8c0215c32b5c9c99417c99721a3e132c16c0272775de182d849e not found: ID does not exist" Sep 08 10:58:59.888269 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.888198 2560 scope.go:117] "RemoveContainer" containerID="70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea" Sep 08 10:58:59.888419 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.888400 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea"} err="failed to get container status \"70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea\": rpc error: code = NotFound desc = could not find container \"70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea\": container with ID starting with 70f88e59ab820844730793592b9a95673eee1984895af945947fbc49365f3eea not found: ID does not exist" Sep 08 10:58:59.888475 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.888420 2560 scope.go:117] "RemoveContainer" containerID="a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2" Sep 08 10:58:59.890256 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.890240 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:58:59.890585 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.890562 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2"} err="failed to get container status \"a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2\": rpc error: code = NotFound desc = could not find container \"a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2\": container with ID starting with a9822514125bcef285a5ad6cee97c634eb87c87c5f7114a9eb4c683c299309e2 not found: ID does not exist" Sep 08 10:58:59.893081 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.893063 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 08 10:58:59.893192 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.893134 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 08 10:58:59.893592 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.893383 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 08 10:58:59.893592 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.893396 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 08 10:58:59.893592 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.893417 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 08 10:58:59.893592 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.893448 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 08 10:58:59.893592 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.893465 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 08 10:58:59.893592 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.893395 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9292k\"" Sep 08 10:58:59.893592 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.893388 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 08 10:58:59.893592 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.893533 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-58ekot3m9ftb1\"" Sep 08 10:58:59.893967 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.893827 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 08 10:58:59.893967 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.893844 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 08 10:58:59.894051 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.894019 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 08 10:58:59.894051 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.894040 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 08 10:58:59.894177 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.894151 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 08 10:58:59.898807 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.898785 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 08 10:58:59.906562 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.906499 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 08 10:58:59.908926 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.908894 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f61e5d61-60ab-4fb6-8227-8f14f8680ca1" path="/var/lib/kubelet/pods/f61e5d61-60ab-4fb6-8227-8f14f8680ca1/volumes" Sep 08 10:58:59.909544 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:58:59.909525 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 08 10:59:00.069113 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.069079 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/956423cc-9f55-4496-9c06-2b2de8de25f3-config\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.069361 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.069120 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/956423cc-9f55-4496-9c06-2b2de8de25f3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.069361 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.069144 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/956423cc-9f55-4496-9c06-2b2de8de25f3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.069361 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.069190 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/956423cc-9f55-4496-9c06-2b2de8de25f3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.069361 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.069256 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/956423cc-9f55-4496-9c06-2b2de8de25f3-web-config\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.069361 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.069324 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/956423cc-9f55-4496-9c06-2b2de8de25f3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.069361 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.069350 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/956423cc-9f55-4496-9c06-2b2de8de25f3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.069667 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.069371 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjs8n\" (UniqueName: \"kubernetes.io/projected/956423cc-9f55-4496-9c06-2b2de8de25f3-kube-api-access-vjs8n\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.069667 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.069398 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/956423cc-9f55-4496-9c06-2b2de8de25f3-config-out\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.069667 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.069425 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/956423cc-9f55-4496-9c06-2b2de8de25f3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.069667 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.069454 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/956423cc-9f55-4496-9c06-2b2de8de25f3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.069667 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.069502 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/956423cc-9f55-4496-9c06-2b2de8de25f3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.069667 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.069522 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/956423cc-9f55-4496-9c06-2b2de8de25f3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.069667 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.069543 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/956423cc-9f55-4496-9c06-2b2de8de25f3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.069667 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.069574 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/956423cc-9f55-4496-9c06-2b2de8de25f3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.069667 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.069595 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/956423cc-9f55-4496-9c06-2b2de8de25f3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.069667 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.069653 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/956423cc-9f55-4496-9c06-2b2de8de25f3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.070064 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.069694 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/956423cc-9f55-4496-9c06-2b2de8de25f3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.070064 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.069723 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/956423cc-9f55-4496-9c06-2b2de8de25f3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.070064 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.069765 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/956423cc-9f55-4496-9c06-2b2de8de25f3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.171102 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.170993 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/956423cc-9f55-4496-9c06-2b2de8de25f3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.171102 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.171052 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/956423cc-9f55-4496-9c06-2b2de8de25f3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.171102 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.171099 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/956423cc-9f55-4496-9c06-2b2de8de25f3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.171501 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.171125 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/956423cc-9f55-4496-9c06-2b2de8de25f3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.171501 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.171151 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/956423cc-9f55-4496-9c06-2b2de8de25f3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.171501 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.171219 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/956423cc-9f55-4496-9c06-2b2de8de25f3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.171501 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.171251 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/956423cc-9f55-4496-9c06-2b2de8de25f3-config\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.171501 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.171283 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/956423cc-9f55-4496-9c06-2b2de8de25f3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.171501 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.171305 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/956423cc-9f55-4496-9c06-2b2de8de25f3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.171501 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.171334 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/956423cc-9f55-4496-9c06-2b2de8de25f3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.171501 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.171357 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/956423cc-9f55-4496-9c06-2b2de8de25f3-web-config\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.171501 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.171385 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/956423cc-9f55-4496-9c06-2b2de8de25f3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.171501 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.171407 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/956423cc-9f55-4496-9c06-2b2de8de25f3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.171501 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.171432 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjs8n\" (UniqueName: \"kubernetes.io/projected/956423cc-9f55-4496-9c06-2b2de8de25f3-kube-api-access-vjs8n\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.171501 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.171458 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/956423cc-9f55-4496-9c06-2b2de8de25f3-config-out\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.171501 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.171482 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/956423cc-9f55-4496-9c06-2b2de8de25f3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.172136 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.171513 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/956423cc-9f55-4496-9c06-2b2de8de25f3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.172136 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.171545 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/956423cc-9f55-4496-9c06-2b2de8de25f3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.172136 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.171578 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/956423cc-9f55-4496-9c06-2b2de8de25f3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.172136 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.171614 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/956423cc-9f55-4496-9c06-2b2de8de25f3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.172136 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.171856 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/956423cc-9f55-4496-9c06-2b2de8de25f3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.172136 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.172039 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/956423cc-9f55-4496-9c06-2b2de8de25f3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.172459 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.172149 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/956423cc-9f55-4496-9c06-2b2de8de25f3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.172878 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.172827 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/956423cc-9f55-4496-9c06-2b2de8de25f3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.172878 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.172844 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/956423cc-9f55-4496-9c06-2b2de8de25f3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.175621 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.174856 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/956423cc-9f55-4496-9c06-2b2de8de25f3-config\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.175621 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.175011 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/956423cc-9f55-4496-9c06-2b2de8de25f3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.175621 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.175523 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/956423cc-9f55-4496-9c06-2b2de8de25f3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.176781 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.176195 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/956423cc-9f55-4496-9c06-2b2de8de25f3-config-out\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.176781 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.176262 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/956423cc-9f55-4496-9c06-2b2de8de25f3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.176781 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.176485 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/956423cc-9f55-4496-9c06-2b2de8de25f3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.176781 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.176506 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/956423cc-9f55-4496-9c06-2b2de8de25f3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.176781 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.176700 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/956423cc-9f55-4496-9c06-2b2de8de25f3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.176781 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.176738 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/956423cc-9f55-4496-9c06-2b2de8de25f3-web-config\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.176781 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.176746 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/956423cc-9f55-4496-9c06-2b2de8de25f3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.177212 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.176888 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/956423cc-9f55-4496-9c06-2b2de8de25f3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.177212 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.177044 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/956423cc-9f55-4496-9c06-2b2de8de25f3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.177996 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.177972 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/956423cc-9f55-4496-9c06-2b2de8de25f3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.178401 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.178385 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/956423cc-9f55-4496-9c06-2b2de8de25f3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.181614 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.181593 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjs8n\" (UniqueName: \"kubernetes.io/projected/956423cc-9f55-4496-9c06-2b2de8de25f3-kube-api-access-vjs8n\") pod \"prometheus-k8s-0\" (UID: \"956423cc-9f55-4496-9c06-2b2de8de25f3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.202114 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.202087 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:00.494411 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.494337 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 08 10:59:00.497578 ip-10-0-139-80 kubenswrapper[2560]: W0908 10:59:00.497557 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod956423cc_9f55_4496_9c06_2b2de8de25f3.slice/crio-0616979acf983a841bb68c2dcc9ca88de1090fc27a4fd7a5f8d8e514708a07c2 WatchSource:0}: Error finding container 0616979acf983a841bb68c2dcc9ca88de1090fc27a4fd7a5f8d8e514708a07c2: Status 404 returned error can't find the container with id 0616979acf983a841bb68c2dcc9ca88de1090fc27a4fd7a5f8d8e514708a07c2 Sep 08 10:59:00.833913 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.833878 2560 generic.go:356] "Generic (PLEG): container finished" podID="956423cc-9f55-4496-9c06-2b2de8de25f3" containerID="5b0e7a88ef92492ad3844adcaa28c0c0b2bbb890902b2ed363b876724cc321a1" exitCode=0 Sep 08 10:59:00.834305 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.833931 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"956423cc-9f55-4496-9c06-2b2de8de25f3","Type":"ContainerDied","Data":"5b0e7a88ef92492ad3844adcaa28c0c0b2bbb890902b2ed363b876724cc321a1"} Sep 08 10:59:00.834305 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:00.833995 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"956423cc-9f55-4496-9c06-2b2de8de25f3","Type":"ContainerStarted","Data":"0616979acf983a841bb68c2dcc9ca88de1090fc27a4fd7a5f8d8e514708a07c2"} Sep 08 10:59:01.841889 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:01.841854 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"956423cc-9f55-4496-9c06-2b2de8de25f3","Type":"ContainerStarted","Data":"ce71eab32539d173848dadf3f6ee27c133a299248f95bb0cf7b2e6604c3f1f2f"} Sep 08 10:59:01.842309 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:01.841924 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"956423cc-9f55-4496-9c06-2b2de8de25f3","Type":"ContainerStarted","Data":"2f5d12d03e5ee32126ad2a9acde5aa0a9cbc7071b89b3af59cd0a3fd646739b5"} Sep 08 10:59:01.842309 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:01.841950 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"956423cc-9f55-4496-9c06-2b2de8de25f3","Type":"ContainerStarted","Data":"4dd048dc09497d1faa0399381d06588aadbf7e26730f5c75b6fa1fdf5643c629"} Sep 08 10:59:01.842309 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:01.841974 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"956423cc-9f55-4496-9c06-2b2de8de25f3","Type":"ContainerStarted","Data":"cb5b741f0eeaf9a2c5bd7f7de2d3f918ba70bb451406489f48ed554a3e8b60f3"} Sep 08 10:59:01.842309 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:01.842005 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"956423cc-9f55-4496-9c06-2b2de8de25f3","Type":"ContainerStarted","Data":"7ae47af9fde8e4ad0d1a111eb30dc93bc6f99c38408baf71b13c2bb6b3c18225"} Sep 08 10:59:01.842309 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:01.842030 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"956423cc-9f55-4496-9c06-2b2de8de25f3","Type":"ContainerStarted","Data":"66d36b614ecd815a46414bbee917a04f11fdcd72f8bf89106b654ace27ac4c95"} Sep 08 10:59:01.876333 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:01.876275 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.855730241 podStartE2EDuration="2.876256886s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.526645ms" isStatefulPod=false podCreationTimestamp="2026-09-08 10:58:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:59:01.873917655 +0000 UTC m=+182.506513135" watchObservedRunningTime="2026-09-08 10:59:01.876256886 +0000 UTC m=+182.508852397" Sep 08 10:59:02.574543 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:02.574507 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:59:02.675215 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:02.675152 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:59:05.203251 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:05.203217 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 10:59:15.386103 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:15.386071 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:59:15.482256 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:15.482220 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:59:48.043334 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:48.043291 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:59:48.115526 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:48.115485 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 10:59:55.725057 ip-10-0-139-80 kubenswrapper[2560]: I0908 10:59:55.725017 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:00:00.203270 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:00:00.203149 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 11:00:00.219574 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:00:00.219548 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 11:00:01.111120 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:00:01.111094 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 11:00:08.763306 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:00:08.763261 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:00:08.831278 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:00:08.831233 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:00:15.935445 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:00:15.935409 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:00:16.004672 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:00:16.004635 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:00:20.768583 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:00:20.768504 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:00:20.837616 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:00:20.837579 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:00:27.101697 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:00:27.101657 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:00:27.201495 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:00:27.201445 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:00:27.275136 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:00:27.275104 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:00:33.120530 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:00:33.120494 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:00:33.220966 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:00:33.220932 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:00:59.798652 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:00:59.798625 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f285w_80be3338-ebb8-4dd1-8545-0fcdf56b9ef3/console-operator/1.log" Sep 08 11:00:59.802580 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:00:59.802556 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f285w_80be3338-ebb8-4dd1-8545-0fcdf56b9ef3/console-operator/1.log" Sep 08 11:00:59.809936 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:00:59.809910 2560 kubelet.go:1648] "Image garbage collection succeeded" Sep 08 11:01:16.598516 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:01:16.598478 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:01:22.130063 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:01:22.130014 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:01:38.901317 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:01:38.901279 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:01:39.273409 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:01:39.273319 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:01:42.679256 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:01:42.679194 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:01:42.829114 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:01:42.829073 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:01:46.730988 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:01:46.730944 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:01:46.875904 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:01:46.875872 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:01:47.609280 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:01:47.609250 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:01:47.711067 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:01:47.711036 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:01:47.810028 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:01:47.809992 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:01:54.919972 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:01:54.919892 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:02:02.549799 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:02.549759 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:02:02.685704 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:02.685664 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:02:13.483224 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:13.483190 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:02:13.646884 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:13.646841 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:02:23.045738 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:23.045693 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:02:23.144712 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:23.144673 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:02:23.298715 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:23.298617 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:02:23.399664 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:23.399630 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:02:23.864806 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:23.864772 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:02:24.631988 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:24.631940 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:02:24.732623 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:24.732592 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:02:25.840679 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:25.840633 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:02:34.745636 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:34.745603 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:02:34.857296 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:34.857257 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:02:41.458717 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:41.458681 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:02:41.559094 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:41.559055 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:02:44.888588 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:44.888555 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:02:44.901567 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:44.901544 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-676ff8bf48-hsz2d"] Sep 08 11:02:44.904822 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:44.904791 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-676ff8bf48-hsz2d" Sep 08 11:02:44.907483 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:44.907463 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Sep 08 11:02:44.908561 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:44.908546 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 08 11:02:44.908561 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:44.908556 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-kgnhz\"" Sep 08 11:02:44.908705 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:44.908560 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Sep 08 11:02:44.908705 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:44.908685 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 08 11:02:44.915728 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:44.915707 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-676ff8bf48-hsz2d"] Sep 08 11:02:44.980719 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:44.980681 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:02:45.000519 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:45.000488 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ntd4\" (UniqueName: \"kubernetes.io/projected/b898fa14-5c21-4c19-98a0-4fb8b0f1d29c-kube-api-access-8ntd4\") pod \"kubeflow-trainer-controller-manager-676ff8bf48-hsz2d\" (UID: \"b898fa14-5c21-4c19-98a0-4fb8b0f1d29c\") " pod="opendatahub/kubeflow-trainer-controller-manager-676ff8bf48-hsz2d" Sep 08 11:02:45.000683 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:45.000595 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/b898fa14-5c21-4c19-98a0-4fb8b0f1d29c-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-676ff8bf48-hsz2d\" (UID: \"b898fa14-5c21-4c19-98a0-4fb8b0f1d29c\") " pod="opendatahub/kubeflow-trainer-controller-manager-676ff8bf48-hsz2d" Sep 08 11:02:45.000683 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:45.000636 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b898fa14-5c21-4c19-98a0-4fb8b0f1d29c-cert\") pod \"kubeflow-trainer-controller-manager-676ff8bf48-hsz2d\" (UID: \"b898fa14-5c21-4c19-98a0-4fb8b0f1d29c\") " pod="opendatahub/kubeflow-trainer-controller-manager-676ff8bf48-hsz2d" Sep 08 11:02:45.101769 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:45.101726 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/b898fa14-5c21-4c19-98a0-4fb8b0f1d29c-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-676ff8bf48-hsz2d\" (UID: \"b898fa14-5c21-4c19-98a0-4fb8b0f1d29c\") " pod="opendatahub/kubeflow-trainer-controller-manager-676ff8bf48-hsz2d" Sep 08 11:02:45.101769 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:45.101778 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b898fa14-5c21-4c19-98a0-4fb8b0f1d29c-cert\") pod \"kubeflow-trainer-controller-manager-676ff8bf48-hsz2d\" (UID: \"b898fa14-5c21-4c19-98a0-4fb8b0f1d29c\") " pod="opendatahub/kubeflow-trainer-controller-manager-676ff8bf48-hsz2d" Sep 08 11:02:45.102040 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:45.101799 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ntd4\" (UniqueName: \"kubernetes.io/projected/b898fa14-5c21-4c19-98a0-4fb8b0f1d29c-kube-api-access-8ntd4\") pod \"kubeflow-trainer-controller-manager-676ff8bf48-hsz2d\" (UID: \"b898fa14-5c21-4c19-98a0-4fb8b0f1d29c\") " pod="opendatahub/kubeflow-trainer-controller-manager-676ff8bf48-hsz2d" Sep 08 11:02:45.102376 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:45.102352 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/b898fa14-5c21-4c19-98a0-4fb8b0f1d29c-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-676ff8bf48-hsz2d\" (UID: \"b898fa14-5c21-4c19-98a0-4fb8b0f1d29c\") " pod="opendatahub/kubeflow-trainer-controller-manager-676ff8bf48-hsz2d" Sep 08 11:02:45.104295 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:45.104275 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b898fa14-5c21-4c19-98a0-4fb8b0f1d29c-cert\") pod \"kubeflow-trainer-controller-manager-676ff8bf48-hsz2d\" (UID: \"b898fa14-5c21-4c19-98a0-4fb8b0f1d29c\") " pod="opendatahub/kubeflow-trainer-controller-manager-676ff8bf48-hsz2d" Sep 08 11:02:45.115244 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:45.115218 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ntd4\" (UniqueName: \"kubernetes.io/projected/b898fa14-5c21-4c19-98a0-4fb8b0f1d29c-kube-api-access-8ntd4\") pod \"kubeflow-trainer-controller-manager-676ff8bf48-hsz2d\" (UID: \"b898fa14-5c21-4c19-98a0-4fb8b0f1d29c\") " pod="opendatahub/kubeflow-trainer-controller-manager-676ff8bf48-hsz2d" Sep 08 11:02:45.225187 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:45.225094 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-676ff8bf48-hsz2d" Sep 08 11:02:45.508393 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:45.508294 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-676ff8bf48-hsz2d"] Sep 08 11:02:45.511724 ip-10-0-139-80 kubenswrapper[2560]: W0908 11:02:45.511692 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb898fa14_5c21_4c19_98a0_4fb8b0f1d29c.slice/crio-f5bd5a2627d36c44232946ae945c8415d6fa5c10c7bd4cdb774f032d78c0e9ed WatchSource:0}: Error finding container f5bd5a2627d36c44232946ae945c8415d6fa5c10c7bd4cdb774f032d78c0e9ed: Status 404 returned error can't find the container with id f5bd5a2627d36c44232946ae945c8415d6fa5c10c7bd4cdb774f032d78c0e9ed Sep 08 11:02:45.513771 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:45.513751 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 11:02:45.789612 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:45.789579 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-676ff8bf48-hsz2d" event={"ID":"b898fa14-5c21-4c19-98a0-4fb8b0f1d29c","Type":"ContainerStarted","Data":"f5bd5a2627d36c44232946ae945c8415d6fa5c10c7bd4cdb774f032d78c0e9ed"} Sep 08 11:02:48.527025 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:48.526985 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:02:48.592356 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:48.592323 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:02:48.811265 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:48.811226 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-676ff8bf48-hsz2d" event={"ID":"b898fa14-5c21-4c19-98a0-4fb8b0f1d29c","Type":"ContainerStarted","Data":"f5104b80490b7a47cebde52686c553b19e0cbb7bfb042711a0047d63a883bf12"} Sep 08 11:02:48.811437 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:48.811367 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-676ff8bf48-hsz2d" Sep 08 11:02:48.831252 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:48.831137 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-676ff8bf48-hsz2d" podStartSLOduration=2.464067887 podStartE2EDuration="4.831123451s" totalImagesPullingTime="2.367055564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:02:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:02:48.830659891 +0000 UTC m=+409.463255369" watchObservedRunningTime="2026-09-08 11:02:48.831123451 +0000 UTC m=+409.463718929" Sep 08 11:02:59.307959 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:59.307919 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:02:59.372818 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:02:59.372781 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:03:01.054364 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:03:01.054329 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:03:04.820909 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:03:04.820872 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-676ff8bf48-hsz2d" Sep 08 11:04:08.491838 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:04:08.491800 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:04:12.555865 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:04:12.555826 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:04:12.655219 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:04:12.655159 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:04:12.726240 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:04:12.726203 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:04:12.727220 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:04:12.727197 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-8zzhv/progression-enabled-node-0-0-c6zlv"] Sep 08 11:04:12.730427 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:04:12.730409 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-8zzhv/progression-enabled-node-0-0-c6zlv" Sep 08 11:04:12.733080 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:04:12.733060 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-8zzhv\"/\"kube-root-ca.crt\"" Sep 08 11:04:12.733080 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:04:12.733070 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-8zzhv\"/\"default-dockercfg-jjv5p\"" Sep 08 11:04:12.733080 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:04:12.733076 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-8zzhv\"/\"openshift-service-ca.crt\"" Sep 08 11:04:12.740282 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:04:12.740260 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-8zzhv/progression-enabled-node-0-0-c6zlv"] Sep 08 11:04:12.761652 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:04:12.761624 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b59pc\" (UniqueName: \"kubernetes.io/projected/01678a97-5d20-4fa2-9753-5b7a8e17ec6c-kube-api-access-b59pc\") pod \"progression-enabled-node-0-0-c6zlv\" (UID: \"01678a97-5d20-4fa2-9753-5b7a8e17ec6c\") " pod="rhai-e2e-progression-8zzhv/progression-enabled-node-0-0-c6zlv" Sep 08 11:04:12.863098 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:04:12.863010 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b59pc\" (UniqueName: \"kubernetes.io/projected/01678a97-5d20-4fa2-9753-5b7a8e17ec6c-kube-api-access-b59pc\") pod \"progression-enabled-node-0-0-c6zlv\" (UID: \"01678a97-5d20-4fa2-9753-5b7a8e17ec6c\") " pod="rhai-e2e-progression-8zzhv/progression-enabled-node-0-0-c6zlv" Sep 08 11:04:12.872406 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:04:12.872378 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b59pc\" (UniqueName: \"kubernetes.io/projected/01678a97-5d20-4fa2-9753-5b7a8e17ec6c-kube-api-access-b59pc\") pod \"progression-enabled-node-0-0-c6zlv\" (UID: \"01678a97-5d20-4fa2-9753-5b7a8e17ec6c\") " pod="rhai-e2e-progression-8zzhv/progression-enabled-node-0-0-c6zlv" Sep 08 11:04:13.041266 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:04:13.041230 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-8zzhv/progression-enabled-node-0-0-c6zlv" Sep 08 11:04:13.288942 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:04:13.288912 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:04:13.322658 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:04:13.322628 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-8zzhv/progression-enabled-node-0-0-c6zlv"] Sep 08 11:04:13.326264 ip-10-0-139-80 kubenswrapper[2560]: W0908 11:04:13.326228 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01678a97_5d20_4fa2_9753_5b7a8e17ec6c.slice/crio-a4371b263bf70891ec47198e2352eeddbcc1ee59af222a08cc9c273713ea1ccd WatchSource:0}: Error finding container a4371b263bf70891ec47198e2352eeddbcc1ee59af222a08cc9c273713ea1ccd: Status 404 returned error can't find the container with id a4371b263bf70891ec47198e2352eeddbcc1ee59af222a08cc9c273713ea1ccd Sep 08 11:04:14.188658 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:04:14.188619 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-8zzhv/progression-enabled-node-0-0-c6zlv" event={"ID":"01678a97-5d20-4fa2-9753-5b7a8e17ec6c","Type":"ContainerStarted","Data":"a4371b263bf70891ec47198e2352eeddbcc1ee59af222a08cc9c273713ea1ccd"} Sep 08 11:04:17.032204 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:04:17.032147 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:04:22.518475 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:04:22.518433 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:04:22.571272 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:04:22.571237 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:06:04.182072 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:04.182038 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f285w_80be3338-ebb8-4dd1-8545-0fcdf56b9ef3/console-operator/1.log" Sep 08 11:06:04.182787 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:04.182762 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f285w_80be3338-ebb8-4dd1-8545-0fcdf56b9ef3/console-operator/1.log" Sep 08 11:06:05.745262 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:05.745221 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-8zzhv/progression-enabled-node-0-0-c6zlv" event={"ID":"01678a97-5d20-4fa2-9753-5b7a8e17ec6c","Type":"ContainerStarted","Data":"7d4c0a2f96cc470158f0f8d4a2eb339043f5f6c56adea0992381903e29fcb313"} Sep 08 11:06:05.745622 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:05.745397 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-8zzhv/progression-enabled-node-0-0-c6zlv" Sep 08 11:06:05.783444 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:05.783382 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-8zzhv/progression-enabled-node-0-0-c6zlv" podStartSLOduration=2.482741944 podStartE2EDuration="1m53.783365288s" totalImagesPullingTime="1m51.300623344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:06:05.78274037 +0000 UTC m=+606.415335849" watchObservedRunningTime="2026-09-08 11:06:05.783365288 +0000 UTC m=+606.415960765" Sep 08 11:06:06.748661 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:06.748632 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-8zzhv/progression-enabled-node-0-0-c6zlv" Sep 08 11:06:27.952584 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:27.952480 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-8zzhv/progression-enabled-node-0-0-c6zlv" podUID="01678a97-5d20-4fa2-9753-5b7a8e17ec6c" containerName="node" probeResult="failure" output="Get \"http://10.133.0.27:28080/metrics\": read tcp 10.133.0.2:36106->10.133.0.27:28080: read: connection reset by peer" Sep 08 11:06:28.745769 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:28.745725 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-8zzhv/progression-enabled-node-0-0-c6zlv" podUID="01678a97-5d20-4fa2-9753-5b7a8e17ec6c" containerName="node" probeResult="failure" output="Get \"http://10.133.0.27:28080/metrics\": dial tcp 10.133.0.27:28080: connect: connection refused" Sep 08 11:06:28.745970 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:28.745837 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-8zzhv/progression-enabled-node-0-0-c6zlv" Sep 08 11:06:28.746391 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:28.746364 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-8zzhv/progression-enabled-node-0-0-c6zlv" podUID="01678a97-5d20-4fa2-9753-5b7a8e17ec6c" containerName="node" probeResult="failure" output="Get \"http://10.133.0.27:28080/metrics\": dial tcp 10.133.0.27:28080: connect: connection refused" Sep 08 11:06:28.849440 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:28.849407 2560 generic.go:356] "Generic (PLEG): container finished" podID="01678a97-5d20-4fa2-9753-5b7a8e17ec6c" containerID="7d4c0a2f96cc470158f0f8d4a2eb339043f5f6c56adea0992381903e29fcb313" exitCode=0 Sep 08 11:06:28.849607 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:28.849446 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-8zzhv/progression-enabled-node-0-0-c6zlv" event={"ID":"01678a97-5d20-4fa2-9753-5b7a8e17ec6c","Type":"ContainerDied","Data":"7d4c0a2f96cc470158f0f8d4a2eb339043f5f6c56adea0992381903e29fcb313"} Sep 08 11:06:30.002519 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:30.002489 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-8zzhv/progression-enabled-node-0-0-c6zlv" Sep 08 11:06:30.020486 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:30.020455 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b59pc\" (UniqueName: \"kubernetes.io/projected/01678a97-5d20-4fa2-9753-5b7a8e17ec6c-kube-api-access-b59pc\") pod \"01678a97-5d20-4fa2-9753-5b7a8e17ec6c\" (UID: \"01678a97-5d20-4fa2-9753-5b7a8e17ec6c\") " Sep 08 11:06:30.023504 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:30.023475 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01678a97-5d20-4fa2-9753-5b7a8e17ec6c-kube-api-access-b59pc" (OuterVolumeSpecName: "kube-api-access-b59pc") pod "01678a97-5d20-4fa2-9753-5b7a8e17ec6c" (UID: "01678a97-5d20-4fa2-9753-5b7a8e17ec6c"). InnerVolumeSpecName "kube-api-access-b59pc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 11:06:30.122066 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:30.121976 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b59pc\" (UniqueName: \"kubernetes.io/projected/01678a97-5d20-4fa2-9753-5b7a8e17ec6c-kube-api-access-b59pc\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 11:06:30.858865 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:30.858840 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-8zzhv/progression-enabled-node-0-0-c6zlv" Sep 08 11:06:30.859049 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:30.858841 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-8zzhv/progression-enabled-node-0-0-c6zlv" event={"ID":"01678a97-5d20-4fa2-9753-5b7a8e17ec6c","Type":"ContainerDied","Data":"a4371b263bf70891ec47198e2352eeddbcc1ee59af222a08cc9c273713ea1ccd"} Sep 08 11:06:30.859049 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:30.858973 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4371b263bf70891ec47198e2352eeddbcc1ee59af222a08cc9c273713ea1ccd" Sep 08 11:06:31.236335 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:31.236245 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:06:31.245138 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:31.245110 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-8zzhv/progression-disabled-node-0-0-sbjxh"] Sep 08 11:06:31.245496 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:31.245482 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01678a97-5d20-4fa2-9753-5b7a8e17ec6c" containerName="node" Sep 08 11:06:31.245538 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:31.245499 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="01678a97-5d20-4fa2-9753-5b7a8e17ec6c" containerName="node" Sep 08 11:06:31.245571 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:31.245556 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="01678a97-5d20-4fa2-9753-5b7a8e17ec6c" containerName="node" Sep 08 11:06:31.260260 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:31.260228 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-8zzhv/progression-disabled-node-0-0-sbjxh"] Sep 08 11:06:31.260413 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:31.260313 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-8zzhv/progression-disabled-node-0-0-sbjxh" Sep 08 11:06:31.263110 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:31.263087 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-8zzhv\"/\"openshift-service-ca.crt\"" Sep 08 11:06:31.263265 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:31.263087 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-8zzhv\"/\"kube-root-ca.crt\"" Sep 08 11:06:31.263265 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:31.263088 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-8zzhv\"/\"default-dockercfg-jjv5p\"" Sep 08 11:06:31.332383 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:31.332349 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mj92\" (UniqueName: \"kubernetes.io/projected/23b615bc-77dd-43cf-a3cb-6c550d21044d-kube-api-access-4mj92\") pod \"progression-disabled-node-0-0-sbjxh\" (UID: \"23b615bc-77dd-43cf-a3cb-6c550d21044d\") " pod="rhai-e2e-progression-8zzhv/progression-disabled-node-0-0-sbjxh" Sep 08 11:06:31.433203 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:31.433140 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mj92\" (UniqueName: \"kubernetes.io/projected/23b615bc-77dd-43cf-a3cb-6c550d21044d-kube-api-access-4mj92\") pod \"progression-disabled-node-0-0-sbjxh\" (UID: \"23b615bc-77dd-43cf-a3cb-6c550d21044d\") " pod="rhai-e2e-progression-8zzhv/progression-disabled-node-0-0-sbjxh" Sep 08 11:06:31.442554 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:31.442529 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mj92\" (UniqueName: \"kubernetes.io/projected/23b615bc-77dd-43cf-a3cb-6c550d21044d-kube-api-access-4mj92\") pod \"progression-disabled-node-0-0-sbjxh\" (UID: \"23b615bc-77dd-43cf-a3cb-6c550d21044d\") " pod="rhai-e2e-progression-8zzhv/progression-disabled-node-0-0-sbjxh" Sep 08 11:06:31.573340 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:31.573308 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-8zzhv/progression-disabled-node-0-0-sbjxh" Sep 08 11:06:31.861009 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:31.860960 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-8zzhv/progression-disabled-node-0-0-sbjxh"] Sep 08 11:06:31.863412 ip-10-0-139-80 kubenswrapper[2560]: W0908 11:06:31.863380 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23b615bc_77dd_43cf_a3cb_6c550d21044d.slice/crio-2aea5ced682c5575fd865e0265ca334f257d7e2ec47301853dab17e42231f896 WatchSource:0}: Error finding container 2aea5ced682c5575fd865e0265ca334f257d7e2ec47301853dab17e42231f896: Status 404 returned error can't find the container with id 2aea5ced682c5575fd865e0265ca334f257d7e2ec47301853dab17e42231f896 Sep 08 11:06:32.870157 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:32.870119 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-8zzhv/progression-disabled-node-0-0-sbjxh" event={"ID":"23b615bc-77dd-43cf-a3cb-6c550d21044d","Type":"ContainerStarted","Data":"b7e86664397180fb2dad57650ce69b97745044eeed70efab4ef322774d6f3f7a"} Sep 08 11:06:32.870605 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:32.870186 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-8zzhv/progression-disabled-node-0-0-sbjxh" event={"ID":"23b615bc-77dd-43cf-a3cb-6c550d21044d","Type":"ContainerStarted","Data":"2aea5ced682c5575fd865e0265ca334f257d7e2ec47301853dab17e42231f896"} Sep 08 11:06:32.870605 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:32.870209 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-8zzhv/progression-disabled-node-0-0-sbjxh" Sep 08 11:06:32.889025 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:32.888980 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-8zzhv/progression-disabled-node-0-0-sbjxh" podStartSLOduration=1.8889606780000001 podStartE2EDuration="1.888960678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:06:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:06:32.888368147 +0000 UTC m=+633.520963626" watchObservedRunningTime="2026-09-08 11:06:32.888960678 +0000 UTC m=+633.521556155" Sep 08 11:06:33.873227 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:33.873190 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-8zzhv/progression-disabled-node-0-0-sbjxh" Sep 08 11:06:55.098609 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:55.098560 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-8zzhv/progression-disabled-node-0-0-sbjxh" podUID="23b615bc-77dd-43cf-a3cb-6c550d21044d" containerName="node" probeResult="failure" output="Get \"http://10.133.0.28:28080/metrics\": read tcp 10.133.0.2:37312->10.133.0.28:28080: read: connection reset by peer" Sep 08 11:06:55.871550 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:55.871507 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-8zzhv/progression-disabled-node-0-0-sbjxh" podUID="23b615bc-77dd-43cf-a3cb-6c550d21044d" containerName="node" probeResult="failure" output="Get \"http://10.133.0.28:28080/metrics\": dial tcp 10.133.0.28:28080: connect: connection refused" Sep 08 11:06:55.871732 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:55.871611 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-8zzhv/progression-disabled-node-0-0-sbjxh" Sep 08 11:06:55.872130 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:55.872107 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-8zzhv/progression-disabled-node-0-0-sbjxh" podUID="23b615bc-77dd-43cf-a3cb-6c550d21044d" containerName="node" probeResult="failure" output="Get \"http://10.133.0.28:28080/metrics\": dial tcp 10.133.0.28:28080: connect: connection refused" Sep 08 11:06:55.978712 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:55.978675 2560 generic.go:356] "Generic (PLEG): container finished" podID="23b615bc-77dd-43cf-a3cb-6c550d21044d" containerID="b7e86664397180fb2dad57650ce69b97745044eeed70efab4ef322774d6f3f7a" exitCode=0 Sep 08 11:06:55.978884 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:55.978749 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-8zzhv/progression-disabled-node-0-0-sbjxh" event={"ID":"23b615bc-77dd-43cf-a3cb-6c550d21044d","Type":"ContainerDied","Data":"b7e86664397180fb2dad57650ce69b97745044eeed70efab4ef322774d6f3f7a"} Sep 08 11:06:57.117673 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:57.117642 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-8zzhv/progression-disabled-node-0-0-sbjxh" Sep 08 11:06:57.257428 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:57.257332 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mj92\" (UniqueName: \"kubernetes.io/projected/23b615bc-77dd-43cf-a3cb-6c550d21044d-kube-api-access-4mj92\") pod \"23b615bc-77dd-43cf-a3cb-6c550d21044d\" (UID: \"23b615bc-77dd-43cf-a3cb-6c550d21044d\") " Sep 08 11:06:57.259513 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:57.259487 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23b615bc-77dd-43cf-a3cb-6c550d21044d-kube-api-access-4mj92" (OuterVolumeSpecName: "kube-api-access-4mj92") pod "23b615bc-77dd-43cf-a3cb-6c550d21044d" (UID: "23b615bc-77dd-43cf-a3cb-6c550d21044d"). InnerVolumeSpecName "kube-api-access-4mj92". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 11:06:57.359022 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:57.358982 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mj92\" (UniqueName: \"kubernetes.io/projected/23b615bc-77dd-43cf-a3cb-6c550d21044d-kube-api-access-4mj92\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 11:06:57.989920 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:57.989881 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-8zzhv/progression-disabled-node-0-0-sbjxh" event={"ID":"23b615bc-77dd-43cf-a3cb-6c550d21044d","Type":"ContainerDied","Data":"2aea5ced682c5575fd865e0265ca334f257d7e2ec47301853dab17e42231f896"} Sep 08 11:06:57.990111 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:57.989941 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2aea5ced682c5575fd865e0265ca334f257d7e2ec47301853dab17e42231f896" Sep 08 11:06:57.990111 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:06:57.989894 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-8zzhv/progression-disabled-node-0-0-sbjxh" Sep 08 11:07:06.233942 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:06.233908 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:07:08.855445 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:08.855407 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:07:11.469804 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:11.469771 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:07:21.277940 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:21.277905 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-8zzhv/progression-custom-config-node-0-0-sgt5d"] Sep 08 11:07:21.278488 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:21.278468 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23b615bc-77dd-43cf-a3cb-6c550d21044d" containerName="node" Sep 08 11:07:21.278565 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:21.278490 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="23b615bc-77dd-43cf-a3cb-6c550d21044d" containerName="node" Sep 08 11:07:21.278650 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:21.278637 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="23b615bc-77dd-43cf-a3cb-6c550d21044d" containerName="node" Sep 08 11:07:21.280887 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:21.280865 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-8zzhv/progression-custom-config-node-0-0-sgt5d" Sep 08 11:07:21.283702 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:21.283681 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-8zzhv\"/\"openshift-service-ca.crt\"" Sep 08 11:07:21.283822 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:21.283804 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-8zzhv\"/\"kube-root-ca.crt\"" Sep 08 11:07:21.283911 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:21.283896 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-8zzhv\"/\"default-dockercfg-jjv5p\"" Sep 08 11:07:21.295152 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:21.295128 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-8zzhv/progression-custom-config-node-0-0-sgt5d"] Sep 08 11:07:21.301340 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:21.301316 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:07:21.360899 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:21.360862 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67ttk\" (UniqueName: \"kubernetes.io/projected/89fe0c07-4219-4a4a-8e52-8c5fb17f1353-kube-api-access-67ttk\") pod \"progression-custom-config-node-0-0-sgt5d\" (UID: \"89fe0c07-4219-4a4a-8e52-8c5fb17f1353\") " pod="rhai-e2e-progression-8zzhv/progression-custom-config-node-0-0-sgt5d" Sep 08 11:07:21.461540 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:21.461505 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67ttk\" (UniqueName: \"kubernetes.io/projected/89fe0c07-4219-4a4a-8e52-8c5fb17f1353-kube-api-access-67ttk\") pod \"progression-custom-config-node-0-0-sgt5d\" (UID: \"89fe0c07-4219-4a4a-8e52-8c5fb17f1353\") " pod="rhai-e2e-progression-8zzhv/progression-custom-config-node-0-0-sgt5d" Sep 08 11:07:21.470920 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:21.470894 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67ttk\" (UniqueName: \"kubernetes.io/projected/89fe0c07-4219-4a4a-8e52-8c5fb17f1353-kube-api-access-67ttk\") pod \"progression-custom-config-node-0-0-sgt5d\" (UID: \"89fe0c07-4219-4a4a-8e52-8c5fb17f1353\") " pod="rhai-e2e-progression-8zzhv/progression-custom-config-node-0-0-sgt5d" Sep 08 11:07:21.590303 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:21.590266 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-8zzhv/progression-custom-config-node-0-0-sgt5d" Sep 08 11:07:21.867194 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:21.867149 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-8zzhv/progression-custom-config-node-0-0-sgt5d"] Sep 08 11:07:21.872547 ip-10-0-139-80 kubenswrapper[2560]: W0908 11:07:21.872516 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89fe0c07_4219_4a4a_8e52_8c5fb17f1353.slice/crio-017f23304ba51cf93e28bb3d7b83f59b1bc5bcbd4a37e2146fb90504b8ef9200 WatchSource:0}: Error finding container 017f23304ba51cf93e28bb3d7b83f59b1bc5bcbd4a37e2146fb90504b8ef9200: Status 404 returned error can't find the container with id 017f23304ba51cf93e28bb3d7b83f59b1bc5bcbd4a37e2146fb90504b8ef9200 Sep 08 11:07:22.106406 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:22.106361 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-8zzhv/progression-custom-config-node-0-0-sgt5d" event={"ID":"89fe0c07-4219-4a4a-8e52-8c5fb17f1353","Type":"ContainerStarted","Data":"7be7a127dbe8632a65c2fa7c42182cb3a5823e9745f006c6db5596c06c50905c"} Sep 08 11:07:22.106627 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:22.106419 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-8zzhv/progression-custom-config-node-0-0-sgt5d" Sep 08 11:07:22.106627 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:22.106435 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-8zzhv/progression-custom-config-node-0-0-sgt5d" event={"ID":"89fe0c07-4219-4a4a-8e52-8c5fb17f1353","Type":"ContainerStarted","Data":"017f23304ba51cf93e28bb3d7b83f59b1bc5bcbd4a37e2146fb90504b8ef9200"} Sep 08 11:07:22.123558 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:22.123454 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:07:22.128249 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:22.128196 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-8zzhv/progression-custom-config-node-0-0-sgt5d" podStartSLOduration=1.128179574 podStartE2EDuration="1.128179574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:07:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:07:22.127352533 +0000 UTC m=+682.759948011" watchObservedRunningTime="2026-09-08 11:07:22.128179574 +0000 UTC m=+682.760775116" Sep 08 11:07:23.108341 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:23.108302 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-8zzhv/progression-custom-config-node-0-0-sgt5d" podUID="89fe0c07-4219-4a4a-8e52-8c5fb17f1353" containerName="node" probeResult="failure" output="Get \"http://10.133.0.29:28080/metrics\": dial tcp 10.133.0.29:28080: connect: connection refused" Sep 08 11:07:23.112345 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:23.112316 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-8zzhv/progression-custom-config-node-0-0-sgt5d" podUID="89fe0c07-4219-4a4a-8e52-8c5fb17f1353" containerName="node" probeResult="failure" output="Get \"http://10.133.0.29:28080/metrics\": dial tcp 10.133.0.29:28080: connect: connection refused" Sep 08 11:07:24.113712 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:24.113682 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-8zzhv/progression-custom-config-node-0-0-sgt5d" Sep 08 11:07:44.033819 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:44.033782 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:07:44.135250 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:44.135215 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:07:45.113245 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:45.113186 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-8zzhv/progression-custom-config-node-0-0-sgt5d" podUID="89fe0c07-4219-4a4a-8e52-8c5fb17f1353" containerName="node" probeResult="failure" output="Get \"http://10.133.0.29:28080/metrics\": dial tcp 10.133.0.29:28080: connect: connection refused" Sep 08 11:07:45.222273 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:45.222241 2560 generic.go:356] "Generic (PLEG): container finished" podID="89fe0c07-4219-4a4a-8e52-8c5fb17f1353" containerID="7be7a127dbe8632a65c2fa7c42182cb3a5823e9745f006c6db5596c06c50905c" exitCode=0 Sep 08 11:07:45.222438 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:45.222310 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-8zzhv/progression-custom-config-node-0-0-sgt5d" event={"ID":"89fe0c07-4219-4a4a-8e52-8c5fb17f1353","Type":"ContainerDied","Data":"7be7a127dbe8632a65c2fa7c42182cb3a5823e9745f006c6db5596c06c50905c"} Sep 08 11:07:46.363619 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:46.363597 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-8zzhv/progression-custom-config-node-0-0-sgt5d" Sep 08 11:07:46.481442 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:46.481333 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67ttk\" (UniqueName: \"kubernetes.io/projected/89fe0c07-4219-4a4a-8e52-8c5fb17f1353-kube-api-access-67ttk\") pod \"89fe0c07-4219-4a4a-8e52-8c5fb17f1353\" (UID: \"89fe0c07-4219-4a4a-8e52-8c5fb17f1353\") " Sep 08 11:07:46.483581 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:46.483556 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89fe0c07-4219-4a4a-8e52-8c5fb17f1353-kube-api-access-67ttk" (OuterVolumeSpecName: "kube-api-access-67ttk") pod "89fe0c07-4219-4a4a-8e52-8c5fb17f1353" (UID: "89fe0c07-4219-4a4a-8e52-8c5fb17f1353"). InnerVolumeSpecName "kube-api-access-67ttk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 11:07:46.582761 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:46.582719 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67ttk\" (UniqueName: \"kubernetes.io/projected/89fe0c07-4219-4a4a-8e52-8c5fb17f1353-kube-api-access-67ttk\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 11:07:47.233797 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:47.233772 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-8zzhv/progression-custom-config-node-0-0-sgt5d" Sep 08 11:07:47.233974 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:47.233771 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-8zzhv/progression-custom-config-node-0-0-sgt5d" event={"ID":"89fe0c07-4219-4a4a-8e52-8c5fb17f1353","Type":"ContainerDied","Data":"017f23304ba51cf93e28bb3d7b83f59b1bc5bcbd4a37e2146fb90504b8ef9200"} Sep 08 11:07:47.233974 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:07:47.233904 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="017f23304ba51cf93e28bb3d7b83f59b1bc5bcbd4a37e2146fb90504b8ef9200" Sep 08 11:09:17.919955 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:17.919920 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:09:17.921267 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:17.921246 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-8zzhv/progression-no-metrics-node-0-0-hvbfr"] Sep 08 11:09:17.921584 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:17.921572 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89fe0c07-4219-4a4a-8e52-8c5fb17f1353" containerName="node" Sep 08 11:09:17.921628 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:17.921586 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="89fe0c07-4219-4a4a-8e52-8c5fb17f1353" containerName="node" Sep 08 11:09:17.921664 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:17.921650 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="89fe0c07-4219-4a4a-8e52-8c5fb17f1353" containerName="node" Sep 08 11:09:17.923527 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:17.923513 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-8zzhv/progression-no-metrics-node-0-0-hvbfr" Sep 08 11:09:17.926353 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:17.926334 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-8zzhv\"/\"kube-root-ca.crt\"" Sep 08 11:09:17.927562 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:17.927539 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-8zzhv\"/\"default-dockercfg-jjv5p\"" Sep 08 11:09:17.927668 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:17.927562 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-8zzhv\"/\"openshift-service-ca.crt\"" Sep 08 11:09:17.936186 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:17.936104 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-8zzhv/progression-no-metrics-node-0-0-hvbfr"] Sep 08 11:09:18.006290 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:18.006249 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssbw6\" (UniqueName: \"kubernetes.io/projected/fbbf6714-40bf-48ca-8ef5-ff8e7aa501ed-kube-api-access-ssbw6\") pod \"progression-no-metrics-node-0-0-hvbfr\" (UID: \"fbbf6714-40bf-48ca-8ef5-ff8e7aa501ed\") " pod="rhai-e2e-progression-8zzhv/progression-no-metrics-node-0-0-hvbfr" Sep 08 11:09:18.107181 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:18.107134 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssbw6\" (UniqueName: \"kubernetes.io/projected/fbbf6714-40bf-48ca-8ef5-ff8e7aa501ed-kube-api-access-ssbw6\") pod \"progression-no-metrics-node-0-0-hvbfr\" (UID: \"fbbf6714-40bf-48ca-8ef5-ff8e7aa501ed\") " pod="rhai-e2e-progression-8zzhv/progression-no-metrics-node-0-0-hvbfr" Sep 08 11:09:18.118296 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:18.118265 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssbw6\" (UniqueName: \"kubernetes.io/projected/fbbf6714-40bf-48ca-8ef5-ff8e7aa501ed-kube-api-access-ssbw6\") pod \"progression-no-metrics-node-0-0-hvbfr\" (UID: \"fbbf6714-40bf-48ca-8ef5-ff8e7aa501ed\") " pod="rhai-e2e-progression-8zzhv/progression-no-metrics-node-0-0-hvbfr" Sep 08 11:09:18.233357 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:18.233244 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-8zzhv/progression-no-metrics-node-0-0-hvbfr" Sep 08 11:09:18.505408 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:18.505382 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-8zzhv/progression-no-metrics-node-0-0-hvbfr"] Sep 08 11:09:18.508228 ip-10-0-139-80 kubenswrapper[2560]: W0908 11:09:18.508189 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbbf6714_40bf_48ca_8ef5_ff8e7aa501ed.slice/crio-e87da5a74c72022af472af45fd3635c04a79099d4ea98a46ea7dd7078fcc700d WatchSource:0}: Error finding container e87da5a74c72022af472af45fd3635c04a79099d4ea98a46ea7dd7078fcc700d: Status 404 returned error can't find the container with id e87da5a74c72022af472af45fd3635c04a79099d4ea98a46ea7dd7078fcc700d Sep 08 11:09:18.666569 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:18.666536 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-8zzhv/progression-no-metrics-node-0-0-hvbfr" event={"ID":"fbbf6714-40bf-48ca-8ef5-ff8e7aa501ed","Type":"ContainerStarted","Data":"aed4adc56543a1e40894ad46a76ce36e6c9da87fb5414002cf5f1a2adcd647e9"} Sep 08 11:09:18.666756 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:18.666580 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-8zzhv/progression-no-metrics-node-0-0-hvbfr" event={"ID":"fbbf6714-40bf-48ca-8ef5-ff8e7aa501ed","Type":"ContainerStarted","Data":"e87da5a74c72022af472af45fd3635c04a79099d4ea98a46ea7dd7078fcc700d"} Sep 08 11:09:18.685109 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:18.685061 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-8zzhv/progression-no-metrics-node-0-0-hvbfr" podStartSLOduration=1.685045531 podStartE2EDuration="1.685045531s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:09:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:09:18.684216643 +0000 UTC m=+799.316812114" watchObservedRunningTime="2026-09-08 11:09:18.685045531 +0000 UTC m=+799.317641006" Sep 08 11:09:23.691701 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:23.691667 2560 generic.go:356] "Generic (PLEG): container finished" podID="fbbf6714-40bf-48ca-8ef5-ff8e7aa501ed" containerID="aed4adc56543a1e40894ad46a76ce36e6c9da87fb5414002cf5f1a2adcd647e9" exitCode=0 Sep 08 11:09:23.692067 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:23.691722 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-8zzhv/progression-no-metrics-node-0-0-hvbfr" event={"ID":"fbbf6714-40bf-48ca-8ef5-ff8e7aa501ed","Type":"ContainerDied","Data":"aed4adc56543a1e40894ad46a76ce36e6c9da87fb5414002cf5f1a2adcd647e9"} Sep 08 11:09:24.827106 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:24.827077 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-8zzhv/progression-no-metrics-node-0-0-hvbfr" Sep 08 11:09:24.969332 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:24.969229 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ssbw6\" (UniqueName: \"kubernetes.io/projected/fbbf6714-40bf-48ca-8ef5-ff8e7aa501ed-kube-api-access-ssbw6\") pod \"fbbf6714-40bf-48ca-8ef5-ff8e7aa501ed\" (UID: \"fbbf6714-40bf-48ca-8ef5-ff8e7aa501ed\") " Sep 08 11:09:24.971463 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:24.971436 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbbf6714-40bf-48ca-8ef5-ff8e7aa501ed-kube-api-access-ssbw6" (OuterVolumeSpecName: "kube-api-access-ssbw6") pod "fbbf6714-40bf-48ca-8ef5-ff8e7aa501ed" (UID: "fbbf6714-40bf-48ca-8ef5-ff8e7aa501ed"). InnerVolumeSpecName "kube-api-access-ssbw6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 11:09:25.070266 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:25.070228 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssbw6\" (UniqueName: \"kubernetes.io/projected/fbbf6714-40bf-48ca-8ef5-ff8e7aa501ed-kube-api-access-ssbw6\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 11:09:25.702609 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:25.702580 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-8zzhv/progression-no-metrics-node-0-0-hvbfr" Sep 08 11:09:25.702787 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:25.702615 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-8zzhv/progression-no-metrics-node-0-0-hvbfr" event={"ID":"fbbf6714-40bf-48ca-8ef5-ff8e7aa501ed","Type":"ContainerDied","Data":"e87da5a74c72022af472af45fd3635c04a79099d4ea98a46ea7dd7078fcc700d"} Sep 08 11:09:25.702787 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:25.702661 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e87da5a74c72022af472af45fd3635c04a79099d4ea98a46ea7dd7078fcc700d" Sep 08 11:09:25.987417 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:25.987301 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:09:26.136763 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:26.136731 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w7mhx/must-gather-nxq5q"] Sep 08 11:09:26.137080 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:26.137068 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbbf6714-40bf-48ca-8ef5-ff8e7aa501ed" containerName="node" Sep 08 11:09:26.137143 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:26.137082 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbbf6714-40bf-48ca-8ef5-ff8e7aa501ed" containerName="node" Sep 08 11:09:26.137190 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:26.137146 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbbf6714-40bf-48ca-8ef5-ff8e7aa501ed" containerName="node" Sep 08 11:09:26.139196 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:26.139158 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w7mhx/must-gather-nxq5q" Sep 08 11:09:26.141854 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:26.141834 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-w7mhx\"/\"default-dockercfg-fls5z\"" Sep 08 11:09:26.142869 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:26.142850 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w7mhx\"/\"kube-root-ca.crt\"" Sep 08 11:09:26.142966 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:26.142866 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w7mhx\"/\"openshift-service-ca.crt\"" Sep 08 11:09:26.151811 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:26.151770 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w7mhx/must-gather-nxq5q"] Sep 08 11:09:26.151811 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:26.151774 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:09:26.250895 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:26.250792 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:09:26.282333 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:26.282294 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-css84\" (UniqueName: \"kubernetes.io/projected/d4287958-cc6c-4053-95b0-65daa9afcd7c-kube-api-access-css84\") pod \"must-gather-nxq5q\" (UID: \"d4287958-cc6c-4053-95b0-65daa9afcd7c\") " pod="openshift-must-gather-w7mhx/must-gather-nxq5q" Sep 08 11:09:26.282483 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:26.282345 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d4287958-cc6c-4053-95b0-65daa9afcd7c-must-gather-output\") pod \"must-gather-nxq5q\" (UID: \"d4287958-cc6c-4053-95b0-65daa9afcd7c\") " pod="openshift-must-gather-w7mhx/must-gather-nxq5q" Sep 08 11:09:26.383310 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:26.383274 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-css84\" (UniqueName: \"kubernetes.io/projected/d4287958-cc6c-4053-95b0-65daa9afcd7c-kube-api-access-css84\") pod \"must-gather-nxq5q\" (UID: \"d4287958-cc6c-4053-95b0-65daa9afcd7c\") " pod="openshift-must-gather-w7mhx/must-gather-nxq5q" Sep 08 11:09:26.383485 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:26.383324 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d4287958-cc6c-4053-95b0-65daa9afcd7c-must-gather-output\") pod \"must-gather-nxq5q\" (UID: \"d4287958-cc6c-4053-95b0-65daa9afcd7c\") " pod="openshift-must-gather-w7mhx/must-gather-nxq5q" Sep 08 11:09:26.383629 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:26.383614 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d4287958-cc6c-4053-95b0-65daa9afcd7c-must-gather-output\") pod \"must-gather-nxq5q\" (UID: \"d4287958-cc6c-4053-95b0-65daa9afcd7c\") " pod="openshift-must-gather-w7mhx/must-gather-nxq5q" Sep 08 11:09:26.393913 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:26.393878 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-css84\" (UniqueName: \"kubernetes.io/projected/d4287958-cc6c-4053-95b0-65daa9afcd7c-kube-api-access-css84\") pod \"must-gather-nxq5q\" (UID: \"d4287958-cc6c-4053-95b0-65daa9afcd7c\") " pod="openshift-must-gather-w7mhx/must-gather-nxq5q" Sep 08 11:09:26.448585 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:26.448539 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w7mhx/must-gather-nxq5q" Sep 08 11:09:26.732441 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:26.732318 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w7mhx/must-gather-nxq5q"] Sep 08 11:09:26.735269 ip-10-0-139-80 kubenswrapper[2560]: W0908 11:09:26.735240 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4287958_cc6c_4053_95b0_65daa9afcd7c.slice/crio-cfbd9c33181a58b51a1d5c3cc921724078cff63fa05fc8a4c2c97595c58c2f8f WatchSource:0}: Error finding container cfbd9c33181a58b51a1d5c3cc921724078cff63fa05fc8a4c2c97595c58c2f8f: Status 404 returned error can't find the container with id cfbd9c33181a58b51a1d5c3cc921724078cff63fa05fc8a4c2c97595c58c2f8f Sep 08 11:09:26.737154 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:26.737135 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 11:09:27.720194 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:27.720106 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w7mhx/must-gather-nxq5q" event={"ID":"d4287958-cc6c-4053-95b0-65daa9afcd7c","Type":"ContainerStarted","Data":"cfbd9c33181a58b51a1d5c3cc921724078cff63fa05fc8a4c2c97595c58c2f8f"} Sep 08 11:09:30.958389 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:30.958355 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-8zzhv/progression-custom-config-node-0-0-sgt5d"] Sep 08 11:09:30.962065 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:30.962032 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-8zzhv/progression-custom-config-node-0-0-sgt5d"] Sep 08 11:09:30.968934 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:30.968908 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-8zzhv/progression-disabled-node-0-0-sbjxh"] Sep 08 11:09:30.975462 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:30.975435 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-8zzhv/progression-disabled-node-0-0-sbjxh"] Sep 08 11:09:30.980382 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:30.980358 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-8zzhv/progression-enabled-node-0-0-c6zlv"] Sep 08 11:09:30.996965 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:30.996936 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-8zzhv/progression-enabled-node-0-0-c6zlv"] Sep 08 11:09:31.017676 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:31.017632 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-8zzhv/progression-no-metrics-node-0-0-hvbfr"] Sep 08 11:09:31.024026 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:31.023995 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-8zzhv/progression-no-metrics-node-0-0-hvbfr"] Sep 08 11:09:31.154701 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:31.154665 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:09:31.901747 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:31.901708 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01678a97-5d20-4fa2-9753-5b7a8e17ec6c" path="/var/lib/kubelet/pods/01678a97-5d20-4fa2-9753-5b7a8e17ec6c/volumes" Sep 08 11:09:31.902203 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:31.902184 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23b615bc-77dd-43cf-a3cb-6c550d21044d" path="/var/lib/kubelet/pods/23b615bc-77dd-43cf-a3cb-6c550d21044d/volumes" Sep 08 11:09:31.902615 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:31.902598 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89fe0c07-4219-4a4a-8e52-8c5fb17f1353" path="/var/lib/kubelet/pods/89fe0c07-4219-4a4a-8e52-8c5fb17f1353/volumes" Sep 08 11:09:31.902997 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:31.902983 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbbf6714-40bf-48ca-8ef5-ff8e7aa501ed" path="/var/lib/kubelet/pods/fbbf6714-40bf-48ca-8ef5-ff8e7aa501ed/volumes" Sep 08 11:09:33.757527 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:33.757491 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w7mhx/must-gather-nxq5q" event={"ID":"d4287958-cc6c-4053-95b0-65daa9afcd7c","Type":"ContainerStarted","Data":"a19dcf721599dc6d8b8894de18c07f93f66f140275d35268a970a732fc9b0914"} Sep 08 11:09:33.757997 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:33.757538 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w7mhx/must-gather-nxq5q" event={"ID":"d4287958-cc6c-4053-95b0-65daa9afcd7c","Type":"ContainerStarted","Data":"a5d06a961e9857c559bc2d84028e5bded6084cb87ec9d812c2e60bbcb3e64264"} Sep 08 11:09:33.777181 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:33.777107 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-w7mhx/must-gather-nxq5q" podStartSLOduration=1.547546454 podStartE2EDuration="7.7770894s" totalImagesPullingTime="6.229542946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:09:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:09:33.776709208 +0000 UTC m=+814.409304687" watchObservedRunningTime="2026-09-08 11:09:33.7770894 +0000 UTC m=+814.409684861" Sep 08 11:09:52.398559 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:52.398527 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:09:52.555316 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:52.555278 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:09:53.303590 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:09:53.303560 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:10:19.018207 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:19.018146 2560 generic.go:356] "Generic (PLEG): container finished" podID="d4287958-cc6c-4053-95b0-65daa9afcd7c" containerID="a5d06a961e9857c559bc2d84028e5bded6084cb87ec9d812c2e60bbcb3e64264" exitCode=0 Sep 08 11:10:19.018639 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:19.018219 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w7mhx/must-gather-nxq5q" event={"ID":"d4287958-cc6c-4053-95b0-65daa9afcd7c","Type":"ContainerDied","Data":"a5d06a961e9857c559bc2d84028e5bded6084cb87ec9d812c2e60bbcb3e64264"} Sep 08 11:10:19.018639 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:19.018551 2560 scope.go:117] "RemoveContainer" containerID="a5d06a961e9857c559bc2d84028e5bded6084cb87ec9d812c2e60bbcb3e64264" Sep 08 11:10:19.932142 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:19.932114 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-w7mhx_must-gather-nxq5q_d4287958-cc6c-4053-95b0-65daa9afcd7c/gather/0.log" Sep 08 11:10:21.570355 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:21.570326 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:10:21.671200 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:21.671143 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:10:23.357704 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:23.357670 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vtxs2_30463b34-4ef7-4a59-8b30-dd4b1199e7a6/global-pull-secret-syncer/0.log" Sep 08 11:10:23.401634 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:23.401604 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" Sep 08 11:10:23.538226 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:23.538193 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-80.ec2.internal_952015d437c3d0f0cd335c2b2dde7781/haproxy/0.log" Sep 08 11:10:25.260713 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:25.260681 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-w7mhx/must-gather-nxq5q"] Sep 08 11:10:25.261105 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:25.260863 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-w7mhx/must-gather-nxq5q" podUID="d4287958-cc6c-4053-95b0-65daa9afcd7c" containerName="copy" containerID="cri-o://a19dcf721599dc6d8b8894de18c07f93f66f140275d35268a970a732fc9b0914" gracePeriod=2 Sep 08 11:10:25.264159 ip-10-0-139-80 kubenswrapper[2560]: E0908 11:10:25.264112 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-nxq5q\" is forbidden: User \"system:node:ip-10-0-139-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-w7mhx\": no relationship found between node 'ip-10-0-139-80.ec2.internal' and this object" podUID="d4287958-cc6c-4053-95b0-65daa9afcd7c" pod="openshift-must-gather-w7mhx/must-gather-nxq5q" Sep 08 11:10:25.265256 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:25.264802 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-w7mhx/must-gather-nxq5q"] Sep 08 11:10:25.496259 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:25.496240 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-w7mhx_must-gather-nxq5q_d4287958-cc6c-4053-95b0-65daa9afcd7c/copy/0.log" Sep 08 11:10:25.498819 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:25.498802 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w7mhx/must-gather-nxq5q" Sep 08 11:10:25.501005 ip-10-0-139-80 kubenswrapper[2560]: E0908 11:10:25.500983 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-nxq5q\" is forbidden: User \"system:node:ip-10-0-139-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-w7mhx\": no relationship found between node 'ip-10-0-139-80.ec2.internal' and this object" podUID="d4287958-cc6c-4053-95b0-65daa9afcd7c" pod="openshift-must-gather-w7mhx/must-gather-nxq5q" Sep 08 11:10:25.533110 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:25.533032 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d4287958-cc6c-4053-95b0-65daa9afcd7c-must-gather-output\") pod \"d4287958-cc6c-4053-95b0-65daa9afcd7c\" (UID: \"d4287958-cc6c-4053-95b0-65daa9afcd7c\") " Sep 08 11:10:25.533110 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:25.533073 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-css84\" (UniqueName: \"kubernetes.io/projected/d4287958-cc6c-4053-95b0-65daa9afcd7c-kube-api-access-css84\") pod \"d4287958-cc6c-4053-95b0-65daa9afcd7c\" (UID: \"d4287958-cc6c-4053-95b0-65daa9afcd7c\") " Sep 08 11:10:25.534357 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:25.534331 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4287958-cc6c-4053-95b0-65daa9afcd7c-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "d4287958-cc6c-4053-95b0-65daa9afcd7c" (UID: "d4287958-cc6c-4053-95b0-65daa9afcd7c"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 11:10:25.535443 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:25.535422 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4287958-cc6c-4053-95b0-65daa9afcd7c-kube-api-access-css84" (OuterVolumeSpecName: "kube-api-access-css84") pod "d4287958-cc6c-4053-95b0-65daa9afcd7c" (UID: "d4287958-cc6c-4053-95b0-65daa9afcd7c"). InnerVolumeSpecName "kube-api-access-css84". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 11:10:25.634007 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:25.633969 2560 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d4287958-cc6c-4053-95b0-65daa9afcd7c-must-gather-output\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 11:10:25.634007 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:25.633998 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-css84\" (UniqueName: \"kubernetes.io/projected/d4287958-cc6c-4053-95b0-65daa9afcd7c-kube-api-access-css84\") on node \"ip-10-0-139-80.ec2.internal\" DevicePath \"\"" Sep 08 11:10:25.900718 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:25.900688 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4287958-cc6c-4053-95b0-65daa9afcd7c" path="/var/lib/kubelet/pods/d4287958-cc6c-4053-95b0-65daa9afcd7c/volumes" Sep 08 11:10:26.036631 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:26.036598 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:10:26.054641 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:26.054616 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-w7mhx_must-gather-nxq5q_d4287958-cc6c-4053-95b0-65daa9afcd7c/copy/0.log" Sep 08 11:10:26.054985 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:26.054962 2560 generic.go:356] "Generic (PLEG): container finished" podID="d4287958-cc6c-4053-95b0-65daa9afcd7c" containerID="a19dcf721599dc6d8b8894de18c07f93f66f140275d35268a970a732fc9b0914" exitCode=143 Sep 08 11:10:26.055063 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:26.055003 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w7mhx/must-gather-nxq5q" Sep 08 11:10:26.055063 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:26.055040 2560 scope.go:117] "RemoveContainer" containerID="a19dcf721599dc6d8b8894de18c07f93f66f140275d35268a970a732fc9b0914" Sep 08 11:10:26.063148 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:26.063132 2560 scope.go:117] "RemoveContainer" containerID="a5d06a961e9857c559bc2d84028e5bded6084cb87ec9d812c2e60bbcb3e64264" Sep 08 11:10:26.075878 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:26.075856 2560 scope.go:117] "RemoveContainer" containerID="a19dcf721599dc6d8b8894de18c07f93f66f140275d35268a970a732fc9b0914" Sep 08 11:10:26.076255 ip-10-0-139-80 kubenswrapper[2560]: E0908 11:10:26.076237 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a19dcf721599dc6d8b8894de18c07f93f66f140275d35268a970a732fc9b0914\": container with ID starting with a19dcf721599dc6d8b8894de18c07f93f66f140275d35268a970a732fc9b0914 not found: ID does not exist" containerID="a19dcf721599dc6d8b8894de18c07f93f66f140275d35268a970a732fc9b0914" Sep 08 11:10:26.076317 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:26.076266 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a19dcf721599dc6d8b8894de18c07f93f66f140275d35268a970a732fc9b0914"} err="failed to get container status \"a19dcf721599dc6d8b8894de18c07f93f66f140275d35268a970a732fc9b0914\": rpc error: code = NotFound desc = could not find container \"a19dcf721599dc6d8b8894de18c07f93f66f140275d35268a970a732fc9b0914\": container with ID starting with a19dcf721599dc6d8b8894de18c07f93f66f140275d35268a970a732fc9b0914 not found: ID does not exist" Sep 08 11:10:26.076317 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:26.076286 2560 scope.go:117] "RemoveContainer" containerID="a5d06a961e9857c559bc2d84028e5bded6084cb87ec9d812c2e60bbcb3e64264" Sep 08 11:10:26.076570 ip-10-0-139-80 kubenswrapper[2560]: E0908 11:10:26.076552 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5d06a961e9857c559bc2d84028e5bded6084cb87ec9d812c2e60bbcb3e64264\": container with ID starting with a5d06a961e9857c559bc2d84028e5bded6084cb87ec9d812c2e60bbcb3e64264 not found: ID does not exist" containerID="a5d06a961e9857c559bc2d84028e5bded6084cb87ec9d812c2e60bbcb3e64264" Sep 08 11:10:26.076615 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:26.076577 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5d06a961e9857c559bc2d84028e5bded6084cb87ec9d812c2e60bbcb3e64264"} err="failed to get container status \"a5d06a961e9857c559bc2d84028e5bded6084cb87ec9d812c2e60bbcb3e64264\": rpc error: code = NotFound desc = could not find container \"a5d06a961e9857c559bc2d84028e5bded6084cb87ec9d812c2e60bbcb3e64264\": container with ID starting with a5d06a961e9857c559bc2d84028e5bded6084cb87ec9d812c2e60bbcb3e64264 not found: ID does not exist" Sep 08 11:10:26.137656 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:26.137628 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjnqs_83286d64-d4e8-4548-8a35-e9fb3201c67e/konnectivity-agent/0.log" limit=1024 Sep 08 11:10:27.546856 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:27.546827 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_18e278cb-1945-4ba1-a2ca-9de9e0051def/alertmanager/0.log" Sep 08 11:10:27.573911 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:27.573884 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_18e278cb-1945-4ba1-a2ca-9de9e0051def/config-reloader/0.log" Sep 08 11:10:27.604519 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:27.604490 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_18e278cb-1945-4ba1-a2ca-9de9e0051def/kube-rbac-proxy-web/0.log" Sep 08 11:10:27.634794 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:27.634774 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_18e278cb-1945-4ba1-a2ca-9de9e0051def/kube-rbac-proxy/0.log" Sep 08 11:10:27.663292 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:27.663263 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_18e278cb-1945-4ba1-a2ca-9de9e0051def/kube-rbac-proxy-metric/0.log" Sep 08 11:10:27.690276 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:27.690255 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_18e278cb-1945-4ba1-a2ca-9de9e0051def/prom-label-proxy/0.log" Sep 08 11:10:27.719974 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:27.719943 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_18e278cb-1945-4ba1-a2ca-9de9e0051def/init-config-reloader/0.log" Sep 08 11:10:27.757376 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:27.757350 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-s4z4b_e149ccac-29e4-4805-9c68-36fdcdd8a649/cluster-monitoring-operator/0.log" Sep 08 11:10:27.792400 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:27.792369 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-l97qz_c3882461-2186-4fe5-851f-6cc5a04d7825/kube-state-metrics/0.log" Sep 08 11:10:27.819236 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:27.819145 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-l97qz_c3882461-2186-4fe5-851f-6cc5a04d7825/kube-rbac-proxy-main/0.log" Sep 08 11:10:27.840849 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:27.840824 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-l97qz_c3882461-2186-4fe5-851f-6cc5a04d7825/kube-rbac-proxy-self/0.log" Sep 08 11:10:28.122823 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:28.122801 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pvp4n_9621f8a4-0b41-438c-b45d-0e0d46cc0d6d/node-exporter/0.log" Sep 08 11:10:28.149930 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:28.149908 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pvp4n_9621f8a4-0b41-438c-b45d-0e0d46cc0d6d/kube-rbac-proxy/0.log" Sep 08 11:10:28.174842 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:28.174819 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pvp4n_9621f8a4-0b41-438c-b45d-0e0d46cc0d6d/init-textfile/0.log" Sep 08 11:10:28.231281 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:28.231254 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-8x767_ab4fc548-56fe-41f1-81e3-f0edefc94eed/kube-rbac-proxy-main/0.log" Sep 08 11:10:28.288225 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:28.288195 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-8x767_ab4fc548-56fe-41f1-81e3-f0edefc94eed/kube-rbac-proxy-self/0.log" Sep 08 11:10:28.323322 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:28.323293 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-8x767_ab4fc548-56fe-41f1-81e3-f0edefc94eed/openshift-state-metrics/0.log" Sep 08 11:10:28.362919 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:28.362832 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_956423cc-9f55-4496-9c06-2b2de8de25f3/prometheus/0.log" Sep 08 11:10:28.398573 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:28.398544 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_956423cc-9f55-4496-9c06-2b2de8de25f3/config-reloader/0.log" Sep 08 11:10:28.424994 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:28.424965 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_956423cc-9f55-4496-9c06-2b2de8de25f3/thanos-sidecar/0.log" Sep 08 11:10:28.466755 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:28.466730 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_956423cc-9f55-4496-9c06-2b2de8de25f3/kube-rbac-proxy-web/0.log" Sep 08 11:10:28.500604 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:28.500554 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_956423cc-9f55-4496-9c06-2b2de8de25f3/kube-rbac-proxy/0.log" Sep 08 11:10:28.528117 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:28.528089 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_956423cc-9f55-4496-9c06-2b2de8de25f3/kube-rbac-proxy-thanos/0.log" Sep 08 11:10:28.558272 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:28.558241 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_956423cc-9f55-4496-9c06-2b2de8de25f3/init-config-reloader/0.log" Sep 08 11:10:28.815557 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:28.815526 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b765d77d5-9svtb_5a16da84-2c59-40b5-81ba-c1cccca048cf/thanos-query/0.log" Sep 08 11:10:28.837635 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:28.837611 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b765d77d5-9svtb_5a16da84-2c59-40b5-81ba-c1cccca048cf/kube-rbac-proxy-web/0.log" Sep 08 11:10:28.864277 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:28.864253 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b765d77d5-9svtb_5a16da84-2c59-40b5-81ba-c1cccca048cf/kube-rbac-proxy/0.log" Sep 08 11:10:28.890770 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:28.890673 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b765d77d5-9svtb_5a16da84-2c59-40b5-81ba-c1cccca048cf/prom-label-proxy/0.log" Sep 08 11:10:28.914458 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:28.914434 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b765d77d5-9svtb_5a16da84-2c59-40b5-81ba-c1cccca048cf/kube-rbac-proxy-rules/0.log" Sep 08 11:10:28.938396 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:28.938365 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b765d77d5-9svtb_5a16da84-2c59-40b5-81ba-c1cccca048cf/kube-rbac-proxy-metrics/0.log" Sep 08 11:10:30.487914 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:30.487887 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f285w_80be3338-ebb8-4dd1-8545-0fcdf56b9ef3/console-operator/1.log" Sep 08 11:10:30.493961 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:30.493941 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-f285w_80be3338-ebb8-4dd1-8545-0fcdf56b9ef3/console-operator/2.log" Sep 08 11:10:30.589300 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:30.589269 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dkg4w/perf-node-gather-daemonset-wpx7n"] Sep 08 11:10:30.589615 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:30.589603 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4287958-cc6c-4053-95b0-65daa9afcd7c" containerName="copy" Sep 08 11:10:30.589659 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:30.589616 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4287958-cc6c-4053-95b0-65daa9afcd7c" containerName="copy" Sep 08 11:10:30.589659 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:30.589640 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4287958-cc6c-4053-95b0-65daa9afcd7c" containerName="gather" Sep 08 11:10:30.589659 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:30.589645 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4287958-cc6c-4053-95b0-65daa9afcd7c" containerName="gather" Sep 08 11:10:30.589757 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:30.589694 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4287958-cc6c-4053-95b0-65daa9afcd7c" containerName="gather" Sep 08 11:10:30.589757 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:30.589705 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4287958-cc6c-4053-95b0-65daa9afcd7c" containerName="copy" Sep 08 11:10:30.594721 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:30.594700 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dkg4w/perf-node-gather-daemonset-wpx7n" Sep 08 11:10:30.597562 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:30.597541 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dkg4w\"/\"default-dockercfg-qz7tv\"" Sep 08 11:10:30.597713 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:30.597577 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dkg4w\"/\"kube-root-ca.crt\"" Sep 08 11:10:30.598598 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:30.598581 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dkg4w\"/\"openshift-service-ca.crt\"" Sep 08 11:10:30.606100 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:30.606077 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dkg4w/perf-node-gather-daemonset-wpx7n"] Sep 08 11:10:30.681855 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:30.681812 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/452175a1-9231-41b5-a9bb-074ef7e38bb1-lib-modules\") pod \"perf-node-gather-daemonset-wpx7n\" (UID: \"452175a1-9231-41b5-a9bb-074ef7e38bb1\") " pod="openshift-must-gather-dkg4w/perf-node-gather-daemonset-wpx7n" Sep 08 11:10:30.682055 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:30.681878 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/452175a1-9231-41b5-a9bb-074ef7e38bb1-sys\") pod \"perf-node-gather-daemonset-wpx7n\" (UID: \"452175a1-9231-41b5-a9bb-074ef7e38bb1\") " pod="openshift-must-gather-dkg4w/perf-node-gather-daemonset-wpx7n" Sep 08 11:10:30.682055 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:30.681898 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/452175a1-9231-41b5-a9bb-074ef7e38bb1-podres\") pod \"perf-node-gather-daemonset-wpx7n\" (UID: \"452175a1-9231-41b5-a9bb-074ef7e38bb1\") " pod="openshift-must-gather-dkg4w/perf-node-gather-daemonset-wpx7n" Sep 08 11:10:30.682055 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:30.681978 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/452175a1-9231-41b5-a9bb-074ef7e38bb1-proc\") pod \"perf-node-gather-daemonset-wpx7n\" (UID: \"452175a1-9231-41b5-a9bb-074ef7e38bb1\") " pod="openshift-must-gather-dkg4w/perf-node-gather-daemonset-wpx7n" Sep 08 11:10:30.682055 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:30.682022 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2rdf\" (UniqueName: \"kubernetes.io/projected/452175a1-9231-41b5-a9bb-074ef7e38bb1-kube-api-access-w2rdf\") pod \"perf-node-gather-daemonset-wpx7n\" (UID: \"452175a1-9231-41b5-a9bb-074ef7e38bb1\") " pod="openshift-must-gather-dkg4w/perf-node-gather-daemonset-wpx7n" Sep 08 11:10:30.783102 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:30.783008 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2rdf\" (UniqueName: \"kubernetes.io/projected/452175a1-9231-41b5-a9bb-074ef7e38bb1-kube-api-access-w2rdf\") pod \"perf-node-gather-daemonset-wpx7n\" (UID: \"452175a1-9231-41b5-a9bb-074ef7e38bb1\") " pod="openshift-must-gather-dkg4w/perf-node-gather-daemonset-wpx7n" Sep 08 11:10:30.783102 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:30.783070 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/452175a1-9231-41b5-a9bb-074ef7e38bb1-lib-modules\") pod \"perf-node-gather-daemonset-wpx7n\" (UID: \"452175a1-9231-41b5-a9bb-074ef7e38bb1\") " pod="openshift-must-gather-dkg4w/perf-node-gather-daemonset-wpx7n" Sep 08 11:10:30.783342 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:30.783126 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/452175a1-9231-41b5-a9bb-074ef7e38bb1-sys\") pod \"perf-node-gather-daemonset-wpx7n\" (UID: \"452175a1-9231-41b5-a9bb-074ef7e38bb1\") " pod="openshift-must-gather-dkg4w/perf-node-gather-daemonset-wpx7n" Sep 08 11:10:30.783342 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:30.783146 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/452175a1-9231-41b5-a9bb-074ef7e38bb1-podres\") pod \"perf-node-gather-daemonset-wpx7n\" (UID: \"452175a1-9231-41b5-a9bb-074ef7e38bb1\") " pod="openshift-must-gather-dkg4w/perf-node-gather-daemonset-wpx7n" Sep 08 11:10:30.783342 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:30.783247 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/452175a1-9231-41b5-a9bb-074ef7e38bb1-proc\") pod \"perf-node-gather-daemonset-wpx7n\" (UID: \"452175a1-9231-41b5-a9bb-074ef7e38bb1\") " pod="openshift-must-gather-dkg4w/perf-node-gather-daemonset-wpx7n" Sep 08 11:10:30.783342 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:30.783271 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/452175a1-9231-41b5-a9bb-074ef7e38bb1-podres\") pod \"perf-node-gather-daemonset-wpx7n\" (UID: \"452175a1-9231-41b5-a9bb-074ef7e38bb1\") " pod="openshift-must-gather-dkg4w/perf-node-gather-daemonset-wpx7n" Sep 08 11:10:30.783342 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:30.783292 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/452175a1-9231-41b5-a9bb-074ef7e38bb1-proc\") pod \"perf-node-gather-daemonset-wpx7n\" (UID: \"452175a1-9231-41b5-a9bb-074ef7e38bb1\") " pod="openshift-must-gather-dkg4w/perf-node-gather-daemonset-wpx7n" Sep 08 11:10:30.783342 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:30.783292 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/452175a1-9231-41b5-a9bb-074ef7e38bb1-lib-modules\") pod \"perf-node-gather-daemonset-wpx7n\" (UID: \"452175a1-9231-41b5-a9bb-074ef7e38bb1\") " pod="openshift-must-gather-dkg4w/perf-node-gather-daemonset-wpx7n" Sep 08 11:10:30.783342 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:30.783251 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/452175a1-9231-41b5-a9bb-074ef7e38bb1-sys\") pod \"perf-node-gather-daemonset-wpx7n\" (UID: \"452175a1-9231-41b5-a9bb-074ef7e38bb1\") " pod="openshift-must-gather-dkg4w/perf-node-gather-daemonset-wpx7n" Sep 08 11:10:30.792764 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:30.792739 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2rdf\" (UniqueName: \"kubernetes.io/projected/452175a1-9231-41b5-a9bb-074ef7e38bb1-kube-api-access-w2rdf\") pod \"perf-node-gather-daemonset-wpx7n\" (UID: \"452175a1-9231-41b5-a9bb-074ef7e38bb1\") " pod="openshift-must-gather-dkg4w/perf-node-gather-daemonset-wpx7n" Sep 08 11:10:30.904434 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:30.904388 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dkg4w/perf-node-gather-daemonset-wpx7n" Sep 08 11:10:31.177923 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:31.177878 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dkg4w/perf-node-gather-daemonset-wpx7n"] Sep 08 11:10:31.181045 ip-10-0-139-80 kubenswrapper[2560]: W0908 11:10:31.181019 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod452175a1_9231_41b5_a9bb_074ef7e38bb1.slice/crio-93259f4448d8a109876fe7b8aee04f33ee7f8b54c9f7e140db10a2d5f55fd647 WatchSource:0}: Error finding container 93259f4448d8a109876fe7b8aee04f33ee7f8b54c9f7e140db10a2d5f55fd647: Status 404 returned error can't find the container with id 93259f4448d8a109876fe7b8aee04f33ee7f8b54c9f7e140db10a2d5f55fd647 Sep 08 11:10:31.491621 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:31.491540 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-q6mzn_5c8bcb6a-6008-4e01-8647-ad956f48a346/volume-data-source-validator/0.log" Sep 08 11:10:32.097008 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:32.096965 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dkg4w/perf-node-gather-daemonset-wpx7n" event={"ID":"452175a1-9231-41b5-a9bb-074ef7e38bb1","Type":"ContainerStarted","Data":"e5eec305b2aa852b44653e13311ac48b0c15b71415c9cb4b3dc6b9d0f39b33aa"} Sep 08 11:10:32.097241 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:32.097023 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dkg4w/perf-node-gather-daemonset-wpx7n" event={"ID":"452175a1-9231-41b5-a9bb-074ef7e38bb1","Type":"ContainerStarted","Data":"93259f4448d8a109876fe7b8aee04f33ee7f8b54c9f7e140db10a2d5f55fd647"} Sep 08 11:10:32.097241 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:32.097089 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dkg4w/perf-node-gather-daemonset-wpx7n" Sep 08 11:10:32.130632 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:32.130586 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dkg4w/perf-node-gather-daemonset-wpx7n" podStartSLOduration=2.1305680750000002 podStartE2EDuration="2.130568075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 11:10:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:10:32.130422575 +0000 UTC m=+872.763018137" watchObservedRunningTime="2026-09-08 11:10:32.130568075 +0000 UTC m=+872.763163575" Sep 08 11:10:32.364410 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:32.364320 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zs2dr_a72bab02-fa2c-499a-81be-8bf56c3db578/dns/0.log" Sep 08 11:10:32.387977 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:32.387953 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zs2dr_a72bab02-fa2c-499a-81be-8bf56c3db578/kube-rbac-proxy/0.log" Sep 08 11:10:32.470618 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:32.470586 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wfrtm_984def62-1940-433d-83c1-b241c0f5cfa5/dns-node-resolver/0.log" Sep 08 11:10:32.868787 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:32.868764 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-84c5985848-9rztx_db7580a8-8378-4b83-9160-855661f06a07/registry/0.log" Sep 08 11:10:32.946905 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:32.946880 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wx4r8_eb5352bc-dbdc-4c6c-a20a-62c87a1e446f/node-ca/0.log" Sep 08 11:10:34.111042 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:34.111006 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xm8x2_8317d8ea-1acd-4ad7-870b-7eb5476f4151/serve-healthcheck-canary/0.log" Sep 08 11:10:34.510662 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:34.510581 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8tnt6_efaaf88d-bd00-40fe-830b-98c162d9972f/kube-rbac-proxy/0.log" Sep 08 11:10:34.534352 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:34.534326 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8tnt6_efaaf88d-bd00-40fe-830b-98c162d9972f/exporter/0.log" Sep 08 11:10:34.558925 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:34.558897 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8tnt6_efaaf88d-bd00-40fe-830b-98c162d9972f/extractor/0.log" Sep 08 11:10:38.111613 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:38.111585 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dkg4w/perf-node-gather-daemonset-wpx7n" Sep 08 11:10:40.115986 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:40.115909 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-dmjqr_02e5b88d-b3d5-4bd8-a6d0-c4c4e4fb4c95/migrator/0.log" Sep 08 11:10:40.149571 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:40.149538 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-dmjqr_02e5b88d-b3d5-4bd8-a6d0-c4c4e4fb4c95/graceful-termination/0.log" Sep 08 11:10:41.523624 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:41.523587 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6sb6d_2d558595-1fcc-4bb3-b6a1-9cca8f1f3ab9/kube-multus/0.log" Sep 08 11:10:42.003494 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:42.003424 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zzppw_f6a86c3a-a256-4e5a-aaa8-737dee4e9147/kube-multus-additional-cni-plugins/0.log" Sep 08 11:10:42.028153 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:42.028124 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zzppw_f6a86c3a-a256-4e5a-aaa8-737dee4e9147/egress-router-binary-copy/0.log" Sep 08 11:10:42.049481 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:42.049449 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zzppw_f6a86c3a-a256-4e5a-aaa8-737dee4e9147/cni-plugins/0.log" Sep 08 11:10:42.072428 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:42.072402 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zzppw_f6a86c3a-a256-4e5a-aaa8-737dee4e9147/bond-cni-plugin/0.log" Sep 08 11:10:42.096931 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:42.096900 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zzppw_f6a86c3a-a256-4e5a-aaa8-737dee4e9147/routeoverride-cni/0.log" Sep 08 11:10:42.120498 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:42.120472 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zzppw_f6a86c3a-a256-4e5a-aaa8-737dee4e9147/whereabouts-cni-bincopy/0.log" Sep 08 11:10:42.143558 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:42.143529 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zzppw_f6a86c3a-a256-4e5a-aaa8-737dee4e9147/whereabouts-cni/0.log" Sep 08 11:10:42.231502 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:42.231475 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-msdpf_dc69f433-ba6d-4fd6-ad22-29d26782f11d/network-metrics-daemon/0.log" Sep 08 11:10:42.254955 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:42.254883 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-msdpf_dc69f433-ba6d-4fd6-ad22-29d26782f11d/kube-rbac-proxy/0.log" Sep 08 11:10:43.038235 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:43.038209 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2fn2c_6437c1e3-5290-4262-815a-b5b88425796d/ovn-controller/0.log" Sep 08 11:10:43.063281 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:43.063254 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2fn2c_6437c1e3-5290-4262-815a-b5b88425796d/ovn-acl-logging/0.log" Sep 08 11:10:43.089921 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:43.089889 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2fn2c_6437c1e3-5290-4262-815a-b5b88425796d/kube-rbac-proxy-node/0.log" Sep 08 11:10:43.124877 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:43.124846 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2fn2c_6437c1e3-5290-4262-815a-b5b88425796d/kube-rbac-proxy-ovn-metrics/0.log" Sep 08 11:10:43.149028 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:43.149005 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2fn2c_6437c1e3-5290-4262-815a-b5b88425796d/northd/0.log" Sep 08 11:10:43.174470 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:43.174443 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2fn2c_6437c1e3-5290-4262-815a-b5b88425796d/nbdb/0.log" Sep 08 11:10:43.205218 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:43.205193 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2fn2c_6437c1e3-5290-4262-815a-b5b88425796d/sbdb/0.log" Sep 08 11:10:43.244700 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:43.244664 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2fn2c_6437c1e3-5290-4262-815a-b5b88425796d/ovnkube-controller/0.log" Sep 08 11:10:44.768264 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:44.768226 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-685456655f-h8954_dbb4fbf0-e68e-4657-bcc1-76eaa1ed729b/check-endpoints/0.log" Sep 08 11:10:44.794880 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:44.794853 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-pdd9x_bd67d177-bc24-48be-acca-e3cd070e193e/network-check-target-container/0.log" Sep 08 11:10:45.773663 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:45.773633 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-lbdsq_090c52f2-8dd6-471d-8dd0-96b288d6aec7/iptables-alerter/0.log" Sep 08 11:10:46.512190 ip-10-0-139-80 kubenswrapper[2560]: I0908 11:10:46.512079 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-pj5pz_c3655b0c-f997-41c9-9dea-43e50b077382/tuned/0.log"