Jun 09 20:51:33.959218 ip-10-0-137-98 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 09 20:51:33.959364 ip-10-0-137-98 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 09 20:51:33.959496 ip-10-0-137-98 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 09 20:51:33.959828 ip-10-0-137-98 systemd[1]: Failed to start Kubernetes Kubelet. Jun 09 20:51:44.111848 ip-10-0-137-98 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 09 20:51:44.111870 ip-10-0-137-98 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 37cb97f3910c4b1b8a4253664891818e -- Jun 09 20:54:07.530745 ip-10-0-137-98 systemd[1]: Starting Kubernetes Kubelet... Jun 09 20:54:07.996681 ip-10-0-137-98 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 20:54:07.996681 ip-10-0-137-98 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 20:54:07.996681 ip-10-0-137-98 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 20:54:07.996681 ip-10-0-137-98 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 20:54:07.996681 ip-10-0-137-98 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 20:54:07.997650 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:07.997556 2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 20:54:08.001723 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001702 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 20:54:08.001723 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001724 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 20:54:08.001797 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001728 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 20:54:08.001797 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001732 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 20:54:08.001797 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001735 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 20:54:08.001797 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001738 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 20:54:08.001797 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001742 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 20:54:08.001797 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001745 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 20:54:08.001797 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001748 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 20:54:08.001797 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001751 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 20:54:08.001797 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001754 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 20:54:08.001797 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001757 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 20:54:08.001797 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001759 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 20:54:08.001797 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001762 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 20:54:08.001797 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001764 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 20:54:08.001797 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001767 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 20:54:08.001797 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001769 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 20:54:08.001797 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001772 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 20:54:08.001797 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001775 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 20:54:08.001797 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001777 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 20:54:08.001797 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001784 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 20:54:08.002240 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001786 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 20:54:08.002240 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001789 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 20:54:08.002240 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001792 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 20:54:08.002240 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001794 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 20:54:08.002240 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001796 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 20:54:08.002240 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001799 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 20:54:08.002240 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001802 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 20:54:08.002240 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001804 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 20:54:08.002240 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001807 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 20:54:08.002240 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001810 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 20:54:08.002240 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001812 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 20:54:08.002240 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001815 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 20:54:08.002240 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001818 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 20:54:08.002240 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001820 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 20:54:08.002240 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001823 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 20:54:08.002240 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001825 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 20:54:08.002240 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001828 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 20:54:08.002240 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001830 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 20:54:08.002240 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001832 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 20:54:08.002240 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001835 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 20:54:08.002769 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001837 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 20:54:08.002769 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001840 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 20:54:08.002769 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001842 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 20:54:08.002769 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001844 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 20:54:08.002769 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001847 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 20:54:08.002769 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001849 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 20:54:08.002769 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001852 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 20:54:08.002769 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001854 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 20:54:08.002769 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001857 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 20:54:08.002769 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001859 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 20:54:08.002769 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001862 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 20:54:08.002769 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001864 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 20:54:08.002769 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001867 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 20:54:08.002769 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001870 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 20:54:08.002769 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001873 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 20:54:08.002769 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001875 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 20:54:08.002769 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001878 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 20:54:08.002769 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001880 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 20:54:08.002769 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001883 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 20:54:08.002769 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001886 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 20:54:08.003251 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001888 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 20:54:08.003251 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001891 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 20:54:08.003251 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001894 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 20:54:08.003251 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001898 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 20:54:08.003251 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001902 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 20:54:08.003251 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001905 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 20:54:08.003251 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001908 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 20:54:08.003251 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001911 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 20:54:08.003251 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001913 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 20:54:08.003251 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001917 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 20:54:08.003251 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001920 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 20:54:08.003251 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001922 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 20:54:08.003251 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001925 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 20:54:08.003251 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001927 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 20:54:08.003251 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001930 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 20:54:08.003251 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001932 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 20:54:08.003251 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001937 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 20:54:08.003251 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001941 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 20:54:08.003251 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001945 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 20:54:08.003734 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001948 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 20:54:08.003734 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001950 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 20:54:08.003734 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001953 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 20:54:08.003734 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001955 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 20:54:08.003734 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001958 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 20:54:08.003734 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001961 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 20:54:08.003734 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001964 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 20:54:08.003734 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001967 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 09 20:54:08.003734 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001970 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 20:54:08.003734 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001973 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 20:54:08.003734 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001976 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 20:54:08.003734 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001979 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 20:54:08.003734 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001981 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 20:54:08.003734 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001984 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 20:54:08.003734 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001986 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 20:54:08.003734 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001989 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 20:54:08.003734 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001992 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 20:54:08.003734 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001994 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 20:54:08.003734 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.001997 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 20:54:08.003734 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003684 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 20:54:08.004299 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003692 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 20:54:08.004299 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003696 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 20:54:08.004299 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003699 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 20:54:08.004299 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003702 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 20:54:08.004299 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003711 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 20:54:08.004299 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003714 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 20:54:08.004299 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003717 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 20:54:08.004299 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003720 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 20:54:08.004299 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003723 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 20:54:08.004299 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003726 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 20:54:08.004299 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003729 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 20:54:08.004299 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003732 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 20:54:08.004299 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003735 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 20:54:08.004299 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003738 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 20:54:08.004299 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003741 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 20:54:08.004299 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003743 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 20:54:08.004299 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003746 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 20:54:08.004299 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003749 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 20:54:08.004299 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003752 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 20:54:08.004299 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003754 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 20:54:08.004817 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003758 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 20:54:08.004817 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003762 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 20:54:08.004817 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003765 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 20:54:08.004817 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003767 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 20:54:08.004817 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003770 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 20:54:08.004817 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003772 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 20:54:08.004817 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003774 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 20:54:08.004817 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003777 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 20:54:08.004817 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003779 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 20:54:08.004817 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003782 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 20:54:08.004817 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003784 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 20:54:08.004817 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003787 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 20:54:08.004817 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003789 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 20:54:08.004817 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003793 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 20:54:08.004817 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003796 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 20:54:08.004817 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003798 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 20:54:08.004817 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003801 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 20:54:08.004817 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003804 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 20:54:08.004817 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003807 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 20:54:08.004817 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003809 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 20:54:08.005306 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003812 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 20:54:08.005306 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003814 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 20:54:08.005306 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003816 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 20:54:08.005306 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003819 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 20:54:08.005306 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003823 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 20:54:08.005306 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003826 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 20:54:08.005306 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003829 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 20:54:08.005306 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003832 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 20:54:08.005306 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003834 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 20:54:08.005306 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003837 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 09 20:54:08.005306 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003841 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 20:54:08.005306 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003844 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 20:54:08.005306 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003847 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 20:54:08.005306 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003849 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 20:54:08.005306 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003852 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 20:54:08.005306 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003855 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 20:54:08.005306 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003857 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 20:54:08.005306 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003860 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 20:54:08.005306 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003863 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 20:54:08.005779 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003865 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 20:54:08.005779 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003868 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 20:54:08.005779 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003870 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 20:54:08.005779 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003873 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 20:54:08.005779 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003875 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 20:54:08.005779 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003878 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 20:54:08.005779 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003881 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 20:54:08.005779 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003884 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 20:54:08.005779 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003887 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 20:54:08.005779 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003889 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 20:54:08.005779 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003894 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 20:54:08.005779 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003898 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 20:54:08.005779 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003901 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 20:54:08.005779 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003904 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 20:54:08.005779 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003907 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 20:54:08.005779 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003911 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 20:54:08.005779 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003913 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 20:54:08.005779 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003916 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 20:54:08.005779 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003919 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 20:54:08.006239 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003921 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 20:54:08.006239 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003924 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 20:54:08.006239 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003926 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 20:54:08.006239 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003928 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 20:54:08.006239 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003931 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 20:54:08.006239 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003933 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 20:54:08.006239 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003936 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 20:54:08.006239 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003938 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 20:54:08.006239 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003940 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 20:54:08.006239 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003943 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 20:54:08.006239 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003946 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 20:54:08.006239 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003948 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 20:54:08.006239 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003951 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 20:54:08.006239 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003953 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 20:54:08.006239 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003956 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 20:54:08.006239 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003958 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 20:54:08.006239 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003961 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 20:54:08.006239 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003964 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 20:54:08.006239 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003966 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 20:54:08.006239 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.003971 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 20:54:08.006763 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004364 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 20:54:08.006763 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004369 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 20:54:08.006763 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004389 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 20:54:08.006763 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004391 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 20:54:08.006763 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004395 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 20:54:08.006763 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004397 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 20:54:08.006763 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004400 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 20:54:08.006763 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004403 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 20:54:08.006763 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004405 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 20:54:08.006763 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004408 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 20:54:08.006763 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004411 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 20:54:08.006763 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004414 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 20:54:08.006763 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004416 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 20:54:08.006763 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004419 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 20:54:08.006763 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004422 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 20:54:08.006763 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004424 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 20:54:08.006763 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004427 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 20:54:08.006763 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004429 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 20:54:08.006763 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004432 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 20:54:08.007228 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004435 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 20:54:08.007228 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004437 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 20:54:08.007228 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004440 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 20:54:08.007228 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004442 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 20:54:08.007228 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004445 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 20:54:08.007228 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004448 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 20:54:08.007228 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004451 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 20:54:08.007228 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004454 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 20:54:08.007228 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004457 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 20:54:08.007228 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004459 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 20:54:08.007228 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004462 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 20:54:08.007228 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004465 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 20:54:08.007228 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004468 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 20:54:08.007228 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004471 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 20:54:08.007228 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004473 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 20:54:08.007228 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004476 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 20:54:08.007228 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004478 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 20:54:08.007228 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004480 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 20:54:08.007228 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004483 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 20:54:08.007228 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004486 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 20:54:08.007768 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004488 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 20:54:08.007768 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004491 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 20:54:08.007768 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004493 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 20:54:08.007768 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004498 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 20:54:08.007768 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004501 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 20:54:08.007768 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004504 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 20:54:08.007768 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004507 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 20:54:08.007768 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004510 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 20:54:08.007768 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004513 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 20:54:08.007768 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004516 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 20:54:08.007768 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004519 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 20:54:08.007768 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004521 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 20:54:08.007768 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004524 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 20:54:08.007768 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004527 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 20:54:08.007768 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004529 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 20:54:08.007768 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004532 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 20:54:08.007768 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004534 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 20:54:08.007768 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004537 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 09 20:54:08.007768 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004539 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 20:54:08.008223 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004542 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 20:54:08.008223 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004544 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 20:54:08.008223 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004546 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 20:54:08.008223 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004549 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 20:54:08.008223 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004551 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 20:54:08.008223 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004554 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 20:54:08.008223 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004556 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 20:54:08.008223 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004559 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 20:54:08.008223 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004561 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 20:54:08.008223 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004564 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 20:54:08.008223 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004566 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 20:54:08.008223 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004569 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 20:54:08.008223 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004572 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 20:54:08.008223 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004574 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 20:54:08.008223 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004577 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 20:54:08.008223 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004579 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 20:54:08.008223 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004584 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 20:54:08.008223 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004587 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 20:54:08.008223 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004590 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 20:54:08.008223 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004592 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 20:54:08.008718 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004595 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 20:54:08.008718 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004598 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 20:54:08.008718 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004600 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 20:54:08.008718 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004603 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 20:54:08.008718 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004605 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 20:54:08.008718 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004608 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 20:54:08.008718 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004610 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 20:54:08.008718 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004613 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 20:54:08.008718 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004615 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 20:54:08.008718 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004618 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 20:54:08.008718 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004622 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 20:54:08.008718 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004625 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 20:54:08.008718 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004628 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 20:54:08.008718 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004631 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 20:54:08.008718 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004633 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 20:54:08.008718 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004635 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 20:54:08.008718 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004638 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 20:54:08.008718 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004640 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 20:54:08.008718 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004643 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 20:54:08.009210 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004646 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 20:54:08.009210 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.004648 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 20:54:08.009210 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004729 2557 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 20:54:08.009210 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004737 2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 20:54:08.009210 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004743 2557 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 20:54:08.009210 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004748 2557 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 20:54:08.009210 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004752 2557 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 20:54:08.009210 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004756 2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 20:54:08.009210 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004760 2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 20:54:08.009210 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004765 2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 20:54:08.009210 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004768 2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 20:54:08.009210 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004771 2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 20:54:08.009210 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004774 2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 20:54:08.009210 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004777 2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 20:54:08.009210 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004781 2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 20:54:08.009210 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004784 2557 flags.go:64] FLAG: --cgroup-root="" Jun 09 20:54:08.009210 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004787 2557 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 20:54:08.009210 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004790 2557 flags.go:64] FLAG: --client-ca-file="" Jun 09 20:54:08.009210 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004793 2557 flags.go:64] FLAG: --cloud-provider="external" Jun 09 20:54:08.009210 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004804 2557 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 20:54:08.009210 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004809 2557 flags.go:64] FLAG: --cluster-domain="" Jun 09 20:54:08.009210 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004812 2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 20:54:08.009210 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004816 2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 20:54:08.009210 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004819 2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 20:54:08.009805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004823 2557 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 20:54:08.009805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004827 2557 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 20:54:08.009805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004830 2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 20:54:08.009805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004833 2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 20:54:08.009805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004836 2557 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 20:54:08.009805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004840 2557 flags.go:64] FLAG: --contention-profiling="false" Jun 09 20:54:08.009805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004843 2557 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 20:54:08.009805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004846 2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 20:54:08.009805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004849 2557 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 20:54:08.009805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004852 2557 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 20:54:08.009805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004856 2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 20:54:08.009805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004859 2557 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 20:54:08.009805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004862 2557 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 20:54:08.009805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004865 2557 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 20:54:08.009805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004868 2557 flags.go:64] FLAG: --enable-server="true" Jun 09 20:54:08.009805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004871 2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 20:54:08.009805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004875 2557 flags.go:64] FLAG: --event-burst="100" Jun 09 20:54:08.009805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004878 2557 flags.go:64] FLAG: --event-qps="50" Jun 09 20:54:08.009805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004881 2557 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 20:54:08.009805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004884 2557 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 20:54:08.009805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004887 2557 flags.go:64] FLAG: --eviction-hard="" Jun 09 20:54:08.009805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004891 2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 20:54:08.009805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004898 2557 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 20:54:08.009805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004901 2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 20:54:08.009805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004904 2557 flags.go:64] FLAG: --eviction-soft="" Jun 09 20:54:08.010447 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004907 2557 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 20:54:08.010447 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004910 2557 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 20:54:08.010447 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004914 2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 20:54:08.010447 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004917 2557 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 20:54:08.010447 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004919 2557 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 20:54:08.010447 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004922 2557 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 20:54:08.010447 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004925 2557 flags.go:64] FLAG: --feature-gates="" Jun 09 20:54:08.010447 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004929 2557 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 20:54:08.010447 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004932 2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 20:54:08.010447 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004935 2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 20:54:08.010447 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004938 2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 20:54:08.010447 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004941 2557 flags.go:64] FLAG: --healthz-port="10248" Jun 09 20:54:08.010447 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004944 2557 flags.go:64] FLAG: --help="false" Jun 09 20:54:08.010447 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004948 2557 flags.go:64] FLAG: --hostname-override="ip-10-0-137-98.ec2.internal" Jun 09 20:54:08.010447 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004951 2557 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 20:54:08.010447 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004954 2557 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 20:54:08.010447 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004957 2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 20:54:08.010447 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004960 2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 20:54:08.010447 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004964 2557 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 20:54:08.010447 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004967 2557 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 20:54:08.010447 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004970 2557 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 20:54:08.010447 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004973 2557 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 20:54:08.010447 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004975 2557 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 20:54:08.011028 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004979 2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 20:54:08.011028 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004982 2557 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 20:54:08.011028 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004985 2557 flags.go:64] FLAG: --kube-reserved="" Jun 09 20:54:08.011028 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004988 2557 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 20:54:08.011028 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004991 2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 20:54:08.011028 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004994 2557 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 20:54:08.011028 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.004998 2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 20:54:08.011028 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005001 2557 flags.go:64] FLAG: --lock-file="" Jun 09 20:54:08.011028 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005004 2557 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 20:54:08.011028 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005006 2557 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 20:54:08.011028 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005009 2557 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 20:54:08.011028 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005015 2557 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 20:54:08.011028 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005018 2557 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 20:54:08.011028 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005020 2557 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 20:54:08.011028 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005024 2557 flags.go:64] FLAG: --logging-format="text" Jun 09 20:54:08.011028 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005026 2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 20:54:08.011028 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005030 2557 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 20:54:08.011028 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005032 2557 flags.go:64] FLAG: --manifest-url="" Jun 09 20:54:08.011028 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005035 2557 flags.go:64] FLAG: --manifest-url-header="" Jun 09 20:54:08.011028 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005039 2557 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 20:54:08.011028 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005042 2557 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 20:54:08.011028 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005047 2557 flags.go:64] FLAG: --max-pods="110" Jun 09 20:54:08.011028 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005050 2557 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 20:54:08.011028 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005053 2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 20:54:08.011028 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005056 2557 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 20:54:08.011689 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005059 2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 20:54:08.011689 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005062 2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 20:54:08.011689 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005065 2557 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 20:54:08.011689 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005068 2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 20:54:08.011689 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005076 2557 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 20:54:08.011689 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005078 2557 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 20:54:08.011689 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005081 2557 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 20:54:08.011689 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005084 2557 flags.go:64] FLAG: --pod-cidr="" Jun 09 20:54:08.011689 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005087 2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 20:54:08.011689 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005094 2557 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 20:54:08.011689 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005097 2557 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 20:54:08.011689 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005100 2557 flags.go:64] FLAG: --pods-per-core="0" Jun 09 20:54:08.011689 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005103 2557 flags.go:64] FLAG: --port="10250" Jun 09 20:54:08.011689 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005106 2557 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 20:54:08.011689 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005110 2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05d82508d60e756df" Jun 09 20:54:08.011689 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005113 2557 flags.go:64] FLAG: --qos-reserved="" Jun 09 20:54:08.011689 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005115 2557 flags.go:64] FLAG: --read-only-port="10255" Jun 09 20:54:08.011689 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005118 2557 flags.go:64] FLAG: --register-node="true" Jun 09 20:54:08.011689 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005121 2557 flags.go:64] FLAG: --register-with-taints="" Jun 09 20:54:08.011689 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005125 2557 flags.go:64] FLAG: --registry-burst="10" Jun 09 20:54:08.011689 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005128 2557 flags.go:64] FLAG: --registry-qps="5" Jun 09 20:54:08.011689 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005131 2557 flags.go:64] FLAG: --reserved-cpus="" Jun 09 20:54:08.011689 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005133 2557 flags.go:64] FLAG: --reserved-memory="" Jun 09 20:54:08.011689 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005137 2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 20:54:08.011689 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005140 2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 20:54:08.012332 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005143 2557 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 20:54:08.012332 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005146 2557 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 20:54:08.012332 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005149 2557 flags.go:64] FLAG: --runonce="false" Jun 09 20:54:08.012332 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005152 2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 20:54:08.012332 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005155 2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 20:54:08.012332 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005158 2557 flags.go:64] FLAG: --seccomp-default="false" Jun 09 20:54:08.012332 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005161 2557 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 20:54:08.012332 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005163 2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 20:54:08.012332 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005166 2557 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 20:54:08.012332 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005169 2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 20:54:08.012332 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005172 2557 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 20:54:08.012332 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005174 2557 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 20:54:08.012332 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005177 2557 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 20:54:08.012332 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005180 2557 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 20:54:08.012332 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005183 2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 20:54:08.012332 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005186 2557 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 20:54:08.012332 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005189 2557 flags.go:64] FLAG: --system-cgroups="" Jun 09 20:54:08.012332 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005192 2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 20:54:08.012332 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005197 2557 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 20:54:08.012332 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005200 2557 flags.go:64] FLAG: --tls-cert-file="" Jun 09 20:54:08.012332 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005202 2557 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 20:54:08.012332 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005207 2557 flags.go:64] FLAG: --tls-min-version="" Jun 09 20:54:08.012332 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005210 2557 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 20:54:08.012332 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005213 2557 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 20:54:08.012332 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005216 2557 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 20:54:08.012974 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005218 2557 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 20:54:08.012974 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005221 2557 flags.go:64] FLAG: --v="2" Jun 09 20:54:08.012974 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005225 2557 flags.go:64] FLAG: --version="false" Jun 09 20:54:08.012974 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005230 2557 flags.go:64] FLAG: --vmodule="" Jun 09 20:54:08.012974 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005233 2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 20:54:08.012974 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005236 2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 20:54:08.012974 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005361 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 20:54:08.012974 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005365 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 20:54:08.012974 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005368 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 20:54:08.012974 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005385 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 20:54:08.012974 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005389 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 20:54:08.012974 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005394 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 20:54:08.012974 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005397 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 20:54:08.012974 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005400 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 20:54:08.012974 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005402 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 20:54:08.012974 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005406 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 20:54:08.012974 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005410 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 20:54:08.012974 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005413 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 20:54:08.012974 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005416 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 20:54:08.012974 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005419 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 20:54:08.012974 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005421 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 20:54:08.013499 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005424 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 20:54:08.013499 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005426 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 20:54:08.013499 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005429 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 20:54:08.013499 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005432 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 20:54:08.013499 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005435 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 20:54:08.013499 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005437 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 20:54:08.013499 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005440 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 20:54:08.013499 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005445 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 20:54:08.013499 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005447 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 20:54:08.013499 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005450 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 20:54:08.013499 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005452 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 20:54:08.013499 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005455 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 20:54:08.013499 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005457 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 20:54:08.013499 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005460 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 20:54:08.013499 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005462 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 20:54:08.013499 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005465 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 20:54:08.013499 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005468 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 09 20:54:08.013499 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005470 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 20:54:08.013499 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005472 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 20:54:08.013499 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005475 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 20:54:08.014013 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005478 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 20:54:08.014013 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005481 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 20:54:08.014013 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005485 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 20:54:08.014013 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005487 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 20:54:08.014013 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005490 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 20:54:08.014013 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005493 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 20:54:08.014013 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005495 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 20:54:08.014013 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005498 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 20:54:08.014013 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005500 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 20:54:08.014013 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005503 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 20:54:08.014013 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005505 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 20:54:08.014013 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005508 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 20:54:08.014013 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005512 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 20:54:08.014013 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005515 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 20:54:08.014013 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005518 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 20:54:08.014013 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005521 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 20:54:08.014013 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005524 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 20:54:08.014013 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005528 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 20:54:08.014013 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005531 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 20:54:08.014520 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005536 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 20:54:08.014520 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005539 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 20:54:08.014520 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005542 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 20:54:08.014520 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005544 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 20:54:08.014520 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005547 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 20:54:08.014520 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005549 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 20:54:08.014520 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005552 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 20:54:08.014520 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005555 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 20:54:08.014520 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005557 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 20:54:08.014520 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005560 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 20:54:08.014520 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005562 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 20:54:08.014520 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005565 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 20:54:08.014520 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005567 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 20:54:08.014520 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005570 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 20:54:08.014520 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005573 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 20:54:08.014520 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005576 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 20:54:08.014520 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005579 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 20:54:08.014520 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005582 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 20:54:08.014520 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005584 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 20:54:08.014520 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005587 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 20:54:08.015075 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005589 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 20:54:08.015075 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005592 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 20:54:08.015075 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005594 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 20:54:08.015075 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005597 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 20:54:08.015075 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005599 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 20:54:08.015075 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005602 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 20:54:08.015075 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005604 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 20:54:08.015075 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005607 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 20:54:08.015075 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005610 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 20:54:08.015075 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005613 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 20:54:08.015075 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005616 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 20:54:08.015075 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005618 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 20:54:08.015075 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005622 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 20:54:08.015075 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005624 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 20:54:08.015075 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005627 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 20:54:08.015075 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005629 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 20:54:08.015075 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005632 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 20:54:08.015075 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005634 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 20:54:08.015075 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005637 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 20:54:08.015075 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005640 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 20:54:08.015878 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005642 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 20:54:08.015878 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005645 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 20:54:08.015878 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005648 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 20:54:08.015878 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005650 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 20:54:08.015878 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.005653 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 20:54:08.015878 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.005658 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 20:54:08.015878 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.014038 2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 20:54:08.015878 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.014063 2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 20:54:08.015878 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.014084 2557 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 20:54:08.015878 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.014091 2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 20:54:08.015878 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014163 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 20:54:08.015878 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014169 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 20:54:08.015878 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014172 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 20:54:08.015878 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014175 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 20:54:08.015878 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014179 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 20:54:08.016357 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014182 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 20:54:08.016357 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014184 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 20:54:08.016357 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014187 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 20:54:08.016357 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014189 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 20:54:08.016357 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014192 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 20:54:08.016357 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014195 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 20:54:08.016357 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014197 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 20:54:08.016357 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014200 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 20:54:08.016357 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014202 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 20:54:08.016357 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014205 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 20:54:08.016357 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014208 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 20:54:08.016357 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014210 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 20:54:08.016357 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014212 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 20:54:08.016357 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014215 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 20:54:08.016357 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014218 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 20:54:08.016357 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014221 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 20:54:08.016357 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014224 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 20:54:08.016357 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014226 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 20:54:08.016357 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014229 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 09 20:54:08.016357 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014232 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 20:54:08.016873 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014234 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 20:54:08.016873 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014236 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 20:54:08.016873 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014239 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 20:54:08.016873 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014242 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 20:54:08.016873 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014251 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 20:54:08.016873 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014255 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 20:54:08.016873 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014257 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 20:54:08.016873 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014260 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 20:54:08.016873 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014262 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 20:54:08.016873 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014265 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 20:54:08.016873 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014269 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 20:54:08.016873 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014273 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 20:54:08.016873 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014277 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 20:54:08.016873 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014279 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 20:54:08.016873 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014282 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 20:54:08.016873 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014284 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 20:54:08.016873 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014287 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 20:54:08.016873 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014290 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 20:54:08.016873 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014292 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 20:54:08.017341 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014294 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 20:54:08.017341 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014297 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 20:54:08.017341 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014299 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 20:54:08.017341 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014303 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 20:54:08.017341 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014307 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 20:54:08.017341 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014310 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 20:54:08.017341 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014313 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 20:54:08.017341 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014315 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 20:54:08.017341 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014318 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 20:54:08.017341 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014320 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 20:54:08.017341 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014323 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 20:54:08.017341 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014325 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 20:54:08.017341 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014328 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 20:54:08.017341 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014330 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 20:54:08.017341 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014332 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 20:54:08.017341 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014335 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 20:54:08.017341 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014337 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 20:54:08.017341 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014340 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 20:54:08.017341 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014348 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 20:54:08.017341 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014351 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 20:54:08.017840 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014354 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 20:54:08.017840 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014356 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 20:54:08.017840 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014359 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 20:54:08.017840 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014362 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 20:54:08.017840 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014364 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 20:54:08.017840 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014367 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 20:54:08.017840 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014383 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 20:54:08.017840 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014386 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 20:54:08.017840 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014388 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 20:54:08.017840 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014391 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 20:54:08.017840 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014394 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 20:54:08.017840 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014396 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 20:54:08.017840 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014399 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 20:54:08.017840 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014402 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 20:54:08.017840 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014404 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 20:54:08.017840 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014407 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 20:54:08.017840 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014409 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 20:54:08.017840 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014412 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 20:54:08.017840 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014415 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 20:54:08.017840 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014417 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 20:54:08.018326 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014420 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 20:54:08.018326 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014422 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 20:54:08.018326 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014425 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 20:54:08.018326 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014429 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 20:54:08.018326 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014432 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 20:54:08.018326 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014435 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 20:54:08.018326 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014437 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 20:54:08.018326 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014440 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 20:54:08.018326 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014442 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 20:54:08.018326 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014446 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 20:54:08.018326 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014449 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 20:54:08.018326 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014458 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 20:54:08.018326 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014462 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 20:54:08.018326 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014464 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 20:54:08.018326 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014467 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 20:54:08.018717 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.014472 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 20:54:08.018717 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014651 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 20:54:08.018717 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014657 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 20:54:08.018717 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014660 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 20:54:08.018717 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014663 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 20:54:08.018717 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014666 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 20:54:08.018717 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014669 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 20:54:08.018717 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014672 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 20:54:08.018717 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014675 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 20:54:08.018717 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014679 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 20:54:08.018717 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014683 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 20:54:08.018717 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014686 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 20:54:08.018717 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014689 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 20:54:08.018717 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014691 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 20:54:08.019067 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014694 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 20:54:08.019067 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014697 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 20:54:08.019067 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014700 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 20:54:08.019067 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014702 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 20:54:08.019067 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014705 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 20:54:08.019067 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014708 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 20:54:08.019067 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014711 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 20:54:08.019067 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014714 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 20:54:08.019067 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014717 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 20:54:08.019067 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014720 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 20:54:08.019067 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014723 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 20:54:08.019067 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014725 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 20:54:08.019067 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014728 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 20:54:08.019067 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014731 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 20:54:08.019067 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014734 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 20:54:08.019067 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014742 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 20:54:08.019067 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014745 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 20:54:08.019067 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014748 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 20:54:08.019067 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014750 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 20:54:08.019067 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014753 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 20:54:08.019588 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014755 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 09 20:54:08.019588 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014757 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 20:54:08.019588 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014766 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 20:54:08.019588 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014768 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 20:54:08.019588 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014771 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 20:54:08.019588 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014773 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 20:54:08.019588 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014776 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 20:54:08.019588 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014778 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 20:54:08.019588 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014781 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 20:54:08.019588 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014784 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 20:54:08.019588 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014786 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 20:54:08.019588 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014788 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 20:54:08.019588 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014791 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 20:54:08.019588 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014794 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 20:54:08.019588 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014796 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 20:54:08.019588 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014798 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 20:54:08.019588 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014801 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 20:54:08.019588 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014803 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 20:54:08.019588 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014806 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 20:54:08.019588 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014808 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 20:54:08.020105 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014811 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 20:54:08.020105 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014813 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 20:54:08.020105 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014816 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 20:54:08.020105 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014818 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 20:54:08.020105 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014821 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 20:54:08.020105 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014824 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 20:54:08.020105 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014826 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 20:54:08.020105 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014829 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 20:54:08.020105 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.014888 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 20:54:08.020105 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015134 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 20:54:08.020105 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015138 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 20:54:08.020105 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015141 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 20:54:08.020105 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015146 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 20:54:08.020105 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015151 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 20:54:08.020105 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015155 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 20:54:08.020105 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015161 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 20:54:08.020105 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015165 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 20:54:08.020105 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015171 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 20:54:08.020105 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015176 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 20:54:08.020105 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015180 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 20:54:08.020615 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015185 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 20:54:08.020615 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015190 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 20:54:08.020615 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015203 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 20:54:08.020615 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015209 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 20:54:08.020615 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015214 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 20:54:08.020615 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015218 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 20:54:08.020615 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015222 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 20:54:08.020615 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015226 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 20:54:08.020615 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015231 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 20:54:08.020615 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015235 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 20:54:08.020615 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015239 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 20:54:08.020615 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015243 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 20:54:08.020615 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015247 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 20:54:08.020615 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015252 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 20:54:08.020615 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015261 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 20:54:08.020615 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015266 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 20:54:08.020615 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015280 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 20:54:08.020615 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015288 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 20:54:08.020615 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015293 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 20:54:08.020615 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015298 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 20:54:08.021107 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015304 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 20:54:08.021107 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015346 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 20:54:08.021107 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015351 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 20:54:08.021107 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015356 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 20:54:08.021107 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015361 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 20:54:08.021107 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:08.015365 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 20:54:08.021107 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.015400 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 20:54:08.021107 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.015883 2557 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 20:54:08.021107 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.019170 2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 20:54:08.021107 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.020838 2557 server.go:1019] "Starting client certificate rotation" Jun 09 20:54:08.021107 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.020945 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 20:54:08.021107 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.020982 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 20:54:08.023840 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.023821 2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 20:54:08.029202 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.025112 2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 20:54:08.045560 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.045530 2557 log.go:25] "Validated CRI v1 runtime API" Jun 09 20:54:08.048746 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.048727 2557 log.go:25] "Validated CRI v1 image API" Jun 09 20:54:08.053533 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.053497 2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 20:54:08.057294 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.057267 2557 fs.go:135] Filesystem UUIDs: map[775c72f6-96b8-4d50-996d-3902a398f111:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 985f3abc-52c2-418d-9e14-30f14ad8be3c:/dev/nvme0n1p4] Jun 09 20:54:08.057440 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.057290 2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 20:54:08.065348 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.065201 2557 manager.go:216] Machine: {Timestamp:2026-06-09 20:54:08.06365101 +0000 UTC m=+0.399340206 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095372 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26ec70c5f14f4458c9e0342c2a6187 SystemUUID:ec26ec70-c5f1-4f44-58c9-e0342c2a6187 BootID:37cb97f3-910c-4b1b-8a42-53664891818e Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:45:57:9a:60:57 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:45:57:9a:60:57 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:7a:08:7e:db:44 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 20:54:08.065348 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.065325 2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 20:54:08.065582 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.065475 2557 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 20:54:08.068988 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.068950 2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 20:54:08.069156 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.068993 2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-98.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 20:54:08.069888 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.069874 2557 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 20:54:08.069888 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.069889 2557 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 20:54:08.069954 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.069903 2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 20:54:08.071131 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.071030 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 20:54:08.071260 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.070760 2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 20:54:08.072476 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.072458 2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 20:54:08.076894 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.076878 2557 state_mem.go:36] "Initialized new in-memory state store" Jun 09 20:54:08.077037 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.077026 2557 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 20:54:08.077082 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.077060 2557 kubelet.go:486] "Attempting to sync node with API server" Jun 09 20:54:08.077082 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.077071 2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 20:54:08.077155 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.077086 2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 20:54:08.077155 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.077096 2557 kubelet.go:398] "Adding apiserver pod source" Jun 09 20:54:08.077155 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.077107 2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 20:54:08.077559 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.077546 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 20:54:08.077600 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.077566 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 20:54:08.080119 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.080100 2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 20:54:08.082049 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.082035 2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 20:54:08.082125 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.082065 2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 20:54:08.085936 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.085917 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 20:54:08.085936 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.085936 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 20:54:08.085936 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.085943 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 20:54:08.086078 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.085948 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 20:54:08.086078 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.085957 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 20:54:08.086078 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.085962 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 20:54:08.086078 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.085970 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 20:54:08.086078 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.085975 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 20:54:08.086078 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.085982 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 20:54:08.086078 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.085987 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 20:54:08.086078 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.085995 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 20:54:08.086078 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.086000 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 20:54:08.086340 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:08.086289 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 20:54:08.086386 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:08.086332 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-98.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 20:54:08.087021 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.087010 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 20:54:08.087068 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.087022 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 20:54:08.089351 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.089329 2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-98.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 20:54:08.090671 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.090658 2557 server.go:1268] "Started kubelet" Jun 09 20:54:08.091066 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.091045 2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 20:54:08.091439 ip-10-0-137-98 systemd[1]: Started Kubernetes Kubelet. Jun 09 20:54:08.093321 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.093117 2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 20:54:08.093321 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.093217 2557 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 20:54:08.094473 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.094454 2557 server.go:310] "Adding debug handlers to kubelet server" Jun 09 20:54:08.095409 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.095394 2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 20:54:08.100428 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:08.099329 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-98.ec2.internal.18b785083dc0e260 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-98.ec2.internal,UID:ip-10-0-137-98.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-98.ec2.internal,},FirstTimestamp:2026-06-09 20:54:08.090604128 +0000 UTC m=+0.426293323,LastTimestamp:2026-06-09 20:54:08.090604128 +0000 UTC m=+0.426293323,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-98.ec2.internal,}" Jun 09 20:54:08.101827 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:08.101800 2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 20:54:08.103313 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.103295 2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 20:54:08.103434 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.103318 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 20:54:08.103541 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:08.103523 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-98.ec2.internal\" not found" Jun 09 20:54:08.104061 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.104040 2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 20:54:08.104172 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.104062 2557 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 20:54:08.104172 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.104104 2557 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 20:54:08.104275 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.104250 2557 reconstruct.go:97] "Volume reconstruction finished" Jun 09 20:54:08.104275 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.104261 2557 reconciler.go:29] "Reconciler: start to sync state" Jun 09 20:54:08.104681 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.104664 2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 20:54:08.104681 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.104682 2557 factory.go:55] Registering systemd factory Jun 09 20:54:08.104816 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.104691 2557 factory.go:223] Registration of the systemd container factory successfully Jun 09 20:54:08.104938 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.104924 2557 factory.go:153] Registering CRI-O factory Jun 09 20:54:08.104996 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.104942 2557 factory.go:223] Registration of the crio container factory successfully Jun 09 20:54:08.104996 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.104965 2557 factory.go:103] Registering Raw factory Jun 09 20:54:08.104996 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.104980 2557 manager.go:1196] Started watching for new ooms in manager Jun 09 20:54:08.106183 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.106166 2557 manager.go:349] Starting recovery of all containers Jun 09 20:54:08.113566 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:08.113201 2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-98.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 20:54:08.113566 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:08.113434 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 20:54:08.113759 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.113616 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hqkl4" Jun 09 20:54:08.116137 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.116088 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 20:54:08.118883 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.118860 2557 manager.go:354] Recovery completed Jun 09 20:54:08.119238 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.119199 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hqkl4" Jun 09 20:54:08.123749 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.123731 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 20:54:08.125978 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.125956 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-98.ec2.internal" event="NodeHasSufficientMemory" Jun 09 20:54:08.126110 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.125994 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-98.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 20:54:08.126110 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.126006 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-98.ec2.internal" event="NodeHasSufficientPID" Jun 09 20:54:08.126644 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.126625 2557 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 20:54:08.126644 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.126643 2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 20:54:08.126776 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.126661 2557 state_mem.go:36] "Initialized new in-memory state store" Jun 09 20:54:08.126776 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.126642 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 20:54:08.127325 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.127309 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-98.ec2.internal" event="NodeHasSufficientMemory" Jun 09 20:54:08.127407 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.127342 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-98.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 20:54:08.127407 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.127356 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-98.ec2.internal" event="NodeHasSufficientPID" Jun 09 20:54:08.128479 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.128465 2557 policy_none.go:49] "None policy: Start" Jun 09 20:54:08.128532 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.128482 2557 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 20:54:08.128532 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.128493 2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 20:54:08.130224 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.130212 2557 policy_none.go:47] "Start" Jun 09 20:54:08.167137 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.167113 2557 manager.go:337] "Starting Device Plugin manager" Jun 09 20:54:08.167613 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:08.167152 2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 20:54:08.167613 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.167164 2557 server.go:87] "Starting device plugin registration server" Jun 09 20:54:08.167613 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.167524 2557 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 20:54:08.167613 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.167538 2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 20:54:08.191993 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.167752 2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 20:54:08.191993 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.167831 2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 20:54:08.191993 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.167840 2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 20:54:08.191993 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:08.168415 2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 20:54:08.191993 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:08.168472 2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-98.ec2.internal\" not found" Jun 09 20:54:08.191993 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.184662 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 20:54:08.191993 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.184714 2557 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 20:54:08.191993 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.184738 2557 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 20:54:08.191993 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:08.184778 2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 20:54:08.191993 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.187138 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 20:54:08.268611 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.268501 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 20:54:08.269763 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.269739 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-98.ec2.internal" event="NodeHasSufficientMemory" Jun 09 20:54:08.269837 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.269772 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-98.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 20:54:08.269837 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.269789 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-98.ec2.internal" event="NodeHasSufficientPID" Jun 09 20:54:08.269837 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.269814 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-98.ec2.internal" Jun 09 20:54:08.278480 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.278456 2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-98.ec2.internal" Jun 09 20:54:08.278537 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:08.278488 2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-98.ec2.internal\": node \"ip-10-0-137-98.ec2.internal\" not found" Jun 09 20:54:08.285833 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.285802 2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-98.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-98.ec2.internal"] Jun 09 20:54:08.285970 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.285877 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 20:54:08.287862 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.287838 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-98.ec2.internal" event="NodeHasSufficientMemory" Jun 09 20:54:08.287964 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.287869 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-98.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 20:54:08.287964 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.287882 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-98.ec2.internal" event="NodeHasSufficientPID" Jun 09 20:54:08.290350 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.290336 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 20:54:08.290505 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.290485 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-98.ec2.internal" Jun 09 20:54:08.290559 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.290525 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 20:54:08.291141 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.291122 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-98.ec2.internal" event="NodeHasSufficientMemory" Jun 09 20:54:08.291231 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.291156 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-98.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 20:54:08.291231 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.291172 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-98.ec2.internal" event="NodeHasSufficientPID" Jun 09 20:54:08.291231 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.291122 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-98.ec2.internal" event="NodeHasSufficientMemory" Jun 09 20:54:08.291393 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.291231 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-98.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 20:54:08.291393 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.291243 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-98.ec2.internal" event="NodeHasSufficientPID" Jun 09 20:54:08.293419 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.293402 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-98.ec2.internal" Jun 09 20:54:08.293500 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.293435 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 20:54:08.295336 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.295321 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-98.ec2.internal" event="NodeHasSufficientMemory" Jun 09 20:54:08.295431 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.295351 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-98.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 20:54:08.295431 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.295362 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-98.ec2.internal" event="NodeHasSufficientPID" Jun 09 20:54:08.299660 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:08.299645 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-98.ec2.internal\" not found" Jun 09 20:54:08.305907 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.305884 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c84ca1047407e2576b91867a00c296e0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-98.ec2.internal\" (UID: \"c84ca1047407e2576b91867a00c296e0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-98.ec2.internal" Jun 09 20:54:08.305998 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.305918 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c7806303e812afd18dcb7a11da25a9c-config\") pod \"kube-apiserver-proxy-ip-10-0-137-98.ec2.internal\" (UID: \"5c7806303e812afd18dcb7a11da25a9c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-98.ec2.internal" Jun 09 20:54:08.305998 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.305942 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c84ca1047407e2576b91867a00c296e0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-98.ec2.internal\" (UID: \"c84ca1047407e2576b91867a00c296e0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-98.ec2.internal" Jun 09 20:54:08.316343 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:08.316318 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-98.ec2.internal\" not found" node="ip-10-0-137-98.ec2.internal" Jun 09 20:54:08.321166 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:08.321146 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-98.ec2.internal\" not found" node="ip-10-0-137-98.ec2.internal" Jun 09 20:54:08.400047 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:08.400006 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-98.ec2.internal\" not found" Jun 09 20:54:08.406388 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.406349 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c84ca1047407e2576b91867a00c296e0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-98.ec2.internal\" (UID: \"c84ca1047407e2576b91867a00c296e0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-98.ec2.internal" Jun 09 20:54:08.406518 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.406398 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c84ca1047407e2576b91867a00c296e0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-98.ec2.internal\" (UID: \"c84ca1047407e2576b91867a00c296e0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-98.ec2.internal" Jun 09 20:54:08.406518 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.406419 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c7806303e812afd18dcb7a11da25a9c-config\") pod \"kube-apiserver-proxy-ip-10-0-137-98.ec2.internal\" (UID: \"5c7806303e812afd18dcb7a11da25a9c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-98.ec2.internal" Jun 09 20:54:08.406518 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.406437 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c84ca1047407e2576b91867a00c296e0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-98.ec2.internal\" (UID: \"c84ca1047407e2576b91867a00c296e0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-98.ec2.internal" Jun 09 20:54:08.406518 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.406446 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c7806303e812afd18dcb7a11da25a9c-config\") pod \"kube-apiserver-proxy-ip-10-0-137-98.ec2.internal\" (UID: \"5c7806303e812afd18dcb7a11da25a9c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-98.ec2.internal" Jun 09 20:54:08.406518 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.406497 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c84ca1047407e2576b91867a00c296e0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-98.ec2.internal\" (UID: \"c84ca1047407e2576b91867a00c296e0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-98.ec2.internal" Jun 09 20:54:08.500573 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:08.500526 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-98.ec2.internal\" not found" Jun 09 20:54:08.601441 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:08.601355 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-98.ec2.internal\" not found" Jun 09 20:54:08.622836 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.622810 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-98.ec2.internal" Jun 09 20:54:08.628388 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.628351 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-98.ec2.internal" Jun 09 20:54:08.702551 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:08.702503 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-98.ec2.internal\" not found" Jun 09 20:54:08.803078 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:08.803044 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-98.ec2.internal\" not found" Jun 09 20:54:08.903566 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:08.903485 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-98.ec2.internal\" not found" Jun 09 20:54:08.920339 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.920308 2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 20:54:08.966833 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:08.966806 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 20:54:09.003885 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.003851 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-98.ec2.internal" Jun 09 20:54:09.019949 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.019919 2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 20:54:09.020132 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:09.020005 2557 request.go:1196] "Unexpected error when reading response body" err="read tcp 10.0.137.98:43162->98.90.176.199:6443: use of closed network connection" Jun 09 20:54:09.020132 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.020070 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 20:54:09.020132 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:09.020103 2557 kubelet.go:3250] "Failed creating a mirror pod" err="unexpected error when reading response body. Please retry. Original error: read tcp 10.0.137.98:43162->98.90.176.199:6443: use of closed network connection" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-98.ec2.internal" Jun 09 20:54:09.020132 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.020118 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-98.ec2.internal" Jun 09 20:54:09.020265 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.020053 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 20:54:09.020265 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.020112 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 20:54:09.032139 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.032113 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 20:54:09.078261 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.078228 2557 apiserver.go:52] "Watching apiserver" Jun 09 20:54:09.088882 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.087488 2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 20:54:09.088882 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.088334 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-2chl4","kube-system/konnectivity-agent-p7x4f","openshift-cluster-node-tuning-operator/tuned-48922","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-98.ec2.internal","openshift-network-operator/iptables-alerter-6gdmg","openshift-ovn-kubernetes/ovnkube-node-5l764","kube-system/kube-apiserver-proxy-ip-10-0-137-98.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx82d","openshift-dns/node-resolver-jzlgv","openshift-image-registry/node-ca-7dxwm","openshift-multus/multus-additional-cni-plugins-fgz4b","openshift-multus/multus-pcpkv","openshift-multus/network-metrics-daemon-dwxkr","openshift-network-diagnostics/network-check-target-ddvmc"] Jun 09 20:54:09.091475 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.091389 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:54:09.091617 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:09.091481 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwxkr" podUID="c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae" Jun 09 20:54:09.093253 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.093232 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p7x4f" Jun 09 20:54:09.095211 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.095185 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.095345 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.095214 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 20:54:09.095345 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.095261 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-v6kpw\"" Jun 09 20:54:09.095655 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.095637 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 20:54:09.096967 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.096944 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 20:54:09.097453 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.097436 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zn9d6\"" Jun 09 20:54:09.097590 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.097572 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 20:54:09.097765 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.097753 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:09.097843 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:09.097809 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2chl4" podUID="2b57eb2c-1312-4faa-9ce2-ad5890cf41ee" Jun 09 20:54:09.099619 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.099599 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6gdmg" Jun 09 20:54:09.101195 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.101178 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 20:54:09.101335 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.101311 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 20:54:09.101485 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.101471 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7wnpd\"" Jun 09 20:54:09.101548 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.101514 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 20:54:09.101890 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.101874 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.103486 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.103469 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 20:54:09.103553 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.103487 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 20:54:09.103831 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.103654 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 20:54:09.103831 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.103666 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 20:54:09.103831 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.103676 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 20:54:09.103831 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.103678 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-twbfw\"" Jun 09 20:54:09.103831 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.103711 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 20:54:09.104055 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.103971 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 20:54:09.104055 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.104017 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:54:09.104140 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:09.104080 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddvmc" podUID="c0a3351e-dc59-4816-87ea-7a918f8c03ab" Jun 09 20:54:09.106260 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.106244 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx82d" Jun 09 20:54:09.108355 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.108339 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 20:54:09.108499 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.108482 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jzlgv" Jun 09 20:54:09.108700 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.108488 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6lqq2\"" Jun 09 20:54:09.108700 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.108647 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 20:54:09.108700 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.108649 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 20:54:09.109395 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.109356 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/85c3f42d-8e0c-48fb-86fd-1f8706950ee3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bx82d\" (UID: \"85c3f42d-8e0c-48fb-86fd-1f8706950ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx82d" Jun 09 20:54:09.109504 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.109443 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-host-run-netns\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.109504 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.109472 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-etc-openvswitch\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.109615 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.109521 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4010dd68-a50f-479f-a86f-2aecbc8e67e1-ovnkube-config\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.109615 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.109539 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a5e543bf-3df6-477f-8da3-262352b84b30-agent-certs\") pod \"konnectivity-agent-p7x4f\" (UID: \"a5e543bf-3df6-477f-8da3-262352b84b30\") " pod="kube-system/konnectivity-agent-p7x4f" Jun 09 20:54:09.109615 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.109584 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a5e543bf-3df6-477f-8da3-262352b84b30-konnectivity-ca\") pod \"konnectivity-agent-p7x4f\" (UID: \"a5e543bf-3df6-477f-8da3-262352b84b30\") " pod="kube-system/konnectivity-agent-p7x4f" Jun 09 20:54:09.109615 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.109610 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-etc-modprobe-d\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.109805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.109641 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/85c3f42d-8e0c-48fb-86fd-1f8706950ee3-etc-selinux\") pod \"aws-ebs-csi-driver-node-bx82d\" (UID: \"85c3f42d-8e0c-48fb-86fd-1f8706950ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx82d" Jun 09 20:54:09.109805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.109665 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqkmb\" (UniqueName: \"kubernetes.io/projected/6fb5611b-d203-40d5-9ec8-f34df2fde783-kube-api-access-cqkmb\") pod \"iptables-alerter-6gdmg\" (UID: \"6fb5611b-d203-40d5-9ec8-f34df2fde783\") " pod="openshift-network-operator/iptables-alerter-6gdmg" Jun 09 20:54:09.109805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.109689 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-systemd-units\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.109805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.109714 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-host-cni-netd\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.109805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.109770 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9nr8\" (UniqueName: \"kubernetes.io/projected/c0a3351e-dc59-4816-87ea-7a918f8c03ab-kube-api-access-f9nr8\") pod \"network-check-target-ddvmc\" (UID: \"c0a3351e-dc59-4816-87ea-7a918f8c03ab\") " pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:54:09.110024 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.109863 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-etc-sysctl-conf\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.110024 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.109924 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-run\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.110024 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.109948 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-lib-modules\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.110024 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110014 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-var-lib-openvswitch\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.110188 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110033 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4010dd68-a50f-479f-a86f-2aecbc8e67e1-env-overrides\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.110188 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110048 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4010dd68-a50f-479f-a86f-2aecbc8e67e1-ovnkube-script-lib\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.110188 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110062 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-metrics-certs\") pod \"network-metrics-daemon-dwxkr\" (UID: \"c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae\") " pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:54:09.110188 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110078 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-var-lib-kubelet\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.110188 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110110 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-etc-tuned\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.110188 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110132 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl6pr\" (UniqueName: \"kubernetes.io/projected/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-kube-api-access-hl6pr\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.110188 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110163 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trxjf\" (UniqueName: \"kubernetes.io/projected/85c3f42d-8e0c-48fb-86fd-1f8706950ee3-kube-api-access-trxjf\") pod \"aws-ebs-csi-driver-node-bx82d\" (UID: \"85c3f42d-8e0c-48fb-86fd-1f8706950ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx82d" Jun 09 20:54:09.110537 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110196 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-sys\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.110537 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110221 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-host\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.110537 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110237 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-host-run-ovn-kubernetes\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.110537 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110238 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p5lc9\"" Jun 09 20:54:09.110537 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110296 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/85c3f42d-8e0c-48fb-86fd-1f8706950ee3-socket-dir\") pod \"aws-ebs-csi-driver-node-bx82d\" (UID: \"85c3f42d-8e0c-48fb-86fd-1f8706950ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx82d" Jun 09 20:54:09.110537 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110323 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/85c3f42d-8e0c-48fb-86fd-1f8706950ee3-device-dir\") pod \"aws-ebs-csi-driver-node-bx82d\" (UID: \"85c3f42d-8e0c-48fb-86fd-1f8706950ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx82d" Jun 09 20:54:09.110537 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110349 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 20:54:09.110537 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110446 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 20:54:09.110537 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110339 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6fb5611b-d203-40d5-9ec8-f34df2fde783-iptables-alerter-script\") pod \"iptables-alerter-6gdmg\" (UID: \"6fb5611b-d203-40d5-9ec8-f34df2fde783\") " pod="openshift-network-operator/iptables-alerter-6gdmg" Jun 09 20:54:09.110537 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110501 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-node-log\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.110537 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110515 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-host-cni-bin\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.110537 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110533 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-tmp\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.111051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110559 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2b57eb2c-1312-4faa-9ce2-ad5890cf41ee-kubelet-config\") pod \"global-pull-secret-syncer-2chl4\" (UID: \"2b57eb2c-1312-4faa-9ce2-ad5890cf41ee\") " pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:09.111051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110578 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2b57eb2c-1312-4faa-9ce2-ad5890cf41ee-dbus\") pod \"global-pull-secret-syncer-2chl4\" (UID: \"2b57eb2c-1312-4faa-9ce2-ad5890cf41ee\") " pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:09.111051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110592 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6fb5611b-d203-40d5-9ec8-f34df2fde783-host-slash\") pod \"iptables-alerter-6gdmg\" (UID: \"6fb5611b-d203-40d5-9ec8-f34df2fde783\") " pod="openshift-network-operator/iptables-alerter-6gdmg" Jun 09 20:54:09.111051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110605 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-host-kubelet\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.111051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110624 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-run-openvswitch\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.111051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110647 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-run-ovn\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.111051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110684 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-log-socket\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.111051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110708 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/85c3f42d-8e0c-48fb-86fd-1f8706950ee3-sys-fs\") pod \"aws-ebs-csi-driver-node-bx82d\" (UID: \"85c3f42d-8e0c-48fb-86fd-1f8706950ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx82d" Jun 09 20:54:09.111051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110733 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-host-slash\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.111051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110780 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.111051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110797 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4010dd68-a50f-479f-a86f-2aecbc8e67e1-ovn-node-metrics-cert\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.111051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110826 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td4xl\" (UniqueName: \"kubernetes.io/projected/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-kube-api-access-td4xl\") pod \"network-metrics-daemon-dwxkr\" (UID: \"c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae\") " pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:54:09.111051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110849 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-etc-sysconfig\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.111051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110870 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-etc-kubernetes\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.111051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110884 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-etc-sysctl-d\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.111051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110898 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b57eb2c-1312-4faa-9ce2-ad5890cf41ee-original-pull-secret\") pod \"global-pull-secret-syncer-2chl4\" (UID: \"2b57eb2c-1312-4faa-9ce2-ad5890cf41ee\") " pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:09.111647 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110929 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/85c3f42d-8e0c-48fb-86fd-1f8706950ee3-registration-dir\") pod \"aws-ebs-csi-driver-node-bx82d\" (UID: \"85c3f42d-8e0c-48fb-86fd-1f8706950ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx82d" Jun 09 20:54:09.111647 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110956 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-run-systemd\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.111647 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110973 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7dxwm" Jun 09 20:54:09.111647 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.110980 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m8gr\" (UniqueName: \"kubernetes.io/projected/4010dd68-a50f-479f-a86f-2aecbc8e67e1-kube-api-access-7m8gr\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.111647 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.111004 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-etc-systemd\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.112334 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.112311 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 20:54:09.112581 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.112564 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 20:54:09.112657 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.112604 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 20:54:09.112657 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.112623 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 20:54:09.112657 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.112564 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9zxdz\"" Jun 09 20:54:09.113538 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.113522 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fgz4b" Jun 09 20:54:09.114961 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.114943 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 20:54:09.115327 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.115307 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 20:54:09.115464 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.115446 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 20:54:09.115533 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.115507 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 20:54:09.115594 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.115551 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 20:54:09.115747 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.115730 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gmll9\"" Jun 09 20:54:09.116731 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.116714 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.118214 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.118198 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7tzh8\"" Jun 09 20:54:09.118263 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.118198 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 20:54:09.123752 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.123726 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 20:49:08 +0000 UTC" deadline="2027-12-30 05:57:47.133114242 +0000 UTC" Jun 09 20:54:09.123752 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.123750 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13641h3m38.009367097s" Jun 09 20:54:09.140196 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.140166 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jzq88" Jun 09 20:54:09.147026 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.146996 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jzq88" Jun 09 20:54:09.202589 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:09.202558 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc84ca1047407e2576b91867a00c296e0.slice/crio-278681e0c550ea0b2f68999a94e86d0b2d51974e3e5ce052021589788633faf1 WatchSource:0}: Error finding container 278681e0c550ea0b2f68999a94e86d0b2d51974e3e5ce052021589788633faf1: Status 404 returned error can't find the container with id 278681e0c550ea0b2f68999a94e86d0b2d51974e3e5ce052021589788633faf1 Jun 09 20:54:09.203187 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:09.203162 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c7806303e812afd18dcb7a11da25a9c.slice/crio-9ce734e1d0095ac7af9a2b01a3ef571538f3ff6e4c76888a592848765072c208 WatchSource:0}: Error finding container 9ce734e1d0095ac7af9a2b01a3ef571538f3ff6e4c76888a592848765072c208: Status 404 returned error can't find the container with id 9ce734e1d0095ac7af9a2b01a3ef571538f3ff6e4c76888a592848765072c208 Jun 09 20:54:09.204744 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.204725 2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 20:54:09.210070 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.210052 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 20:54:09.211801 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.211781 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/85c3f42d-8e0c-48fb-86fd-1f8706950ee3-device-dir\") pod \"aws-ebs-csi-driver-node-bx82d\" (UID: \"85c3f42d-8e0c-48fb-86fd-1f8706950ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx82d" Jun 09 20:54:09.211870 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.211809 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-node-log\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.211870 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.211825 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-host-cni-bin\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.211870 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.211844 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/84c09f0a-64ef-41e7-b1ca-c16ae3eeb4f9-serviceca\") pod \"node-ca-7dxwm\" (UID: \"84c09f0a-64ef-41e7-b1ca-c16ae3eeb4f9\") " pod="openshift-image-registry/node-ca-7dxwm" Jun 09 20:54:09.211870 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.211862 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-multus-cni-dir\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.212024 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.211887 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2b57eb2c-1312-4faa-9ce2-ad5890cf41ee-kubelet-config\") pod \"global-pull-secret-syncer-2chl4\" (UID: \"2b57eb2c-1312-4faa-9ce2-ad5890cf41ee\") " pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:09.212024 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.211907 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-host-cni-bin\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.212024 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.211908 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-node-log\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.212024 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.211912 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6fb5611b-d203-40d5-9ec8-f34df2fde783-host-slash\") pod \"iptables-alerter-6gdmg\" (UID: \"6fb5611b-d203-40d5-9ec8-f34df2fde783\") " pod="openshift-network-operator/iptables-alerter-6gdmg" Jun 09 20:54:09.212024 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.211945 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6fb5611b-d203-40d5-9ec8-f34df2fde783-host-slash\") pod \"iptables-alerter-6gdmg\" (UID: \"6fb5611b-d203-40d5-9ec8-f34df2fde783\") " pod="openshift-network-operator/iptables-alerter-6gdmg" Jun 09 20:54:09.212024 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.211909 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/85c3f42d-8e0c-48fb-86fd-1f8706950ee3-device-dir\") pod \"aws-ebs-csi-driver-node-bx82d\" (UID: \"85c3f42d-8e0c-48fb-86fd-1f8706950ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx82d" Jun 09 20:54:09.212024 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.211960 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-host-kubelet\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.212024 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.211961 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2b57eb2c-1312-4faa-9ce2-ad5890cf41ee-kubelet-config\") pod \"global-pull-secret-syncer-2chl4\" (UID: \"2b57eb2c-1312-4faa-9ce2-ad5890cf41ee\") " pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:09.212024 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.211992 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-run-openvswitch\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.212024 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212008 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-host-kubelet\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.212024 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212010 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-run-ovn\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.212024 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212029 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-run-ovn\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.212639 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212048 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-log-socket\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.212639 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212062 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-run-openvswitch\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.212639 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212074 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-log-socket\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.212639 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212075 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-etc-kubernetes\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.212639 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212102 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/85c3f42d-8e0c-48fb-86fd-1f8706950ee3-sys-fs\") pod \"aws-ebs-csi-driver-node-bx82d\" (UID: \"85c3f42d-8e0c-48fb-86fd-1f8706950ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx82d" Jun 09 20:54:09.212639 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212116 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-etc-kubernetes\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.212639 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212123 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.212639 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212149 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4010dd68-a50f-479f-a86f-2aecbc8e67e1-ovn-node-metrics-cert\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.212639 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212167 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/85c3f42d-8e0c-48fb-86fd-1f8706950ee3-sys-fs\") pod \"aws-ebs-csi-driver-node-bx82d\" (UID: \"85c3f42d-8e0c-48fb-86fd-1f8706950ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx82d" Jun 09 20:54:09.212639 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212177 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-etc-systemd\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.212639 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212150 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.212639 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212201 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84c09f0a-64ef-41e7-b1ca-c16ae3eeb4f9-host\") pod \"node-ca-7dxwm\" (UID: \"84c09f0a-64ef-41e7-b1ca-c16ae3eeb4f9\") " pod="openshift-image-registry/node-ca-7dxwm" Jun 09 20:54:09.212639 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212219 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4rdr\" (UniqueName: \"kubernetes.io/projected/84c09f0a-64ef-41e7-b1ca-c16ae3eeb4f9-kube-api-access-q4rdr\") pod \"node-ca-7dxwm\" (UID: \"84c09f0a-64ef-41e7-b1ca-c16ae3eeb4f9\") " pod="openshift-image-registry/node-ca-7dxwm" Jun 09 20:54:09.212639 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212234 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-hostroot\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.212639 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212254 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m8gr\" (UniqueName: \"kubernetes.io/projected/4010dd68-a50f-479f-a86f-2aecbc8e67e1-kube-api-access-7m8gr\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.212639 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212313 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-etc-systemd\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.212639 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212352 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/234cd6b9-9e32-4cf9-94c4-2bb0053ff04c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fgz4b\" (UID: \"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c\") " pod="openshift-multus/multus-additional-cni-plugins-fgz4b" Jun 09 20:54:09.213449 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212534 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxp4w\" (UniqueName: \"kubernetes.io/projected/234cd6b9-9e32-4cf9-94c4-2bb0053ff04c-kube-api-access-cxp4w\") pod \"multus-additional-cni-plugins-fgz4b\" (UID: \"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c\") " pod="openshift-multus/multus-additional-cni-plugins-fgz4b" Jun 09 20:54:09.213449 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212548 2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 20:54:09.213449 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212569 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-host-run-netns\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.213449 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212594 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4010dd68-a50f-479f-a86f-2aecbc8e67e1-ovnkube-config\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.213449 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212630 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a5e543bf-3df6-477f-8da3-262352b84b30-agent-certs\") pod \"konnectivity-agent-p7x4f\" (UID: \"a5e543bf-3df6-477f-8da3-262352b84b30\") " pod="kube-system/konnectivity-agent-p7x4f" Jun 09 20:54:09.213449 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212655 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a5e543bf-3df6-477f-8da3-262352b84b30-konnectivity-ca\") pod \"konnectivity-agent-p7x4f\" (UID: \"a5e543bf-3df6-477f-8da3-262352b84b30\") " pod="kube-system/konnectivity-agent-p7x4f" Jun 09 20:54:09.213449 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212663 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-host-run-netns\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.213449 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212683 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-host-run-k8s-cni-cncf-io\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.213449 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212710 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-host-cni-netd\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.213449 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212734 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9nr8\" (UniqueName: \"kubernetes.io/projected/c0a3351e-dc59-4816-87ea-7a918f8c03ab-kube-api-access-f9nr8\") pod \"network-check-target-ddvmc\" (UID: \"c0a3351e-dc59-4816-87ea-7a918f8c03ab\") " pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:54:09.213449 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212758 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-run\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.213449 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212779 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-var-lib-kubelet\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.213449 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212787 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-host-cni-netd\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.213449 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212818 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqn55\" (UniqueName: \"kubernetes.io/projected/48ea32f0-3aed-49d4-bd34-2c0bc6a8b251-kube-api-access-tqn55\") pod \"node-resolver-jzlgv\" (UID: \"48ea32f0-3aed-49d4-bd34-2c0bc6a8b251\") " pod="openshift-dns/node-resolver-jzlgv" Jun 09 20:54:09.213449 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212846 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4010dd68-a50f-479f-a86f-2aecbc8e67e1-env-overrides\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.213449 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212853 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-run\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.213449 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212867 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl6pr\" (UniqueName: \"kubernetes.io/projected/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-kube-api-access-hl6pr\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.214233 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212891 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trxjf\" (UniqueName: \"kubernetes.io/projected/85c3f42d-8e0c-48fb-86fd-1f8706950ee3-kube-api-access-trxjf\") pod \"aws-ebs-csi-driver-node-bx82d\" (UID: \"85c3f42d-8e0c-48fb-86fd-1f8706950ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx82d" Jun 09 20:54:09.214233 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212913 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdknt\" (UniqueName: \"kubernetes.io/projected/b15205f0-3a84-48f4-ad29-fc648c18c930-kube-api-access-hdknt\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.214233 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212938 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6fb5611b-d203-40d5-9ec8-f34df2fde783-iptables-alerter-script\") pod \"iptables-alerter-6gdmg\" (UID: \"6fb5611b-d203-40d5-9ec8-f34df2fde783\") " pod="openshift-network-operator/iptables-alerter-6gdmg" Jun 09 20:54:09.214233 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212959 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-tmp\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.214233 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212978 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-cnibin\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.214233 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.212996 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-multus-socket-dir-parent\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.214233 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.213017 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-host-run-netns\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.214233 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.213036 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-host-var-lib-cni-multus\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.214233 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.213055 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-etc-kubernetes\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.214233 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.213103 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-sys\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.214233 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.213194 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4010dd68-a50f-479f-a86f-2aecbc8e67e1-ovnkube-config\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.214233 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.213336 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-sys\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.214233 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.213469 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4010dd68-a50f-479f-a86f-2aecbc8e67e1-env-overrides\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.214233 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.213526 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-var-lib-kubelet\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.214233 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.213577 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2b57eb2c-1312-4faa-9ce2-ad5890cf41ee-dbus\") pod \"global-pull-secret-syncer-2chl4\" (UID: \"2b57eb2c-1312-4faa-9ce2-ad5890cf41ee\") " pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:09.214233 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.213666 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td4xl\" (UniqueName: \"kubernetes.io/projected/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-kube-api-access-td4xl\") pod \"network-metrics-daemon-dwxkr\" (UID: \"c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae\") " pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:54:09.214233 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.213817 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-etc-sysconfig\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.215051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.213843 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/234cd6b9-9e32-4cf9-94c4-2bb0053ff04c-cnibin\") pod \"multus-additional-cni-plugins-fgz4b\" (UID: \"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c\") " pod="openshift-multus/multus-additional-cni-plugins-fgz4b" Jun 09 20:54:09.215051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.213867 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-host-var-lib-cni-bin\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.215051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.213907 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-host-var-lib-kubelet\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.215051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.213929 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-host-slash\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.215051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.213951 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-etc-sysctl-d\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.215051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.213997 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6fb5611b-d203-40d5-9ec8-f34df2fde783-iptables-alerter-script\") pod \"iptables-alerter-6gdmg\" (UID: \"6fb5611b-d203-40d5-9ec8-f34df2fde783\") " pod="openshift-network-operator/iptables-alerter-6gdmg" Jun 09 20:54:09.215051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214005 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/234cd6b9-9e32-4cf9-94c4-2bb0053ff04c-system-cni-dir\") pod \"multus-additional-cni-plugins-fgz4b\" (UID: \"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c\") " pod="openshift-multus/multus-additional-cni-plugins-fgz4b" Jun 09 20:54:09.215051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214040 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/234cd6b9-9e32-4cf9-94c4-2bb0053ff04c-os-release\") pod \"multus-additional-cni-plugins-fgz4b\" (UID: \"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c\") " pod="openshift-multus/multus-additional-cni-plugins-fgz4b" Jun 09 20:54:09.215051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214065 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/234cd6b9-9e32-4cf9-94c4-2bb0053ff04c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fgz4b\" (UID: \"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c\") " pod="openshift-multus/multus-additional-cni-plugins-fgz4b" Jun 09 20:54:09.215051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214067 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-etc-sysconfig\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.215051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214119 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-system-cni-dir\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.215051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214167 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b57eb2c-1312-4faa-9ce2-ad5890cf41ee-original-pull-secret\") pod \"global-pull-secret-syncer-2chl4\" (UID: \"2b57eb2c-1312-4faa-9ce2-ad5890cf41ee\") " pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:09.215051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214193 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/85c3f42d-8e0c-48fb-86fd-1f8706950ee3-registration-dir\") pod \"aws-ebs-csi-driver-node-bx82d\" (UID: \"85c3f42d-8e0c-48fb-86fd-1f8706950ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx82d" Jun 09 20:54:09.215051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214231 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-run-systemd\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.215051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214242 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-host-slash\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.215051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214267 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48ea32f0-3aed-49d4-bd34-2c0bc6a8b251-tmp-dir\") pod \"node-resolver-jzlgv\" (UID: \"48ea32f0-3aed-49d4-bd34-2c0bc6a8b251\") " pod="openshift-dns/node-resolver-jzlgv" Jun 09 20:54:09.215051 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214293 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-host\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.215601 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214324 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/85c3f42d-8e0c-48fb-86fd-1f8706950ee3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bx82d\" (UID: \"85c3f42d-8e0c-48fb-86fd-1f8706950ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx82d" Jun 09 20:54:09.215601 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214353 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-etc-openvswitch\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.215601 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214394 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-etc-modprobe-d\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.215601 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214201 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2b57eb2c-1312-4faa-9ce2-ad5890cf41ee-dbus\") pod \"global-pull-secret-syncer-2chl4\" (UID: \"2b57eb2c-1312-4faa-9ce2-ad5890cf41ee\") " pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:09.215601 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214490 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-etc-sysctl-conf\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.215601 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214515 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/48ea32f0-3aed-49d4-bd34-2c0bc6a8b251-hosts-file\") pod \"node-resolver-jzlgv\" (UID: \"48ea32f0-3aed-49d4-bd34-2c0bc6a8b251\") " pod="openshift-dns/node-resolver-jzlgv" Jun 09 20:54:09.215601 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214551 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-etc-sysctl-d\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.215601 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214553 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b15205f0-3a84-48f4-ad29-fc648c18c930-multus-daemon-config\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.215601 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214592 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/85c3f42d-8e0c-48fb-86fd-1f8706950ee3-etc-selinux\") pod \"aws-ebs-csi-driver-node-bx82d\" (UID: \"85c3f42d-8e0c-48fb-86fd-1f8706950ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx82d" Jun 09 20:54:09.215601 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214622 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqkmb\" (UniqueName: \"kubernetes.io/projected/6fb5611b-d203-40d5-9ec8-f34df2fde783-kube-api-access-cqkmb\") pod \"iptables-alerter-6gdmg\" (UID: \"6fb5611b-d203-40d5-9ec8-f34df2fde783\") " pod="openshift-network-operator/iptables-alerter-6gdmg" Jun 09 20:54:09.215601 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214635 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-etc-modprobe-d\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.215601 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214649 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-systemd-units\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.215601 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214674 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-lib-modules\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.215601 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214702 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-multus-conf-dir\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.215601 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:09.214707 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 20:54:09.215601 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214766 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-host-run-multus-certs\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.215601 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214794 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-var-lib-openvswitch\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.215601 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214818 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4010dd68-a50f-479f-a86f-2aecbc8e67e1-ovnkube-script-lib\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.216534 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214843 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-metrics-certs\") pod \"network-metrics-daemon-dwxkr\" (UID: \"c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae\") " pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:54:09.216534 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214865 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-etc-tuned\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.216534 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214888 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/234cd6b9-9e32-4cf9-94c4-2bb0053ff04c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fgz4b\" (UID: \"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c\") " pod="openshift-multus/multus-additional-cni-plugins-fgz4b" Jun 09 20:54:09.216534 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214930 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-os-release\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.216534 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214953 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b15205f0-3a84-48f4-ad29-fc648c18c930-cni-binary-copy\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.216534 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.214977 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/234cd6b9-9e32-4cf9-94c4-2bb0053ff04c-cni-binary-copy\") pod \"multus-additional-cni-plugins-fgz4b\" (UID: \"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c\") " pod="openshift-multus/multus-additional-cni-plugins-fgz4b" Jun 09 20:54:09.216534 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.215004 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-host-run-ovn-kubernetes\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.216534 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.215027 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/85c3f42d-8e0c-48fb-86fd-1f8706950ee3-socket-dir\") pod \"aws-ebs-csi-driver-node-bx82d\" (UID: \"85c3f42d-8e0c-48fb-86fd-1f8706950ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx82d" Jun 09 20:54:09.216534 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.215161 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-etc-sysctl-conf\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.216534 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.215170 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/85c3f42d-8e0c-48fb-86fd-1f8706950ee3-socket-dir\") pod \"aws-ebs-csi-driver-node-bx82d\" (UID: \"85c3f42d-8e0c-48fb-86fd-1f8706950ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx82d" Jun 09 20:54:09.216534 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.215212 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-systemd-units\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.216534 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:09.215246 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b57eb2c-1312-4faa-9ce2-ad5890cf41ee-original-pull-secret podName:2b57eb2c-1312-4faa-9ce2-ad5890cf41ee nodeName:}" failed. No retries permitted until 2026-06-09 20:54:09.715212273 +0000 UTC m=+2.050901489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b57eb2c-1312-4faa-9ce2-ad5890cf41ee-original-pull-secret") pod "global-pull-secret-syncer-2chl4" (UID: "2b57eb2c-1312-4faa-9ce2-ad5890cf41ee") : object "kube-system"/"original-pull-secret" not registered Jun 09 20:54:09.216534 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.215296 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/85c3f42d-8e0c-48fb-86fd-1f8706950ee3-registration-dir\") pod \"aws-ebs-csi-driver-node-bx82d\" (UID: \"85c3f42d-8e0c-48fb-86fd-1f8706950ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx82d" Jun 09 20:54:09.216534 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.215301 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-lib-modules\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.216534 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.215342 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-run-systemd\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.216534 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.215350 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-var-lib-openvswitch\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.217324 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.215409 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-host\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.217324 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.215408 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/85c3f42d-8e0c-48fb-86fd-1f8706950ee3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bx82d\" (UID: \"85c3f42d-8e0c-48fb-86fd-1f8706950ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx82d" Jun 09 20:54:09.217324 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.215434 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-etc-openvswitch\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.217324 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.215494 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/85c3f42d-8e0c-48fb-86fd-1f8706950ee3-etc-selinux\") pod \"aws-ebs-csi-driver-node-bx82d\" (UID: \"85c3f42d-8e0c-48fb-86fd-1f8706950ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx82d" Jun 09 20:54:09.217324 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:09.215497 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 20:54:09.217324 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:09.215541 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-metrics-certs podName:c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae nodeName:}" failed. No retries permitted until 2026-06-09 20:54:09.715529142 +0000 UTC m=+2.051218340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-metrics-certs") pod "network-metrics-daemon-dwxkr" (UID: "c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 20:54:09.217324 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.216283 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-tmp\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.217324 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.216330 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4010dd68-a50f-479f-a86f-2aecbc8e67e1-ovn-node-metrics-cert\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.217324 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.216420 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4010dd68-a50f-479f-a86f-2aecbc8e67e1-host-run-ovn-kubernetes\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.217324 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.216883 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4010dd68-a50f-479f-a86f-2aecbc8e67e1-ovnkube-script-lib\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.217324 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.217213 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a5e543bf-3df6-477f-8da3-262352b84b30-konnectivity-ca\") pod \"konnectivity-agent-p7x4f\" (UID: \"a5e543bf-3df6-477f-8da3-262352b84b30\") " pod="kube-system/konnectivity-agent-p7x4f" Jun 09 20:54:09.217324 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.217249 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a5e543bf-3df6-477f-8da3-262352b84b30-agent-certs\") pod \"konnectivity-agent-p7x4f\" (UID: \"a5e543bf-3df6-477f-8da3-262352b84b30\") " pod="kube-system/konnectivity-agent-p7x4f" Jun 09 20:54:09.217815 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.217781 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-etc-tuned\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.218313 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:09.218291 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 20:54:09.218313 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:09.218318 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 20:54:09.218313 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:09.218331 2557 projected.go:196] Error preparing data for projected volume kube-api-access-f9nr8 for pod openshift-network-diagnostics/network-check-target-ddvmc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 20:54:09.218576 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:09.218418 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0a3351e-dc59-4816-87ea-7a918f8c03ab-kube-api-access-f9nr8 podName:c0a3351e-dc59-4816-87ea-7a918f8c03ab nodeName:}" failed. No retries permitted until 2026-06-09 20:54:09.718385913 +0000 UTC m=+2.054075108 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f9nr8" (UniqueName: "kubernetes.io/projected/c0a3351e-dc59-4816-87ea-7a918f8c03ab-kube-api-access-f9nr8") pod "network-check-target-ddvmc" (UID: "c0a3351e-dc59-4816-87ea-7a918f8c03ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 20:54:09.220511 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.220486 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl6pr\" (UniqueName: \"kubernetes.io/projected/3c52be6f-c3a2-4eae-b9c8-b5d3f3002170-kube-api-access-hl6pr\") pod \"tuned-48922\" (UID: \"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170\") " pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.220909 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.220888 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m8gr\" (UniqueName: \"kubernetes.io/projected/4010dd68-a50f-479f-a86f-2aecbc8e67e1-kube-api-access-7m8gr\") pod \"ovnkube-node-5l764\" (UID: \"4010dd68-a50f-479f-a86f-2aecbc8e67e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.220979 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.220907 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trxjf\" (UniqueName: \"kubernetes.io/projected/85c3f42d-8e0c-48fb-86fd-1f8706950ee3-kube-api-access-trxjf\") pod \"aws-ebs-csi-driver-node-bx82d\" (UID: \"85c3f42d-8e0c-48fb-86fd-1f8706950ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx82d" Jun 09 20:54:09.221415 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.221396 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-td4xl\" (UniqueName: \"kubernetes.io/projected/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-kube-api-access-td4xl\") pod \"network-metrics-daemon-dwxkr\" (UID: \"c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae\") " pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:54:09.224999 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.224971 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqkmb\" (UniqueName: \"kubernetes.io/projected/6fb5611b-d203-40d5-9ec8-f34df2fde783-kube-api-access-cqkmb\") pod \"iptables-alerter-6gdmg\" (UID: \"6fb5611b-d203-40d5-9ec8-f34df2fde783\") " pod="openshift-network-operator/iptables-alerter-6gdmg" Jun 09 20:54:09.315628 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.315595 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/234cd6b9-9e32-4cf9-94c4-2bb0053ff04c-cnibin\") pod \"multus-additional-cni-plugins-fgz4b\" (UID: \"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c\") " pod="openshift-multus/multus-additional-cni-plugins-fgz4b" Jun 09 20:54:09.315628 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.315631 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-host-var-lib-cni-bin\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.315836 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.315649 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-host-var-lib-kubelet\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.315836 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.315674 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/234cd6b9-9e32-4cf9-94c4-2bb0053ff04c-system-cni-dir\") pod \"multus-additional-cni-plugins-fgz4b\" (UID: \"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c\") " pod="openshift-multus/multus-additional-cni-plugins-fgz4b" Jun 09 20:54:09.315836 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.315695 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/234cd6b9-9e32-4cf9-94c4-2bb0053ff04c-os-release\") pod \"multus-additional-cni-plugins-fgz4b\" (UID: \"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c\") " pod="openshift-multus/multus-additional-cni-plugins-fgz4b" Jun 09 20:54:09.315836 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.315708 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/234cd6b9-9e32-4cf9-94c4-2bb0053ff04c-cnibin\") pod \"multus-additional-cni-plugins-fgz4b\" (UID: \"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c\") " pod="openshift-multus/multus-additional-cni-plugins-fgz4b" Jun 09 20:54:09.315836 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.315717 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/234cd6b9-9e32-4cf9-94c4-2bb0053ff04c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fgz4b\" (UID: \"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c\") " pod="openshift-multus/multus-additional-cni-plugins-fgz4b" Jun 09 20:54:09.315836 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.315733 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-host-var-lib-kubelet\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.315836 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.315758 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/234cd6b9-9e32-4cf9-94c4-2bb0053ff04c-system-cni-dir\") pod \"multus-additional-cni-plugins-fgz4b\" (UID: \"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c\") " pod="openshift-multus/multus-additional-cni-plugins-fgz4b" Jun 09 20:54:09.315836 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.315733 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-host-var-lib-cni-bin\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.315836 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.315764 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-system-cni-dir\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.315836 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.315803 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-system-cni-dir\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.315836 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.315806 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/234cd6b9-9e32-4cf9-94c4-2bb0053ff04c-os-release\") pod \"multus-additional-cni-plugins-fgz4b\" (UID: \"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c\") " pod="openshift-multus/multus-additional-cni-plugins-fgz4b" Jun 09 20:54:09.315836 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.315819 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48ea32f0-3aed-49d4-bd34-2c0bc6a8b251-tmp-dir\") pod \"node-resolver-jzlgv\" (UID: \"48ea32f0-3aed-49d4-bd34-2c0bc6a8b251\") " pod="openshift-dns/node-resolver-jzlgv" Jun 09 20:54:09.316435 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.315851 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/48ea32f0-3aed-49d4-bd34-2c0bc6a8b251-hosts-file\") pod \"node-resolver-jzlgv\" (UID: \"48ea32f0-3aed-49d4-bd34-2c0bc6a8b251\") " pod="openshift-dns/node-resolver-jzlgv" Jun 09 20:54:09.316435 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.315870 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b15205f0-3a84-48f4-ad29-fc648c18c930-multus-daemon-config\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.316435 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.315887 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-multus-conf-dir\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.316435 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.315890 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/234cd6b9-9e32-4cf9-94c4-2bb0053ff04c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fgz4b\" (UID: \"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c\") " pod="openshift-multus/multus-additional-cni-plugins-fgz4b" Jun 09 20:54:09.316435 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.315913 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/48ea32f0-3aed-49d4-bd34-2c0bc6a8b251-hosts-file\") pod \"node-resolver-jzlgv\" (UID: \"48ea32f0-3aed-49d4-bd34-2c0bc6a8b251\") " pod="openshift-dns/node-resolver-jzlgv" Jun 09 20:54:09.316435 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.315927 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-multus-conf-dir\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.316435 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.315987 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-host-run-multus-certs\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.316435 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316012 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-host-run-multus-certs\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.316435 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316022 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/234cd6b9-9e32-4cf9-94c4-2bb0053ff04c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fgz4b\" (UID: \"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c\") " pod="openshift-multus/multus-additional-cni-plugins-fgz4b" Jun 09 20:54:09.316435 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316039 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-os-release\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.316435 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316054 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b15205f0-3a84-48f4-ad29-fc648c18c930-cni-binary-copy\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.316435 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316069 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/234cd6b9-9e32-4cf9-94c4-2bb0053ff04c-cni-binary-copy\") pod \"multus-additional-cni-plugins-fgz4b\" (UID: \"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c\") " pod="openshift-multus/multus-additional-cni-plugins-fgz4b" Jun 09 20:54:09.316435 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316088 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/84c09f0a-64ef-41e7-b1ca-c16ae3eeb4f9-serviceca\") pod \"node-ca-7dxwm\" (UID: \"84c09f0a-64ef-41e7-b1ca-c16ae3eeb4f9\") " pod="openshift-image-registry/node-ca-7dxwm" Jun 09 20:54:09.316435 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316108 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-multus-cni-dir\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.316435 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316142 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84c09f0a-64ef-41e7-b1ca-c16ae3eeb4f9-host\") pod \"node-ca-7dxwm\" (UID: \"84c09f0a-64ef-41e7-b1ca-c16ae3eeb4f9\") " pod="openshift-image-registry/node-ca-7dxwm" Jun 09 20:54:09.316435 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316144 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48ea32f0-3aed-49d4-bd34-2c0bc6a8b251-tmp-dir\") pod \"node-resolver-jzlgv\" (UID: \"48ea32f0-3aed-49d4-bd34-2c0bc6a8b251\") " pod="openshift-dns/node-resolver-jzlgv" Jun 09 20:54:09.316435 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316164 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4rdr\" (UniqueName: \"kubernetes.io/projected/84c09f0a-64ef-41e7-b1ca-c16ae3eeb4f9-kube-api-access-q4rdr\") pod \"node-ca-7dxwm\" (UID: \"84c09f0a-64ef-41e7-b1ca-c16ae3eeb4f9\") " pod="openshift-image-registry/node-ca-7dxwm" Jun 09 20:54:09.316435 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316224 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-multus-cni-dir\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.317156 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316257 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-hostroot\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.317156 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316286 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/234cd6b9-9e32-4cf9-94c4-2bb0053ff04c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fgz4b\" (UID: \"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c\") " pod="openshift-multus/multus-additional-cni-plugins-fgz4b" Jun 09 20:54:09.317156 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316314 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxp4w\" (UniqueName: \"kubernetes.io/projected/234cd6b9-9e32-4cf9-94c4-2bb0053ff04c-kube-api-access-cxp4w\") pod \"multus-additional-cni-plugins-fgz4b\" (UID: \"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c\") " pod="openshift-multus/multus-additional-cni-plugins-fgz4b" Jun 09 20:54:09.317156 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316345 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-host-run-k8s-cni-cncf-io\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.317156 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316411 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqn55\" (UniqueName: \"kubernetes.io/projected/48ea32f0-3aed-49d4-bd34-2c0bc6a8b251-kube-api-access-tqn55\") pod \"node-resolver-jzlgv\" (UID: \"48ea32f0-3aed-49d4-bd34-2c0bc6a8b251\") " pod="openshift-dns/node-resolver-jzlgv" Jun 09 20:54:09.317156 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316452 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdknt\" (UniqueName: \"kubernetes.io/projected/b15205f0-3a84-48f4-ad29-fc648c18c930-kube-api-access-hdknt\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.317156 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316477 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-cnibin\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.317156 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316501 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-multus-socket-dir-parent\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.317156 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316516 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84c09f0a-64ef-41e7-b1ca-c16ae3eeb4f9-host\") pod \"node-ca-7dxwm\" (UID: \"84c09f0a-64ef-41e7-b1ca-c16ae3eeb4f9\") " pod="openshift-image-registry/node-ca-7dxwm" Jun 09 20:54:09.317156 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316523 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-host-run-netns\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.317156 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316524 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b15205f0-3a84-48f4-ad29-fc648c18c930-multus-daemon-config\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.317156 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316550 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-host-var-lib-cni-multus\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.317156 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316574 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-etc-kubernetes\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.317156 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316600 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/234cd6b9-9e32-4cf9-94c4-2bb0053ff04c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fgz4b\" (UID: \"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c\") " pod="openshift-multus/multus-additional-cni-plugins-fgz4b" Jun 09 20:54:09.317156 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316631 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b15205f0-3a84-48f4-ad29-fc648c18c930-cni-binary-copy\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.317156 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316650 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/234cd6b9-9e32-4cf9-94c4-2bb0053ff04c-cni-binary-copy\") pod \"multus-additional-cni-plugins-fgz4b\" (UID: \"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c\") " pod="openshift-multus/multus-additional-cni-plugins-fgz4b" Jun 09 20:54:09.317156 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316660 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-cnibin\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.317156 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316632 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/84c09f0a-64ef-41e7-b1ca-c16ae3eeb4f9-serviceca\") pod \"node-ca-7dxwm\" (UID: \"84c09f0a-64ef-41e7-b1ca-c16ae3eeb4f9\") " pod="openshift-image-registry/node-ca-7dxwm" Jun 09 20:54:09.317652 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316686 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-host-run-k8s-cni-cncf-io\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.317652 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316660 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-host-var-lib-cni-multus\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.317652 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316717 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-etc-kubernetes\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.317652 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316722 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-multus-socket-dir-parent\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.317652 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316733 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-host-run-netns\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.317652 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316769 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-hostroot\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.317652 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.316823 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b15205f0-3a84-48f4-ad29-fc648c18c930-os-release\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.317652 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.317633 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/234cd6b9-9e32-4cf9-94c4-2bb0053ff04c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fgz4b\" (UID: \"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c\") " pod="openshift-multus/multus-additional-cni-plugins-fgz4b" Jun 09 20:54:09.323952 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.323932 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxp4w\" (UniqueName: \"kubernetes.io/projected/234cd6b9-9e32-4cf9-94c4-2bb0053ff04c-kube-api-access-cxp4w\") pod \"multus-additional-cni-plugins-fgz4b\" (UID: \"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c\") " pod="openshift-multus/multus-additional-cni-plugins-fgz4b" Jun 09 20:54:09.324050 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.323953 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdknt\" (UniqueName: \"kubernetes.io/projected/b15205f0-3a84-48f4-ad29-fc648c18c930-kube-api-access-hdknt\") pod \"multus-pcpkv\" (UID: \"b15205f0-3a84-48f4-ad29-fc648c18c930\") " pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.324387 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.324352 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqn55\" (UniqueName: \"kubernetes.io/projected/48ea32f0-3aed-49d4-bd34-2c0bc6a8b251-kube-api-access-tqn55\") pod \"node-resolver-jzlgv\" (UID: \"48ea32f0-3aed-49d4-bd34-2c0bc6a8b251\") " pod="openshift-dns/node-resolver-jzlgv" Jun 09 20:54:09.324469 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.324395 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4rdr\" (UniqueName: \"kubernetes.io/projected/84c09f0a-64ef-41e7-b1ca-c16ae3eeb4f9-kube-api-access-q4rdr\") pod \"node-ca-7dxwm\" (UID: \"84c09f0a-64ef-41e7-b1ca-c16ae3eeb4f9\") " pod="openshift-image-registry/node-ca-7dxwm" Jun 09 20:54:09.428939 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.428834 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p7x4f" Jun 09 20:54:09.438812 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:09.438784 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5e543bf_3df6_477f_8da3_262352b84b30.slice/crio-df54fb1b3bf84cd6db6b39b125df868b3113a2b8796e9315dc656bcc28ad0e43 WatchSource:0}: Error finding container df54fb1b3bf84cd6db6b39b125df868b3113a2b8796e9315dc656bcc28ad0e43: Status 404 returned error can't find the container with id df54fb1b3bf84cd6db6b39b125df868b3113a2b8796e9315dc656bcc28ad0e43 Jun 09 20:54:09.446359 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.446335 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-48922" Jun 09 20:54:09.454526 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:09.454502 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c52be6f_c3a2_4eae_b9c8_b5d3f3002170.slice/crio-9f743e2c58b496b1cf73eebc0c0345395bf885e83404eba8baff78eb9b961e4f WatchSource:0}: Error finding container 9f743e2c58b496b1cf73eebc0c0345395bf885e83404eba8baff78eb9b961e4f: Status 404 returned error can't find the container with id 9f743e2c58b496b1cf73eebc0c0345395bf885e83404eba8baff78eb9b961e4f Jun 09 20:54:09.463089 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.463064 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6gdmg" Jun 09 20:54:09.471290 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:09.471252 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fb5611b_d203_40d5_9ec8_f34df2fde783.slice/crio-a45ec835321745912834f15f243615a815cdc6f1c8150d0b5640746eba9454fd WatchSource:0}: Error finding container a45ec835321745912834f15f243615a815cdc6f1c8150d0b5640746eba9454fd: Status 404 returned error can't find the container with id a45ec835321745912834f15f243615a815cdc6f1c8150d0b5640746eba9454fd Jun 09 20:54:09.477829 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.477805 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:09.486118 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:09.486091 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4010dd68_a50f_479f_a86f_2aecbc8e67e1.slice/crio-6d6f5eabefd01786a62d7994d5c3a1a9ada0093e46e925c5a418830ef2123709 WatchSource:0}: Error finding container 6d6f5eabefd01786a62d7994d5c3a1a9ada0093e46e925c5a418830ef2123709: Status 404 returned error can't find the container with id 6d6f5eabefd01786a62d7994d5c3a1a9ada0093e46e925c5a418830ef2123709 Jun 09 20:54:09.511904 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.511864 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx82d" Jun 09 20:54:09.522163 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:09.521244 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85c3f42d_8e0c_48fb_86fd_1f8706950ee3.slice/crio-e898a6b32625f1972ba19eb79a03c831aa7b48b4e29830fbe819ab2d0377dfa4 WatchSource:0}: Error finding container e898a6b32625f1972ba19eb79a03c831aa7b48b4e29830fbe819ab2d0377dfa4: Status 404 returned error can't find the container with id e898a6b32625f1972ba19eb79a03c831aa7b48b4e29830fbe819ab2d0377dfa4 Jun 09 20:54:09.531816 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.531792 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jzlgv" Jun 09 20:54:09.538601 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.538580 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7dxwm" Jun 09 20:54:09.540659 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:09.540627 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48ea32f0_3aed_49d4_bd34_2c0bc6a8b251.slice/crio-db06e97b65b46c903c0dd97a69d3365e8e2e42bd92b5ff670a25acf696540b95 WatchSource:0}: Error finding container db06e97b65b46c903c0dd97a69d3365e8e2e42bd92b5ff670a25acf696540b95: Status 404 returned error can't find the container with id db06e97b65b46c903c0dd97a69d3365e8e2e42bd92b5ff670a25acf696540b95 Jun 09 20:54:09.542538 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.542521 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fgz4b" Jun 09 20:54:09.548654 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:09.548629 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84c09f0a_64ef_41e7_b1ca_c16ae3eeb4f9.slice/crio-eee71c0ed164fe3021041dbadbfb7e634aa7950255843aa185b0e9c2f04da2c3 WatchSource:0}: Error finding container eee71c0ed164fe3021041dbadbfb7e634aa7950255843aa185b0e9c2f04da2c3: Status 404 returned error can't find the container with id eee71c0ed164fe3021041dbadbfb7e634aa7950255843aa185b0e9c2f04da2c3 Jun 09 20:54:09.549933 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.549913 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pcpkv" Jun 09 20:54:09.551684 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:09.551664 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod234cd6b9_9e32_4cf9_94c4_2bb0053ff04c.slice/crio-e95346eff206955cec73aba885b6c394f1dc196a2fec9d955b28b12452f69a57 WatchSource:0}: Error finding container e95346eff206955cec73aba885b6c394f1dc196a2fec9d955b28b12452f69a57: Status 404 returned error can't find the container with id e95346eff206955cec73aba885b6c394f1dc196a2fec9d955b28b12452f69a57 Jun 09 20:54:09.559562 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:09.559537 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb15205f0_3a84_48f4_ad29_fc648c18c930.slice/crio-99b587a52afd2caba8ec23254c22dfbbf51e79313ef06745ace02bc1764633ba WatchSource:0}: Error finding container 99b587a52afd2caba8ec23254c22dfbbf51e79313ef06745ace02bc1764633ba: Status 404 returned error can't find the container with id 99b587a52afd2caba8ec23254c22dfbbf51e79313ef06745ace02bc1764633ba Jun 09 20:54:09.562495 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.562478 2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 20:54:09.720248 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.720163 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b57eb2c-1312-4faa-9ce2-ad5890cf41ee-original-pull-secret\") pod \"global-pull-secret-syncer-2chl4\" (UID: \"2b57eb2c-1312-4faa-9ce2-ad5890cf41ee\") " pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:09.720248 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.720226 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-metrics-certs\") pod \"network-metrics-daemon-dwxkr\" (UID: \"c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae\") " pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:54:09.720485 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:09.720284 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9nr8\" (UniqueName: \"kubernetes.io/projected/c0a3351e-dc59-4816-87ea-7a918f8c03ab-kube-api-access-f9nr8\") pod \"network-check-target-ddvmc\" (UID: \"c0a3351e-dc59-4816-87ea-7a918f8c03ab\") " pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:54:09.720485 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:09.720325 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 20:54:09.720485 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:09.720409 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 20:54:09.720485 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:09.720421 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 20:54:09.720485 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:09.720438 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b57eb2c-1312-4faa-9ce2-ad5890cf41ee-original-pull-secret podName:2b57eb2c-1312-4faa-9ce2-ad5890cf41ee nodeName:}" failed. No retries permitted until 2026-06-09 20:54:10.720418116 +0000 UTC m=+3.056107315 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b57eb2c-1312-4faa-9ce2-ad5890cf41ee-original-pull-secret") pod "global-pull-secret-syncer-2chl4" (UID: "2b57eb2c-1312-4faa-9ce2-ad5890cf41ee") : object "kube-system"/"original-pull-secret" not registered Jun 09 20:54:09.720485 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:09.720442 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 20:54:09.720485 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:09.720461 2557 projected.go:196] Error preparing data for projected volume kube-api-access-f9nr8 for pod openshift-network-diagnostics/network-check-target-ddvmc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 20:54:09.720485 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:09.720469 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-metrics-certs podName:c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae nodeName:}" failed. No retries permitted until 2026-06-09 20:54:10.720451038 +0000 UTC m=+3.056140224 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-metrics-certs") pod "network-metrics-daemon-dwxkr" (UID: "c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 20:54:09.720749 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:09.720500 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0a3351e-dc59-4816-87ea-7a918f8c03ab-kube-api-access-f9nr8 podName:c0a3351e-dc59-4816-87ea-7a918f8c03ab nodeName:}" failed. No retries permitted until 2026-06-09 20:54:10.720488959 +0000 UTC m=+3.056178163 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f9nr8" (UniqueName: "kubernetes.io/projected/c0a3351e-dc59-4816-87ea-7a918f8c03ab-kube-api-access-f9nr8") pod "network-check-target-ddvmc" (UID: "c0a3351e-dc59-4816-87ea-7a918f8c03ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 20:54:10.150145 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:10.149994 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 20:49:09 +0000 UTC" deadline="2027-11-06 22:12:32.900229122 +0000 UTC" Jun 09 20:54:10.150145 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:10.150036 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12361h18m22.750198782s" Jun 09 20:54:10.200024 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:10.199897 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pcpkv" event={"ID":"b15205f0-3a84-48f4-ad29-fc648c18c930","Type":"ContainerStarted","Data":"99b587a52afd2caba8ec23254c22dfbbf51e79313ef06745ace02bc1764633ba"} Jun 09 20:54:10.211447 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:10.209552 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fgz4b" event={"ID":"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c","Type":"ContainerStarted","Data":"e95346eff206955cec73aba885b6c394f1dc196a2fec9d955b28b12452f69a57"} Jun 09 20:54:10.213456 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:10.212149 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jzlgv" event={"ID":"48ea32f0-3aed-49d4-bd34-2c0bc6a8b251","Type":"ContainerStarted","Data":"db06e97b65b46c903c0dd97a69d3365e8e2e42bd92b5ff670a25acf696540b95"} Jun 09 20:54:10.225541 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:10.225500 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx82d" event={"ID":"85c3f42d-8e0c-48fb-86fd-1f8706950ee3","Type":"ContainerStarted","Data":"e898a6b32625f1972ba19eb79a03c831aa7b48b4e29830fbe819ab2d0377dfa4"} Jun 09 20:54:10.229099 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:10.229060 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l764" event={"ID":"4010dd68-a50f-479f-a86f-2aecbc8e67e1","Type":"ContainerStarted","Data":"6d6f5eabefd01786a62d7994d5c3a1a9ada0093e46e925c5a418830ef2123709"} Jun 09 20:54:10.231408 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:10.231360 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6gdmg" event={"ID":"6fb5611b-d203-40d5-9ec8-f34df2fde783","Type":"ContainerStarted","Data":"a45ec835321745912834f15f243615a815cdc6f1c8150d0b5640746eba9454fd"} Jun 09 20:54:10.235710 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:10.235639 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-48922" event={"ID":"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170","Type":"ContainerStarted","Data":"9f743e2c58b496b1cf73eebc0c0345395bf885e83404eba8baff78eb9b961e4f"} Jun 09 20:54:10.252617 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:10.252579 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-98.ec2.internal" event={"ID":"5c7806303e812afd18dcb7a11da25a9c","Type":"ContainerStarted","Data":"9ce734e1d0095ac7af9a2b01a3ef571538f3ff6e4c76888a592848765072c208"} Jun 09 20:54:10.262894 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:10.262850 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7dxwm" event={"ID":"84c09f0a-64ef-41e7-b1ca-c16ae3eeb4f9","Type":"ContainerStarted","Data":"eee71c0ed164fe3021041dbadbfb7e634aa7950255843aa185b0e9c2f04da2c3"} Jun 09 20:54:10.267391 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:10.267338 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p7x4f" event={"ID":"a5e543bf-3df6-477f-8da3-262352b84b30","Type":"ContainerStarted","Data":"df54fb1b3bf84cd6db6b39b125df868b3113a2b8796e9315dc656bcc28ad0e43"} Jun 09 20:54:10.286044 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:10.285998 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-98.ec2.internal" event={"ID":"c84ca1047407e2576b91867a00c296e0","Type":"ContainerStarted","Data":"278681e0c550ea0b2f68999a94e86d0b2d51974e3e5ce052021589788633faf1"} Jun 09 20:54:10.456719 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:10.456623 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 20:54:10.730672 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:10.730518 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b57eb2c-1312-4faa-9ce2-ad5890cf41ee-original-pull-secret\") pod \"global-pull-secret-syncer-2chl4\" (UID: \"2b57eb2c-1312-4faa-9ce2-ad5890cf41ee\") " pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:10.730672 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:10.730579 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-metrics-certs\") pod \"network-metrics-daemon-dwxkr\" (UID: \"c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae\") " pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:54:10.730672 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:10.730633 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9nr8\" (UniqueName: \"kubernetes.io/projected/c0a3351e-dc59-4816-87ea-7a918f8c03ab-kube-api-access-f9nr8\") pod \"network-check-target-ddvmc\" (UID: \"c0a3351e-dc59-4816-87ea-7a918f8c03ab\") " pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:54:10.730950 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:10.730806 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 20:54:10.730950 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:10.730828 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 20:54:10.730950 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:10.730841 2557 projected.go:196] Error preparing data for projected volume kube-api-access-f9nr8 for pod openshift-network-diagnostics/network-check-target-ddvmc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 20:54:10.730950 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:10.730898 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0a3351e-dc59-4816-87ea-7a918f8c03ab-kube-api-access-f9nr8 podName:c0a3351e-dc59-4816-87ea-7a918f8c03ab nodeName:}" failed. No retries permitted until 2026-06-09 20:54:12.730880317 +0000 UTC m=+5.066569520 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-f9nr8" (UniqueName: "kubernetes.io/projected/c0a3351e-dc59-4816-87ea-7a918f8c03ab-kube-api-access-f9nr8") pod "network-check-target-ddvmc" (UID: "c0a3351e-dc59-4816-87ea-7a918f8c03ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 20:54:10.731400 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:10.731324 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 20:54:10.731400 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:10.731364 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b57eb2c-1312-4faa-9ce2-ad5890cf41ee-original-pull-secret podName:2b57eb2c-1312-4faa-9ce2-ad5890cf41ee nodeName:}" failed. No retries permitted until 2026-06-09 20:54:12.731353728 +0000 UTC m=+5.067042910 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b57eb2c-1312-4faa-9ce2-ad5890cf41ee-original-pull-secret") pod "global-pull-secret-syncer-2chl4" (UID: "2b57eb2c-1312-4faa-9ce2-ad5890cf41ee") : object "kube-system"/"original-pull-secret" not registered Jun 09 20:54:10.731586 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:10.731434 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 20:54:10.731586 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:10.731462 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-metrics-certs podName:c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae nodeName:}" failed. No retries permitted until 2026-06-09 20:54:12.731451256 +0000 UTC m=+5.067140440 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-metrics-certs") pod "network-metrics-daemon-dwxkr" (UID: "c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 20:54:11.152555 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:11.152465 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 20:49:09 +0000 UTC" deadline="2027-11-04 10:27:47.64502539 +0000 UTC" Jun 09 20:54:11.152555 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:11.152508 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12301h33m36.492522795s" Jun 09 20:54:11.185422 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:11.185367 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:54:11.185595 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:11.185526 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddvmc" podUID="c0a3351e-dc59-4816-87ea-7a918f8c03ab" Jun 09 20:54:11.185972 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:11.185954 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:54:11.186076 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:11.186056 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwxkr" podUID="c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae" Jun 09 20:54:11.186141 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:11.186122 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:11.186245 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:11.186188 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2chl4" podUID="2b57eb2c-1312-4faa-9ce2-ad5890cf41ee" Jun 09 20:54:11.407917 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:11.407826 2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 20:54:11.475617 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:11.475553 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 20:54:12.746800 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:12.746761 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9nr8\" (UniqueName: \"kubernetes.io/projected/c0a3351e-dc59-4816-87ea-7a918f8c03ab-kube-api-access-f9nr8\") pod \"network-check-target-ddvmc\" (UID: \"c0a3351e-dc59-4816-87ea-7a918f8c03ab\") " pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:54:12.747282 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:12.746837 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b57eb2c-1312-4faa-9ce2-ad5890cf41ee-original-pull-secret\") pod \"global-pull-secret-syncer-2chl4\" (UID: \"2b57eb2c-1312-4faa-9ce2-ad5890cf41ee\") " pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:12.747282 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:12.746881 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-metrics-certs\") pod \"network-metrics-daemon-dwxkr\" (UID: \"c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae\") " pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:54:12.747282 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:12.747009 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 20:54:12.747282 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:12.747076 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-metrics-certs podName:c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae nodeName:}" failed. No retries permitted until 2026-06-09 20:54:16.747057401 +0000 UTC m=+9.082746589 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-metrics-certs") pod "network-metrics-daemon-dwxkr" (UID: "c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 20:54:12.747584 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:12.747472 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 20:54:12.747584 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:12.747490 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 20:54:12.747584 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:12.747505 2557 projected.go:196] Error preparing data for projected volume kube-api-access-f9nr8 for pod openshift-network-diagnostics/network-check-target-ddvmc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 20:54:12.747584 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:12.747535 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 20:54:12.747584 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:12.747549 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0a3351e-dc59-4816-87ea-7a918f8c03ab-kube-api-access-f9nr8 podName:c0a3351e-dc59-4816-87ea-7a918f8c03ab nodeName:}" failed. No retries permitted until 2026-06-09 20:54:16.747535246 +0000 UTC m=+9.083224449 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-f9nr8" (UniqueName: "kubernetes.io/projected/c0a3351e-dc59-4816-87ea-7a918f8c03ab-kube-api-access-f9nr8") pod "network-check-target-ddvmc" (UID: "c0a3351e-dc59-4816-87ea-7a918f8c03ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 20:54:12.747584 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:12.747576 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b57eb2c-1312-4faa-9ce2-ad5890cf41ee-original-pull-secret podName:2b57eb2c-1312-4faa-9ce2-ad5890cf41ee nodeName:}" failed. No retries permitted until 2026-06-09 20:54:16.747563008 +0000 UTC m=+9.083252205 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b57eb2c-1312-4faa-9ce2-ad5890cf41ee-original-pull-secret") pod "global-pull-secret-syncer-2chl4" (UID: "2b57eb2c-1312-4faa-9ce2-ad5890cf41ee") : object "kube-system"/"original-pull-secret" not registered Jun 09 20:54:13.185997 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:13.185961 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:54:13.186196 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:13.186097 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddvmc" podUID="c0a3351e-dc59-4816-87ea-7a918f8c03ab" Jun 09 20:54:13.186515 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:13.186491 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:54:13.186613 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:13.186597 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwxkr" podUID="c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae" Jun 09 20:54:13.186676 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:13.186637 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:13.186744 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:13.186690 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2chl4" podUID="2b57eb2c-1312-4faa-9ce2-ad5890cf41ee" Jun 09 20:54:15.185928 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:15.185899 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:54:15.186497 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:15.186042 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwxkr" podUID="c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae" Jun 09 20:54:15.186497 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:15.186481 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:15.186600 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:15.186577 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2chl4" podUID="2b57eb2c-1312-4faa-9ce2-ad5890cf41ee" Jun 09 20:54:15.186639 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:15.186621 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:54:15.186705 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:15.186683 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddvmc" podUID="c0a3351e-dc59-4816-87ea-7a918f8c03ab" Jun 09 20:54:16.782162 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:16.782113 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9nr8\" (UniqueName: \"kubernetes.io/projected/c0a3351e-dc59-4816-87ea-7a918f8c03ab-kube-api-access-f9nr8\") pod \"network-check-target-ddvmc\" (UID: \"c0a3351e-dc59-4816-87ea-7a918f8c03ab\") " pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:54:16.782621 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:16.782195 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b57eb2c-1312-4faa-9ce2-ad5890cf41ee-original-pull-secret\") pod \"global-pull-secret-syncer-2chl4\" (UID: \"2b57eb2c-1312-4faa-9ce2-ad5890cf41ee\") " pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:16.782621 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:16.782238 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-metrics-certs\") pod \"network-metrics-daemon-dwxkr\" (UID: \"c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae\") " pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:54:16.782621 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:16.782408 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 20:54:16.782621 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:16.782476 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-metrics-certs podName:c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae nodeName:}" failed. No retries permitted until 2026-06-09 20:54:24.782455803 +0000 UTC m=+17.118144986 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-metrics-certs") pod "network-metrics-daemon-dwxkr" (UID: "c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 20:54:16.782895 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:16.782867 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 20:54:16.782895 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:16.782893 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 20:54:16.783074 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:16.782906 2557 projected.go:196] Error preparing data for projected volume kube-api-access-f9nr8 for pod openshift-network-diagnostics/network-check-target-ddvmc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 20:54:16.783074 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:16.782946 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0a3351e-dc59-4816-87ea-7a918f8c03ab-kube-api-access-f9nr8 podName:c0a3351e-dc59-4816-87ea-7a918f8c03ab nodeName:}" failed. No retries permitted until 2026-06-09 20:54:24.782934679 +0000 UTC m=+17.118623861 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-f9nr8" (UniqueName: "kubernetes.io/projected/c0a3351e-dc59-4816-87ea-7a918f8c03ab-kube-api-access-f9nr8") pod "network-check-target-ddvmc" (UID: "c0a3351e-dc59-4816-87ea-7a918f8c03ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 20:54:16.783074 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:16.782996 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 20:54:16.783074 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:16.783018 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b57eb2c-1312-4faa-9ce2-ad5890cf41ee-original-pull-secret podName:2b57eb2c-1312-4faa-9ce2-ad5890cf41ee nodeName:}" failed. No retries permitted until 2026-06-09 20:54:24.783011569 +0000 UTC m=+17.118700751 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b57eb2c-1312-4faa-9ce2-ad5890cf41ee-original-pull-secret") pod "global-pull-secret-syncer-2chl4" (UID: "2b57eb2c-1312-4faa-9ce2-ad5890cf41ee") : object "kube-system"/"original-pull-secret" not registered Jun 09 20:54:17.185282 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:17.185199 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:54:17.185472 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:17.185199 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:17.185472 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:17.185321 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwxkr" podUID="c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae" Jun 09 20:54:17.185472 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:17.185199 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:54:17.185472 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:17.185406 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2chl4" podUID="2b57eb2c-1312-4faa-9ce2-ad5890cf41ee" Jun 09 20:54:17.185693 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:17.185469 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddvmc" podUID="c0a3351e-dc59-4816-87ea-7a918f8c03ab" Jun 09 20:54:19.185242 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:19.185199 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:54:19.185750 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:19.185333 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddvmc" podUID="c0a3351e-dc59-4816-87ea-7a918f8c03ab" Jun 09 20:54:19.185828 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:19.185761 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:54:19.186021 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:19.185872 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwxkr" podUID="c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae" Jun 09 20:54:19.186021 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:19.185925 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:19.186021 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:19.185986 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2chl4" podUID="2b57eb2c-1312-4faa-9ce2-ad5890cf41ee" Jun 09 20:54:21.185723 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:21.185678 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:54:21.185723 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:21.185705 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:54:21.186201 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:21.185705 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:21.186201 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:21.185831 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddvmc" podUID="c0a3351e-dc59-4816-87ea-7a918f8c03ab" Jun 09 20:54:21.186201 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:21.185978 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2chl4" podUID="2b57eb2c-1312-4faa-9ce2-ad5890cf41ee" Jun 09 20:54:21.186201 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:21.186063 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwxkr" podUID="c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae" Jun 09 20:54:23.185502 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:23.185461 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:54:23.185502 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:23.185484 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:54:23.185950 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:23.185474 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:23.185950 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:23.185656 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwxkr" podUID="c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae" Jun 09 20:54:23.185950 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:23.185768 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddvmc" podUID="c0a3351e-dc59-4816-87ea-7a918f8c03ab" Jun 09 20:54:23.185950 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:23.185851 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2chl4" podUID="2b57eb2c-1312-4faa-9ce2-ad5890cf41ee" Jun 09 20:54:24.847586 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:24.847548 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b57eb2c-1312-4faa-9ce2-ad5890cf41ee-original-pull-secret\") pod \"global-pull-secret-syncer-2chl4\" (UID: \"2b57eb2c-1312-4faa-9ce2-ad5890cf41ee\") " pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:24.847586 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:24.847594 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-metrics-certs\") pod \"network-metrics-daemon-dwxkr\" (UID: \"c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae\") " pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:54:24.848074 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:24.847638 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9nr8\" (UniqueName: \"kubernetes.io/projected/c0a3351e-dc59-4816-87ea-7a918f8c03ab-kube-api-access-f9nr8\") pod \"network-check-target-ddvmc\" (UID: \"c0a3351e-dc59-4816-87ea-7a918f8c03ab\") " pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:54:24.848074 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:24.847716 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 20:54:24.848074 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:24.847742 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 20:54:24.848074 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:24.847759 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 20:54:24.848074 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:24.847771 2557 projected.go:196] Error preparing data for projected volume kube-api-access-f9nr8 for pod openshift-network-diagnostics/network-check-target-ddvmc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 20:54:24.848074 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:24.847788 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b57eb2c-1312-4faa-9ce2-ad5890cf41ee-original-pull-secret podName:2b57eb2c-1312-4faa-9ce2-ad5890cf41ee nodeName:}" failed. No retries permitted until 2026-06-09 20:54:40.847769606 +0000 UTC m=+33.183458789 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b57eb2c-1312-4faa-9ce2-ad5890cf41ee-original-pull-secret") pod "global-pull-secret-syncer-2chl4" (UID: "2b57eb2c-1312-4faa-9ce2-ad5890cf41ee") : object "kube-system"/"original-pull-secret" not registered Jun 09 20:54:24.848074 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:24.847794 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 20:54:24.848074 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:24.847805 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0a3351e-dc59-4816-87ea-7a918f8c03ab-kube-api-access-f9nr8 podName:c0a3351e-dc59-4816-87ea-7a918f8c03ab nodeName:}" failed. No retries permitted until 2026-06-09 20:54:40.847794798 +0000 UTC m=+33.183483981 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-f9nr8" (UniqueName: "kubernetes.io/projected/c0a3351e-dc59-4816-87ea-7a918f8c03ab-kube-api-access-f9nr8") pod "network-check-target-ddvmc" (UID: "c0a3351e-dc59-4816-87ea-7a918f8c03ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 20:54:24.848074 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:24.847868 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-metrics-certs podName:c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae nodeName:}" failed. No retries permitted until 2026-06-09 20:54:40.847845517 +0000 UTC m=+33.183534715 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-metrics-certs") pod "network-metrics-daemon-dwxkr" (UID: "c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 20:54:25.185311 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:25.185281 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:25.185485 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:25.185320 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:54:25.185485 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:25.185319 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:54:25.185485 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:25.185409 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2chl4" podUID="2b57eb2c-1312-4faa-9ce2-ad5890cf41ee" Jun 09 20:54:25.185485 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:25.185452 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddvmc" podUID="c0a3351e-dc59-4816-87ea-7a918f8c03ab" Jun 09 20:54:25.185632 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:25.185515 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwxkr" podUID="c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae" Jun 09 20:54:27.185926 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:27.185882 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:54:27.186569 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:27.185883 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:27.186569 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:27.186020 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:54:27.186569 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:27.186014 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwxkr" podUID="c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae" Jun 09 20:54:27.186569 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:27.186088 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2chl4" podUID="2b57eb2c-1312-4faa-9ce2-ad5890cf41ee" Jun 09 20:54:27.186569 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:27.186216 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddvmc" podUID="c0a3351e-dc59-4816-87ea-7a918f8c03ab" Jun 09 20:54:29.185237 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:29.185196 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:54:29.185237 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:29.185239 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:29.185756 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:29.185245 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:54:29.185756 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:29.185354 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwxkr" podUID="c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae" Jun 09 20:54:29.185756 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:29.185432 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2chl4" podUID="2b57eb2c-1312-4faa-9ce2-ad5890cf41ee" Jun 09 20:54:29.185756 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:29.185511 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddvmc" podUID="c0a3351e-dc59-4816-87ea-7a918f8c03ab" Jun 09 20:54:31.185208 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:31.184939 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:31.186131 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:31.184939 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:54:31.186131 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:31.185005 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:54:31.186131 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:31.185325 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2chl4" podUID="2b57eb2c-1312-4faa-9ce2-ad5890cf41ee" Jun 09 20:54:31.186131 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:31.185416 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddvmc" podUID="c0a3351e-dc59-4816-87ea-7a918f8c03ab" Jun 09 20:54:31.186131 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:31.185521 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwxkr" podUID="c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae" Jun 09 20:54:31.342257 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:31.342135 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pcpkv" event={"ID":"b15205f0-3a84-48f4-ad29-fc648c18c930","Type":"ContainerStarted","Data":"c2f429e43ea8f612ab742bf79d6b18de52ad1df93c25d1265380a22c39530e04"} Jun 09 20:54:31.345437 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:31.345409 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l764_4010dd68-a50f-479f-a86f-2aecbc8e67e1/ovn-acl-logging/0.log" Jun 09 20:54:31.345769 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:31.345750 2557 generic.go:356] "Generic (PLEG): container finished" podID="4010dd68-a50f-479f-a86f-2aecbc8e67e1" containerID="2342385de3376ce33c7c06e9a43c9b0558aedfde36387a616945d13fdc34ae7f" exitCode=1 Jun 09 20:54:31.345857 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:31.345816 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l764" event={"ID":"4010dd68-a50f-479f-a86f-2aecbc8e67e1","Type":"ContainerStarted","Data":"adb31ecd4bafb6eb38211086cfe2f576d3d86da12a08b813ea3fb5bc5032ff55"} Jun 09 20:54:31.345905 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:31.345889 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l764" event={"ID":"4010dd68-a50f-479f-a86f-2aecbc8e67e1","Type":"ContainerStarted","Data":"b454164510c98a639df31c079557772535ac44d5bf8bdd15c689f2a0cd5d7096"} Jun 09 20:54:31.345947 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:31.345926 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l764" event={"ID":"4010dd68-a50f-479f-a86f-2aecbc8e67e1","Type":"ContainerStarted","Data":"af481e814814b04dce1cefe6e1cd338f40899ffcdcb8d6c9dec4e98c982e1756"} Jun 09 20:54:31.345989 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:31.345962 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l764" event={"ID":"4010dd68-a50f-479f-a86f-2aecbc8e67e1","Type":"ContainerStarted","Data":"e9bab49e7783a3beaa92ecd573923226378b8b80509959dc65391411504716db"} Jun 09 20:54:31.346021 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:31.345996 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l764" event={"ID":"4010dd68-a50f-479f-a86f-2aecbc8e67e1","Type":"ContainerDied","Data":"2342385de3376ce33c7c06e9a43c9b0558aedfde36387a616945d13fdc34ae7f"} Jun 09 20:54:31.346060 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:31.346035 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l764" event={"ID":"4010dd68-a50f-479f-a86f-2aecbc8e67e1","Type":"ContainerStarted","Data":"828b2b8f3943fb1971b9acb9bb979888fb52c7cff6c8caee0b71500a79e23e54"} Jun 09 20:54:31.347627 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:31.347592 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-48922" event={"ID":"3c52be6f-c3a2-4eae-b9c8-b5d3f3002170","Type":"ContainerStarted","Data":"e69a783e74791a7a142a599bc1e92ee9cbe079ef3350a2175db0c4488f9cf54c"} Jun 09 20:54:31.348974 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:31.348952 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-98.ec2.internal" event={"ID":"5c7806303e812afd18dcb7a11da25a9c","Type":"ContainerStarted","Data":"3e87bc6b6a526ce59e9218b5041bac1529ce0c5fcc34c0cf54fd44e7058dd1f4"} Jun 09 20:54:31.357987 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:31.357936 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pcpkv" podStartSLOduration=2.426796457 podStartE2EDuration="23.357921529s" totalImagesPullingTime="20.931125072s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 20:54:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:54:31.357395889 +0000 UTC m=+23.693085087" watchObservedRunningTime="2026-06-09 20:54:31.357921529 +0000 UTC m=+23.693610733" Jun 09 20:54:31.373067 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:31.372962 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-98.ec2.internal" podStartSLOduration=22.372940203 podStartE2EDuration="22.372940203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 20:54:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:54:31.372347293 +0000 UTC m=+23.708036496" watchObservedRunningTime="2026-06-09 20:54:31.372940203 +0000 UTC m=+23.708629408" Jun 09 20:54:31.388243 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:31.388191 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-48922" podStartSLOduration=2.516920174 podStartE2EDuration="23.388176606s" totalImagesPullingTime="20.871256432s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 20:54:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:54:31.386583211 +0000 UTC m=+23.722272417" watchObservedRunningTime="2026-06-09 20:54:31.388176606 +0000 UTC m=+23.723865816" Jun 09 20:54:32.353616 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:32.353567 2557 generic.go:356] "Generic (PLEG): container finished" podID="234cd6b9-9e32-4cf9-94c4-2bb0053ff04c" containerID="ec922b46db5a066a01f82a4fee8d2551579f9a384dc3c7042d76626da7efea42" exitCode=0 Jun 09 20:54:32.354186 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:32.353655 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fgz4b" event={"ID":"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c","Type":"ContainerDied","Data":"ec922b46db5a066a01f82a4fee8d2551579f9a384dc3c7042d76626da7efea42"} Jun 09 20:54:32.355833 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:32.355806 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jzlgv" event={"ID":"48ea32f0-3aed-49d4-bd34-2c0bc6a8b251","Type":"ContainerStarted","Data":"a1be87de934bf91139bbcd62ab2f7dbe610969890d7e7fd7646a76a786390ee6"} Jun 09 20:54:32.357951 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:32.357778 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx82d" event={"ID":"85c3f42d-8e0c-48fb-86fd-1f8706950ee3","Type":"ContainerStarted","Data":"7fe1e2e0f7e7073cac002cfea8e0b21c0bac041cee2c4f4122906cfa575bee33"} Jun 09 20:54:32.359368 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:32.359342 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6gdmg" event={"ID":"6fb5611b-d203-40d5-9ec8-f34df2fde783","Type":"ContainerStarted","Data":"ac13c6e188b2c12e5b124547723a4c8e682b3cafba18be758e53a7c062d42cc3"} Jun 09 20:54:32.361010 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:32.360984 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7dxwm" event={"ID":"84c09f0a-64ef-41e7-b1ca-c16ae3eeb4f9","Type":"ContainerStarted","Data":"b1778eeede126d5fee45c4959dbfcca7491baf5ba533df5f62b6d26c153dd2fd"} Jun 09 20:54:32.362555 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:32.362524 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p7x4f" event={"ID":"a5e543bf-3df6-477f-8da3-262352b84b30","Type":"ContainerStarted","Data":"7e7cedc9e5ed3ab3dde1c2447e434e620b6a110b0cb8a49e6d96e3666c1670d0"} Jun 09 20:54:32.364243 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:32.364216 2557 generic.go:356] "Generic (PLEG): container finished" podID="c84ca1047407e2576b91867a00c296e0" containerID="7fbda4640765244ab18dbc76080a1be56e858e214c82aff23fed9c2770ef6e29" exitCode=0 Jun 09 20:54:32.364341 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:32.364270 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-98.ec2.internal" event={"ID":"c84ca1047407e2576b91867a00c296e0","Type":"ContainerDied","Data":"7fbda4640765244ab18dbc76080a1be56e858e214c82aff23fed9c2770ef6e29"} Jun 09 20:54:32.388573 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:32.388518 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-p7x4f" podStartSLOduration=3.534377088 podStartE2EDuration="24.388503368s" totalImagesPullingTime="20.85412628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 20:54:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:54:32.388067469 +0000 UTC m=+24.723756673" watchObservedRunningTime="2026-06-09 20:54:32.388503368 +0000 UTC m=+24.724192572" Jun 09 20:54:32.400262 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:32.400206 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6gdmg" podStartSLOduration=3.545802867 podStartE2EDuration="24.400186822s" totalImagesPullingTime="20.854383955s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 20:54:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:54:32.400053888 +0000 UTC m=+24.735743092" watchObservedRunningTime="2026-06-09 20:54:32.400186822 +0000 UTC m=+24.735876029" Jun 09 20:54:32.425700 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:32.425016 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jzlgv" podStartSLOduration=3.604377985 podStartE2EDuration="24.424997672s" totalImagesPullingTime="20.820619687s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 20:54:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:54:32.424581271 +0000 UTC m=+24.760270479" watchObservedRunningTime="2026-06-09 20:54:32.424997672 +0000 UTC m=+24.760686876" Jun 09 20:54:32.439212 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:32.439157 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7dxwm" podStartSLOduration=3.629915388 podStartE2EDuration="24.439140355s" totalImagesPullingTime="20.809224967s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 20:54:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:54:32.438729661 +0000 UTC m=+24.774418864" watchObservedRunningTime="2026-06-09 20:54:32.439140355 +0000 UTC m=+24.774829559" Jun 09 20:54:32.747296 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:32.747271 2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 20:54:33.179406 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:33.179288 2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T20:54:32.747291785Z","UUID":"970626c3-5eba-425e-9192-309a893c4ff3","Handler":null,"Name":"","Endpoint":""} Jun 09 20:54:33.181307 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:33.181281 2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 20:54:33.181481 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:33.181328 2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 20:54:33.185755 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:33.185332 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:33.185755 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:33.185454 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:54:33.185755 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:33.185468 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2chl4" podUID="2b57eb2c-1312-4faa-9ce2-ad5890cf41ee" Jun 09 20:54:33.185755 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:33.185563 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddvmc" podUID="c0a3351e-dc59-4816-87ea-7a918f8c03ab" Jun 09 20:54:33.185755 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:33.185623 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:54:33.185755 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:33.185696 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwxkr" podUID="c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae" Jun 09 20:54:33.370581 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:33.370469 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx82d" event={"ID":"85c3f42d-8e0c-48fb-86fd-1f8706950ee3","Type":"ContainerStarted","Data":"6f6594958023734297dac0364c02d79967e4fed869e28edc64538da0b55f88c1"} Jun 09 20:54:33.374171 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:33.374137 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-98.ec2.internal" event={"ID":"c84ca1047407e2576b91867a00c296e0","Type":"ContainerStarted","Data":"2068ab6fbc81d1570c37d7149e56e1b3c95f58d7c79cb2660662b95d6b19e626"} Jun 09 20:54:33.388277 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:33.388226 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-98.ec2.internal" podStartSLOduration=24.388210011 podStartE2EDuration="24.388210011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 20:54:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:54:33.387885586 +0000 UTC m=+25.723574792" watchObservedRunningTime="2026-06-09 20:54:33.388210011 +0000 UTC m=+25.723899214" Jun 09 20:54:33.887707 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:33.887442 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-p7x4f" Jun 09 20:54:33.888077 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:33.888051 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-p7x4f" Jun 09 20:54:34.379319 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:34.379242 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx82d" event={"ID":"85c3f42d-8e0c-48fb-86fd-1f8706950ee3","Type":"ContainerStarted","Data":"a5191c6d0530cf121c209362f369a97d5ee51788dffafe19221bb0f6cc005ae6"} Jun 09 20:54:34.383306 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:34.383278 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l764_4010dd68-a50f-479f-a86f-2aecbc8e67e1/ovn-acl-logging/0.log" Jun 09 20:54:34.383794 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:34.383766 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l764" event={"ID":"4010dd68-a50f-479f-a86f-2aecbc8e67e1","Type":"ContainerStarted","Data":"c3cb1197d5c803d021acb85306857f9c33a4c116fcbbf0f784c36e5e2b849f51"} Jun 09 20:54:34.383899 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:34.383865 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-p7x4f" Jun 09 20:54:34.384434 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:34.384415 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-p7x4f" Jun 09 20:54:34.395526 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:34.395467 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx82d" podStartSLOduration=3.443701128 podStartE2EDuration="26.395448694s" totalImagesPullingTime="22.951747566s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 20:54:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:54:34.395412658 +0000 UTC m=+26.731101864" watchObservedRunningTime="2026-06-09 20:54:34.395448694 +0000 UTC m=+26.731137899" Jun 09 20:54:35.185405 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:35.185008 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:54:35.185405 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:35.185039 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:54:35.185405 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:35.185134 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:35.185405 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:35.185148 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddvmc" podUID="c0a3351e-dc59-4816-87ea-7a918f8c03ab" Jun 09 20:54:35.185405 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:35.185255 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2chl4" podUID="2b57eb2c-1312-4faa-9ce2-ad5890cf41ee" Jun 09 20:54:35.185405 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:35.185355 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwxkr" podUID="c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae" Jun 09 20:54:37.185831 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:37.185645 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:54:37.186477 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:37.185649 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:54:37.186477 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:37.185920 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwxkr" podUID="c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae" Jun 09 20:54:37.186477 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:37.185681 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:37.186477 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:37.185991 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddvmc" podUID="c0a3351e-dc59-4816-87ea-7a918f8c03ab" Jun 09 20:54:37.186477 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:37.186079 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2chl4" podUID="2b57eb2c-1312-4faa-9ce2-ad5890cf41ee" Jun 09 20:54:37.392538 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:37.392506 2557 generic.go:356] "Generic (PLEG): container finished" podID="234cd6b9-9e32-4cf9-94c4-2bb0053ff04c" containerID="bc36710a21bb0c56b5fe27e1f5bd2fc47c362357095710156d45272a560e355a" exitCode=0 Jun 09 20:54:37.392703 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:37.392595 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fgz4b" event={"ID":"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c","Type":"ContainerDied","Data":"bc36710a21bb0c56b5fe27e1f5bd2fc47c362357095710156d45272a560e355a"} Jun 09 20:54:37.396068 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:37.396040 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l764_4010dd68-a50f-479f-a86f-2aecbc8e67e1/ovn-acl-logging/0.log" Jun 09 20:54:37.396452 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:37.396431 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l764" event={"ID":"4010dd68-a50f-479f-a86f-2aecbc8e67e1","Type":"ContainerStarted","Data":"19f8a5bae849181d780104efe8a518074b2c5c7870dbd95583c2b423bc09179e"} Jun 09 20:54:37.396725 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:37.396701 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:37.396798 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:37.396786 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:37.396866 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:37.396847 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:37.396973 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:37.396951 2557 scope.go:117] "RemoveContainer" containerID="2342385de3376ce33c7c06e9a43c9b0558aedfde36387a616945d13fdc34ae7f" Jun 09 20:54:37.414744 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:37.414714 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:37.414955 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:37.414941 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:54:38.408848 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:38.408825 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l764_4010dd68-a50f-479f-a86f-2aecbc8e67e1/ovn-acl-logging/0.log" Jun 09 20:54:38.409737 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:38.409686 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l764" event={"ID":"4010dd68-a50f-479f-a86f-2aecbc8e67e1","Type":"ContainerStarted","Data":"326233aef9d9586087a859446c4ae95d7caf6acd63f3d19d2c03d66ddf6f6ab8"} Jun 09 20:54:38.437171 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:38.434482 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5l764" podStartSLOduration=9.429982379 podStartE2EDuration="30.434457952s" totalImagesPullingTime="21.004475573s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 20:54:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:54:38.433069963 +0000 UTC m=+30.768759168" watchObservedRunningTime="2026-06-09 20:54:38.434457952 +0000 UTC m=+30.770147157" Jun 09 20:54:38.656686 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:38.656591 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ddvmc"] Jun 09 20:54:38.656864 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:38.656754 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:54:38.656864 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:38.656850 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddvmc" podUID="c0a3351e-dc59-4816-87ea-7a918f8c03ab" Jun 09 20:54:38.659333 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:38.659304 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dwxkr"] Jun 09 20:54:38.659493 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:38.659479 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:54:38.659625 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:38.659604 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwxkr" podUID="c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae" Jun 09 20:54:38.666969 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:38.666942 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2chl4"] Jun 09 20:54:38.667078 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:38.667053 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:38.667170 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:38.667148 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2chl4" podUID="2b57eb2c-1312-4faa-9ce2-ad5890cf41ee" Jun 09 20:54:39.413733 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:39.413700 2557 generic.go:356] "Generic (PLEG): container finished" podID="234cd6b9-9e32-4cf9-94c4-2bb0053ff04c" containerID="126f106f7fb6f376844c7c33e6d39137c34ce9b55c95822daed2bcb18eea85d7" exitCode=0 Jun 09 20:54:39.414133 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:39.413794 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fgz4b" event={"ID":"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c","Type":"ContainerDied","Data":"126f106f7fb6f376844c7c33e6d39137c34ce9b55c95822daed2bcb18eea85d7"} Jun 09 20:54:40.185313 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:40.185140 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:40.185468 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:40.185142 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:54:40.185468 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:40.185423 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2chl4" podUID="2b57eb2c-1312-4faa-9ce2-ad5890cf41ee" Jun 09 20:54:40.185582 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:40.185490 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwxkr" podUID="c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae" Jun 09 20:54:40.185582 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:40.185172 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:54:40.185684 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:40.185614 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddvmc" podUID="c0a3351e-dc59-4816-87ea-7a918f8c03ab" Jun 09 20:54:40.419002 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:40.418917 2557 generic.go:356] "Generic (PLEG): container finished" podID="234cd6b9-9e32-4cf9-94c4-2bb0053ff04c" containerID="be5625fb23aa3fd9c79d28887b1cb64068803959aacfc18a1fd31fc6a34819d8" exitCode=0 Jun 09 20:54:40.419783 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:40.419001 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fgz4b" event={"ID":"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c","Type":"ContainerDied","Data":"be5625fb23aa3fd9c79d28887b1cb64068803959aacfc18a1fd31fc6a34819d8"} Jun 09 20:54:40.862362 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:40.862318 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-metrics-certs\") pod \"network-metrics-daemon-dwxkr\" (UID: \"c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae\") " pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:54:40.862552 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:40.862474 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9nr8\" (UniqueName: \"kubernetes.io/projected/c0a3351e-dc59-4816-87ea-7a918f8c03ab-kube-api-access-f9nr8\") pod \"network-check-target-ddvmc\" (UID: \"c0a3351e-dc59-4816-87ea-7a918f8c03ab\") " pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:54:40.862552 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:40.862504 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 20:54:40.862552 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:40.862526 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b57eb2c-1312-4faa-9ce2-ad5890cf41ee-original-pull-secret\") pod \"global-pull-secret-syncer-2chl4\" (UID: \"2b57eb2c-1312-4faa-9ce2-ad5890cf41ee\") " pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:40.862664 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:40.862582 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-metrics-certs podName:c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae nodeName:}" failed. No retries permitted until 2026-06-09 20:55:12.862560391 +0000 UTC m=+65.198249576 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-metrics-certs") pod "network-metrics-daemon-dwxkr" (UID: "c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 20:54:40.862664 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:40.862622 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 20:54:40.862746 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:40.862667 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b57eb2c-1312-4faa-9ce2-ad5890cf41ee-original-pull-secret podName:2b57eb2c-1312-4faa-9ce2-ad5890cf41ee nodeName:}" failed. No retries permitted until 2026-06-09 20:55:12.862650313 +0000 UTC m=+65.198339522 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b57eb2c-1312-4faa-9ce2-ad5890cf41ee-original-pull-secret") pod "global-pull-secret-syncer-2chl4" (UID: "2b57eb2c-1312-4faa-9ce2-ad5890cf41ee") : object "kube-system"/"original-pull-secret" not registered Jun 09 20:54:40.862746 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:40.862726 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 20:54:40.862746 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:40.862743 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 20:54:40.862871 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:40.862757 2557 projected.go:196] Error preparing data for projected volume kube-api-access-f9nr8 for pod openshift-network-diagnostics/network-check-target-ddvmc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 20:54:40.862871 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:40.862783 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0a3351e-dc59-4816-87ea-7a918f8c03ab-kube-api-access-f9nr8 podName:c0a3351e-dc59-4816-87ea-7a918f8c03ab nodeName:}" failed. No retries permitted until 2026-06-09 20:55:12.862775281 +0000 UTC m=+65.198464462 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-f9nr8" (UniqueName: "kubernetes.io/projected/c0a3351e-dc59-4816-87ea-7a918f8c03ab-kube-api-access-f9nr8") pod "network-check-target-ddvmc" (UID: "c0a3351e-dc59-4816-87ea-7a918f8c03ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 20:54:42.185644 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:42.185603 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:54:42.186238 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:42.185603 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:54:42.186238 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:42.185756 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwxkr" podUID="c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae" Jun 09 20:54:42.186238 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:42.185614 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:42.186238 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:42.185830 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddvmc" podUID="c0a3351e-dc59-4816-87ea-7a918f8c03ab" Jun 09 20:54:42.186238 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:42.185902 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2chl4" podUID="2b57eb2c-1312-4faa-9ce2-ad5890cf41ee" Jun 09 20:54:43.513485 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.513451 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-98.ec2.internal" event="NodeReady" Jun 09 20:54:43.514093 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.513652 2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 20:54:43.546202 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.546150 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bf67c8ff7-crdj6"] Jun 09 20:54:43.584059 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.584027 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pnvwt"] Jun 09 20:54:43.584303 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.584180 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:54:43.586190 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.586159 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 20:54:43.586190 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.586184 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 20:54:43.586364 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.586245 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 20:54:43.586364 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.586274 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wzshz\"" Jun 09 20:54:43.591853 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.591816 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 20:54:43.598930 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.598892 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vdjv9"] Jun 09 20:54:43.599069 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.599021 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pnvwt" Jun 09 20:54:43.601403 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.601364 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 20:54:43.601676 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.601657 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 20:54:43.601855 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.601843 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d85mb\"" Jun 09 20:54:43.621006 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.620974 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bf67c8ff7-crdj6"] Jun 09 20:54:43.621006 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.621010 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pnvwt"] Jun 09 20:54:43.621211 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.621035 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vdjv9"] Jun 09 20:54:43.621211 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.621104 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vdjv9" Jun 09 20:54:43.623066 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.623045 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 20:54:43.623066 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.623061 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g7bh2\"" Jun 09 20:54:43.623249 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.623077 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 20:54:43.623311 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.623298 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 20:54:43.684886 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.684841 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-config-volume\") pod \"dns-default-pnvwt\" (UID: \"f27bc7c7-a410-4ec4-9b29-c9f1160d2271\") " pod="openshift-dns/dns-default-pnvwt" Jun 09 20:54:43.684886 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.684881 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tc9j\" (UniqueName: \"kubernetes.io/projected/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-kube-api-access-4tc9j\") pod \"dns-default-pnvwt\" (UID: \"f27bc7c7-a410-4ec4-9b29-c9f1160d2271\") " pod="openshift-dns/dns-default-pnvwt" Jun 09 20:54:43.685110 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.684907 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c5209e7-8425-499a-8987-9d9377addd60-trusted-ca\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:54:43.685110 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.685013 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-tmp-dir\") pod \"dns-default-pnvwt\" (UID: \"f27bc7c7-a410-4ec4-9b29-c9f1160d2271\") " pod="openshift-dns/dns-default-pnvwt" Jun 09 20:54:43.685110 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.685050 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3c5209e7-8425-499a-8987-9d9377addd60-ca-trust-extracted\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:54:43.685110 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.685076 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3c5209e7-8425-499a-8987-9d9377addd60-registry-certificates\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:54:43.685314 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.685108 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3c5209e7-8425-499a-8987-9d9377addd60-image-registry-private-configuration\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:54:43.685314 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.685135 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:54:43.685314 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.685179 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-bound-sa-token\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:54:43.685314 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.685209 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3c5209e7-8425-499a-8987-9d9377addd60-installation-pull-secrets\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:54:43.685314 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.685239 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-metrics-tls\") pod \"dns-default-pnvwt\" (UID: \"f27bc7c7-a410-4ec4-9b29-c9f1160d2271\") " pod="openshift-dns/dns-default-pnvwt" Jun 09 20:54:43.685314 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.685270 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzrqp\" (UniqueName: \"kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-kube-api-access-mzrqp\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:54:43.785729 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.785633 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-config-volume\") pod \"dns-default-pnvwt\" (UID: \"f27bc7c7-a410-4ec4-9b29-c9f1160d2271\") " pod="openshift-dns/dns-default-pnvwt" Jun 09 20:54:43.785729 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.785679 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tc9j\" (UniqueName: \"kubernetes.io/projected/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-kube-api-access-4tc9j\") pod \"dns-default-pnvwt\" (UID: \"f27bc7c7-a410-4ec4-9b29-c9f1160d2271\") " pod="openshift-dns/dns-default-pnvwt" Jun 09 20:54:43.785729 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.785705 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c5209e7-8425-499a-8987-9d9377addd60-trusted-ca\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:54:43.786007 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.785739 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-tmp-dir\") pod \"dns-default-pnvwt\" (UID: \"f27bc7c7-a410-4ec4-9b29-c9f1160d2271\") " pod="openshift-dns/dns-default-pnvwt" Jun 09 20:54:43.786007 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.785761 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3c5209e7-8425-499a-8987-9d9377addd60-ca-trust-extracted\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:54:43.786007 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.785779 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3c5209e7-8425-499a-8987-9d9377addd60-registry-certificates\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:54:43.786007 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.785811 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3c5209e7-8425-499a-8987-9d9377addd60-image-registry-private-configuration\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:54:43.786247 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.786125 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:54:43.786247 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.786184 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-bound-sa-token\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:54:43.786247 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:43.786211 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 20:54:43.786247 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.786216 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3c5209e7-8425-499a-8987-9d9377addd60-installation-pull-secrets\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:54:43.786247 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:43.786228 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf67c8ff7-crdj6: secret "image-registry-tls" not found Jun 09 20:54:43.786247 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.786136 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-tmp-dir\") pod \"dns-default-pnvwt\" (UID: \"f27bc7c7-a410-4ec4-9b29-c9f1160d2271\") " pod="openshift-dns/dns-default-pnvwt" Jun 09 20:54:43.786247 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.786247 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-metrics-tls\") pod \"dns-default-pnvwt\" (UID: \"f27bc7c7-a410-4ec4-9b29-c9f1160d2271\") " pod="openshift-dns/dns-default-pnvwt" Jun 09 20:54:43.786603 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:43.786284 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls podName:3c5209e7-8425-499a-8987-9d9377addd60 nodeName:}" failed. No retries permitted until 2026-06-09 20:54:44.286264715 +0000 UTC m=+36.621953903 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls") pod "image-registry-5bf67c8ff7-crdj6" (UID: "3c5209e7-8425-499a-8987-9d9377addd60") : secret "image-registry-tls" not found Jun 09 20:54:43.786603 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.786313 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzrqp\" (UniqueName: \"kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-kube-api-access-mzrqp\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:54:43.786603 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.786349 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-config-volume\") pod \"dns-default-pnvwt\" (UID: \"f27bc7c7-a410-4ec4-9b29-c9f1160d2271\") " pod="openshift-dns/dns-default-pnvwt" Jun 09 20:54:43.786603 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.786360 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24a48d8d-ec0f-4be8-9c45-791c56450da6-cert\") pod \"ingress-canary-vdjv9\" (UID: \"24a48d8d-ec0f-4be8-9c45-791c56450da6\") " pod="openshift-ingress-canary/ingress-canary-vdjv9" Jun 09 20:54:43.786603 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.786223 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3c5209e7-8425-499a-8987-9d9377addd60-ca-trust-extracted\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:54:43.786603 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.786409 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcqhd\" (UniqueName: \"kubernetes.io/projected/24a48d8d-ec0f-4be8-9c45-791c56450da6-kube-api-access-hcqhd\") pod \"ingress-canary-vdjv9\" (UID: \"24a48d8d-ec0f-4be8-9c45-791c56450da6\") " pod="openshift-ingress-canary/ingress-canary-vdjv9" Jun 09 20:54:43.786603 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:43.786474 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 20:54:43.786603 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.786514 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3c5209e7-8425-499a-8987-9d9377addd60-registry-certificates\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:54:43.786603 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:43.786524 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-metrics-tls podName:f27bc7c7-a410-4ec4-9b29-c9f1160d2271 nodeName:}" failed. No retries permitted until 2026-06-09 20:54:44.286508204 +0000 UTC m=+36.622197402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-metrics-tls") pod "dns-default-pnvwt" (UID: "f27bc7c7-a410-4ec4-9b29-c9f1160d2271") : secret "dns-default-metrics-tls" not found Jun 09 20:54:43.786976 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.786957 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c5209e7-8425-499a-8987-9d9377addd60-trusted-ca\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:54:43.790848 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.790819 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3c5209e7-8425-499a-8987-9d9377addd60-installation-pull-secrets\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:54:43.790848 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.790832 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3c5209e7-8425-499a-8987-9d9377addd60-image-registry-private-configuration\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:54:43.794335 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.794310 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tc9j\" (UniqueName: \"kubernetes.io/projected/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-kube-api-access-4tc9j\") pod \"dns-default-pnvwt\" (UID: \"f27bc7c7-a410-4ec4-9b29-c9f1160d2271\") " pod="openshift-dns/dns-default-pnvwt" Jun 09 20:54:43.794633 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.794602 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-bound-sa-token\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:54:43.794783 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.794761 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzrqp\" (UniqueName: \"kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-kube-api-access-mzrqp\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:54:43.887733 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.887679 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24a48d8d-ec0f-4be8-9c45-791c56450da6-cert\") pod \"ingress-canary-vdjv9\" (UID: \"24a48d8d-ec0f-4be8-9c45-791c56450da6\") " pod="openshift-ingress-canary/ingress-canary-vdjv9" Jun 09 20:54:43.887907 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.887743 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcqhd\" (UniqueName: \"kubernetes.io/projected/24a48d8d-ec0f-4be8-9c45-791c56450da6-kube-api-access-hcqhd\") pod \"ingress-canary-vdjv9\" (UID: \"24a48d8d-ec0f-4be8-9c45-791c56450da6\") " pod="openshift-ingress-canary/ingress-canary-vdjv9" Jun 09 20:54:43.890757 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.890718 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24a48d8d-ec0f-4be8-9c45-791c56450da6-cert\") pod \"ingress-canary-vdjv9\" (UID: \"24a48d8d-ec0f-4be8-9c45-791c56450da6\") " pod="openshift-ingress-canary/ingress-canary-vdjv9" Jun 09 20:54:43.895878 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.895840 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcqhd\" (UniqueName: \"kubernetes.io/projected/24a48d8d-ec0f-4be8-9c45-791c56450da6-kube-api-access-hcqhd\") pod \"ingress-canary-vdjv9\" (UID: \"24a48d8d-ec0f-4be8-9c45-791c56450da6\") " pod="openshift-ingress-canary/ingress-canary-vdjv9" Jun 09 20:54:43.931940 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:43.931898 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vdjv9" Jun 09 20:54:44.185221 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:44.185183 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:54:44.185221 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:44.185208 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:54:44.185854 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:44.185822 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:54:44.188404 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:44.187826 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 20:54:44.188404 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:44.188124 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 20:54:44.188404 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:44.188160 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dhgsz\"" Jun 09 20:54:44.188404 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:44.188213 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 20:54:44.188663 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:44.188488 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 20:54:44.188663 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:44.188651 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zlm4s\"" Jun 09 20:54:44.291196 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:44.291162 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:54:44.291423 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:44.291220 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-metrics-tls\") pod \"dns-default-pnvwt\" (UID: \"f27bc7c7-a410-4ec4-9b29-c9f1160d2271\") " pod="openshift-dns/dns-default-pnvwt" Jun 09 20:54:44.291423 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:44.291338 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 20:54:44.291423 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:44.291356 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf67c8ff7-crdj6: secret "image-registry-tls" not found Jun 09 20:54:44.291568 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:44.291434 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 20:54:44.291568 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:44.291444 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls podName:3c5209e7-8425-499a-8987-9d9377addd60 nodeName:}" failed. No retries permitted until 2026-06-09 20:54:45.291425865 +0000 UTC m=+37.627115068 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls") pod "image-registry-5bf67c8ff7-crdj6" (UID: "3c5209e7-8425-499a-8987-9d9377addd60") : secret "image-registry-tls" not found Jun 09 20:54:44.291568 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:44.291521 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-metrics-tls podName:f27bc7c7-a410-4ec4-9b29-c9f1160d2271 nodeName:}" failed. No retries permitted until 2026-06-09 20:54:45.291502854 +0000 UTC m=+37.627192043 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-metrics-tls") pod "dns-default-pnvwt" (UID: "f27bc7c7-a410-4ec4-9b29-c9f1160d2271") : secret "dns-default-metrics-tls" not found Jun 09 20:54:44.631561 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:44.631337 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vdjv9"] Jun 09 20:54:44.706464 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:54:44.706421 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24a48d8d_ec0f_4be8_9c45_791c56450da6.slice/crio-a65987445f999c49bdba0a1de142b7459f3cfc1f65db8459b7adbca14196e4b7 WatchSource:0}: Error finding container a65987445f999c49bdba0a1de142b7459f3cfc1f65db8459b7adbca14196e4b7: Status 404 returned error can't find the container with id a65987445f999c49bdba0a1de142b7459f3cfc1f65db8459b7adbca14196e4b7 Jun 09 20:54:45.299828 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:45.299784 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:54:45.299979 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:45.299843 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-metrics-tls\") pod \"dns-default-pnvwt\" (UID: \"f27bc7c7-a410-4ec4-9b29-c9f1160d2271\") " pod="openshift-dns/dns-default-pnvwt" Jun 09 20:54:45.299979 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:45.299952 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 20:54:45.299979 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:45.299972 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf67c8ff7-crdj6: secret "image-registry-tls" not found Jun 09 20:54:45.300090 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:45.300014 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 20:54:45.300090 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:45.300027 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls podName:3c5209e7-8425-499a-8987-9d9377addd60 nodeName:}" failed. No retries permitted until 2026-06-09 20:54:47.300012445 +0000 UTC m=+39.635701658 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls") pod "image-registry-5bf67c8ff7-crdj6" (UID: "3c5209e7-8425-499a-8987-9d9377addd60") : secret "image-registry-tls" not found Jun 09 20:54:45.300090 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:45.300053 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-metrics-tls podName:f27bc7c7-a410-4ec4-9b29-c9f1160d2271 nodeName:}" failed. No retries permitted until 2026-06-09 20:54:47.300042534 +0000 UTC m=+39.635731716 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-metrics-tls") pod "dns-default-pnvwt" (UID: "f27bc7c7-a410-4ec4-9b29-c9f1160d2271") : secret "dns-default-metrics-tls" not found Jun 09 20:54:45.432064 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:45.432023 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vdjv9" event={"ID":"24a48d8d-ec0f-4be8-9c45-791c56450da6","Type":"ContainerStarted","Data":"a65987445f999c49bdba0a1de142b7459f3cfc1f65db8459b7adbca14196e4b7"} Jun 09 20:54:45.434838 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:45.434808 2557 generic.go:356] "Generic (PLEG): container finished" podID="234cd6b9-9e32-4cf9-94c4-2bb0053ff04c" containerID="a0eeca18fa6c5c523a8dc221cc3e2bf6031c5b1d0db68fe25268d80263b1c1a1" exitCode=0 Jun 09 20:54:45.434944 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:45.434868 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fgz4b" event={"ID":"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c","Type":"ContainerDied","Data":"a0eeca18fa6c5c523a8dc221cc3e2bf6031c5b1d0db68fe25268d80263b1c1a1"} Jun 09 20:54:46.439726 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:46.439690 2557 generic.go:356] "Generic (PLEG): container finished" podID="234cd6b9-9e32-4cf9-94c4-2bb0053ff04c" containerID="6da1c6a317cb263b4737ad391475ff003c94584358d369ba354c0ad7fbad4be0" exitCode=0 Jun 09 20:54:46.440103 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:46.439751 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fgz4b" event={"ID":"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c","Type":"ContainerDied","Data":"6da1c6a317cb263b4737ad391475ff003c94584358d369ba354c0ad7fbad4be0"} Jun 09 20:54:47.317605 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:47.317416 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-metrics-tls\") pod \"dns-default-pnvwt\" (UID: \"f27bc7c7-a410-4ec4-9b29-c9f1160d2271\") " pod="openshift-dns/dns-default-pnvwt" Jun 09 20:54:47.317791 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:47.317566 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 20:54:47.317791 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:47.317696 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:54:47.317791 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:47.317734 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-metrics-tls podName:f27bc7c7-a410-4ec4-9b29-c9f1160d2271 nodeName:}" failed. No retries permitted until 2026-06-09 20:54:51.3177184 +0000 UTC m=+43.653407581 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-metrics-tls") pod "dns-default-pnvwt" (UID: "f27bc7c7-a410-4ec4-9b29-c9f1160d2271") : secret "dns-default-metrics-tls" not found Jun 09 20:54:47.317944 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:47.317793 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 20:54:47.317944 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:47.317808 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf67c8ff7-crdj6: secret "image-registry-tls" not found Jun 09 20:54:47.317944 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:47.317890 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls podName:3c5209e7-8425-499a-8987-9d9377addd60 nodeName:}" failed. No retries permitted until 2026-06-09 20:54:51.317874421 +0000 UTC m=+43.653563622 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls") pod "image-registry-5bf67c8ff7-crdj6" (UID: "3c5209e7-8425-499a-8987-9d9377addd60") : secret "image-registry-tls" not found Jun 09 20:54:47.444867 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:47.444829 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vdjv9" event={"ID":"24a48d8d-ec0f-4be8-9c45-791c56450da6","Type":"ContainerStarted","Data":"9e412438c3bea991b5826bc7e9563fa03d7d63a21e4eb7d9d8a812cc1cd1bdab"} Jun 09 20:54:47.449894 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:47.449847 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fgz4b" event={"ID":"234cd6b9-9e32-4cf9-94c4-2bb0053ff04c","Type":"ContainerStarted","Data":"09de685e7523fc38499d8e19d06f26904615f6f436c2f504e5821f7f28a11859"} Jun 09 20:54:47.462004 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:47.461935 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vdjv9" podStartSLOduration=1.940708313 podStartE2EDuration="4.461912546s" totalImagesPullingTime="2.521204233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 20:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:54:47.461560913 +0000 UTC m=+39.797250114" watchObservedRunningTime="2026-06-09 20:54:47.461912546 +0000 UTC m=+39.797601751" Jun 09 20:54:47.480592 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:47.480531 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fgz4b" podStartSLOduration=8.216758304 podStartE2EDuration="39.480510734s" totalImagesPullingTime="31.26375243s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 20:54:08 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:54:47.479761665 +0000 UTC m=+39.815450868" watchObservedRunningTime="2026-06-09 20:54:47.480510734 +0000 UTC m=+39.816199936" Jun 09 20:54:51.350339 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:51.350290 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-metrics-tls\") pod \"dns-default-pnvwt\" (UID: \"f27bc7c7-a410-4ec4-9b29-c9f1160d2271\") " pod="openshift-dns/dns-default-pnvwt" Jun 09 20:54:51.350977 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:51.350404 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:54:51.350977 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:51.350503 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 20:54:51.350977 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:51.350593 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-metrics-tls podName:f27bc7c7-a410-4ec4-9b29-c9f1160d2271 nodeName:}" failed. No retries permitted until 2026-06-09 20:54:59.350570898 +0000 UTC m=+51.686260082 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-metrics-tls") pod "dns-default-pnvwt" (UID: "f27bc7c7-a410-4ec4-9b29-c9f1160d2271") : secret "dns-default-metrics-tls" not found Jun 09 20:54:51.350977 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:51.350508 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 20:54:51.350977 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:51.350618 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf67c8ff7-crdj6: secret "image-registry-tls" not found Jun 09 20:54:51.350977 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:51.350666 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls podName:3c5209e7-8425-499a-8987-9d9377addd60 nodeName:}" failed. No retries permitted until 2026-06-09 20:54:59.3506544 +0000 UTC m=+51.686343581 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls") pod "image-registry-5bf67c8ff7-crdj6" (UID: "3c5209e7-8425-499a-8987-9d9377addd60") : secret "image-registry-tls" not found Jun 09 20:54:59.413536 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:59.413494 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-metrics-tls\") pod \"dns-default-pnvwt\" (UID: \"f27bc7c7-a410-4ec4-9b29-c9f1160d2271\") " pod="openshift-dns/dns-default-pnvwt" Jun 09 20:54:59.414109 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:54:59.413577 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:54:59.414109 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:59.413653 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 20:54:59.414109 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:59.413717 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-metrics-tls podName:f27bc7c7-a410-4ec4-9b29-c9f1160d2271 nodeName:}" failed. No retries permitted until 2026-06-09 20:55:15.413701267 +0000 UTC m=+67.749390462 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-metrics-tls") pod "dns-default-pnvwt" (UID: "f27bc7c7-a410-4ec4-9b29-c9f1160d2271") : secret "dns-default-metrics-tls" not found Jun 09 20:54:59.414109 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:59.413657 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 20:54:59.414109 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:59.413750 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf67c8ff7-crdj6: secret "image-registry-tls" not found Jun 09 20:54:59.414109 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:54:59.413800 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls podName:3c5209e7-8425-499a-8987-9d9377addd60 nodeName:}" failed. No retries permitted until 2026-06-09 20:55:15.413788546 +0000 UTC m=+67.749477728 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls") pod "image-registry-5bf67c8ff7-crdj6" (UID: "3c5209e7-8425-499a-8987-9d9377addd60") : secret "image-registry-tls" not found Jun 09 20:55:09.425075 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:55:09.425044 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5l764" Jun 09 20:55:12.904357 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:55:12.904310 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b57eb2c-1312-4faa-9ce2-ad5890cf41ee-original-pull-secret\") pod \"global-pull-secret-syncer-2chl4\" (UID: \"2b57eb2c-1312-4faa-9ce2-ad5890cf41ee\") " pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:55:12.904357 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:55:12.904360 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-metrics-certs\") pod \"network-metrics-daemon-dwxkr\" (UID: \"c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae\") " pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:55:12.904800 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:55:12.904415 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9nr8\" (UniqueName: \"kubernetes.io/projected/c0a3351e-dc59-4816-87ea-7a918f8c03ab-kube-api-access-f9nr8\") pod \"network-check-target-ddvmc\" (UID: \"c0a3351e-dc59-4816-87ea-7a918f8c03ab\") " pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:55:12.906452 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:55:12.906427 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 20:55:12.906545 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:55:12.906529 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 20:55:12.906712 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:55:12.906701 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 20:55:12.915108 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:55:12.915082 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 20:55:12.915184 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:55:12.915173 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-metrics-certs podName:c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae nodeName:}" failed. No retries permitted until 2026-06-09 20:56:16.915148414 +0000 UTC m=+129.250837596 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-metrics-certs") pod "network-metrics-daemon-dwxkr" (UID: "c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae") : secret "metrics-daemon-secret" not found Jun 09 20:55:12.916686 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:55:12.916657 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 20:55:12.919313 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:55:12.919284 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b57eb2c-1312-4faa-9ce2-ad5890cf41ee-original-pull-secret\") pod \"global-pull-secret-syncer-2chl4\" (UID: \"2b57eb2c-1312-4faa-9ce2-ad5890cf41ee\") " pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:55:12.927732 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:55:12.927704 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9nr8\" (UniqueName: \"kubernetes.io/projected/c0a3351e-dc59-4816-87ea-7a918f8c03ab-kube-api-access-f9nr8\") pod \"network-check-target-ddvmc\" (UID: \"c0a3351e-dc59-4816-87ea-7a918f8c03ab\") " pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:55:13.003357 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:55:13.003320 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dhgsz\"" Jun 09 20:55:13.006875 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:55:13.006851 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2chl4" Jun 09 20:55:13.011461 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:55:13.011443 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:55:13.146451 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:55:13.146418 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2chl4"] Jun 09 20:55:13.149916 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:55:13.149888 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b57eb2c_1312_4faa_9ce2_ad5890cf41ee.slice/crio-6e1f3f815917f82d41f6ab473aca4f939536459c0ea0cace440f04451448c8b7 WatchSource:0}: Error finding container 6e1f3f815917f82d41f6ab473aca4f939536459c0ea0cace440f04451448c8b7: Status 404 returned error can't find the container with id 6e1f3f815917f82d41f6ab473aca4f939536459c0ea0cace440f04451448c8b7 Jun 09 20:55:13.159470 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:55:13.159400 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ddvmc"] Jun 09 20:55:13.163310 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:55:13.163286 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0a3351e_dc59_4816_87ea_7a918f8c03ab.slice/crio-17670ecbec72ba53ca5fd4cd5776831122b05c1bcd42f309e72f869179820bff WatchSource:0}: Error finding container 17670ecbec72ba53ca5fd4cd5776831122b05c1bcd42f309e72f869179820bff: Status 404 returned error can't find the container with id 17670ecbec72ba53ca5fd4cd5776831122b05c1bcd42f309e72f869179820bff Jun 09 20:55:13.513769 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:55:13.513730 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ddvmc" event={"ID":"c0a3351e-dc59-4816-87ea-7a918f8c03ab","Type":"ContainerStarted","Data":"17670ecbec72ba53ca5fd4cd5776831122b05c1bcd42f309e72f869179820bff"} Jun 09 20:55:13.514876 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:55:13.514850 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2chl4" event={"ID":"2b57eb2c-1312-4faa-9ce2-ad5890cf41ee","Type":"ContainerStarted","Data":"6e1f3f815917f82d41f6ab473aca4f939536459c0ea0cace440f04451448c8b7"} Jun 09 20:55:15.423653 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:55:15.423604 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:55:15.424256 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:55:15.423669 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-metrics-tls\") pod \"dns-default-pnvwt\" (UID: \"f27bc7c7-a410-4ec4-9b29-c9f1160d2271\") " pod="openshift-dns/dns-default-pnvwt" Jun 09 20:55:15.424256 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:55:15.423776 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 20:55:15.424256 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:55:15.423780 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 20:55:15.424256 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:55:15.423811 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf67c8ff7-crdj6: secret "image-registry-tls" not found Jun 09 20:55:15.424256 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:55:15.423848 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-metrics-tls podName:f27bc7c7-a410-4ec4-9b29-c9f1160d2271 nodeName:}" failed. No retries permitted until 2026-06-09 20:55:47.423825097 +0000 UTC m=+99.759514278 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-metrics-tls") pod "dns-default-pnvwt" (UID: "f27bc7c7-a410-4ec4-9b29-c9f1160d2271") : secret "dns-default-metrics-tls" not found Jun 09 20:55:15.424256 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:55:15.423877 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls podName:3c5209e7-8425-499a-8987-9d9377addd60 nodeName:}" failed. No retries permitted until 2026-06-09 20:55:47.423856147 +0000 UTC m=+99.759545353 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls") pod "image-registry-5bf67c8ff7-crdj6" (UID: "3c5209e7-8425-499a-8987-9d9377addd60") : secret "image-registry-tls" not found Jun 09 20:55:16.525497 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:55:16.525461 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ddvmc" event={"ID":"c0a3351e-dc59-4816-87ea-7a918f8c03ab","Type":"ContainerStarted","Data":"6eed2bd88a90bc675c1b15df0e0debbfd5890b96c8aa51f9d1fe95c22c441264"} Jun 09 20:55:16.525945 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:55:16.525601 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:55:16.539080 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:55:16.539010 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ddvmc" podStartSLOduration=65.731534583 podStartE2EDuration="1m8.538986766s" totalImagesPullingTime="2.807452183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 20:54:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:55:16.538321937 +0000 UTC m=+68.874011141" watchObservedRunningTime="2026-06-09 20:55:16.538986766 +0000 UTC m=+68.874675966" Jun 09 20:55:19.534792 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:55:19.534749 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2chl4" event={"ID":"2b57eb2c-1312-4faa-9ce2-ad5890cf41ee","Type":"ContainerStarted","Data":"e1b9476817e1b1cedce16a668205da8d7f85e500bccdc7f4f536653689cb432b"} Jun 09 20:55:19.548435 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:55:19.548367 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2chl4" podStartSLOduration=65.885191478 podStartE2EDuration="1m11.548351569s" totalImagesPullingTime="5.663160091s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 20:54:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:55:19.547425095 +0000 UTC m=+71.883114296" watchObservedRunningTime="2026-06-09 20:55:19.548351569 +0000 UTC m=+71.884040774" Jun 09 20:55:47.456368 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:55:47.456228 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:55:47.456368 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:55:47.456281 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-metrics-tls\") pod \"dns-default-pnvwt\" (UID: \"f27bc7c7-a410-4ec4-9b29-c9f1160d2271\") " pod="openshift-dns/dns-default-pnvwt" Jun 09 20:55:47.456943 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:55:47.456412 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 20:55:47.456943 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:55:47.456429 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 20:55:47.456943 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:55:47.456430 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf67c8ff7-crdj6: secret "image-registry-tls" not found Jun 09 20:55:47.456943 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:55:47.456484 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-metrics-tls podName:f27bc7c7-a410-4ec4-9b29-c9f1160d2271 nodeName:}" failed. No retries permitted until 2026-06-09 20:56:51.456470606 +0000 UTC m=+163.792159788 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-metrics-tls") pod "dns-default-pnvwt" (UID: "f27bc7c7-a410-4ec4-9b29-c9f1160d2271") : secret "dns-default-metrics-tls" not found Jun 09 20:55:47.456943 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:55:47.456497 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls podName:3c5209e7-8425-499a-8987-9d9377addd60 nodeName:}" failed. No retries permitted until 2026-06-09 20:56:51.456491172 +0000 UTC m=+163.792180355 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls") pod "image-registry-5bf67c8ff7-crdj6" (UID: "3c5209e7-8425-499a-8987-9d9377addd60") : secret "image-registry-tls" not found Jun 09 20:55:47.531135 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:55:47.531103 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ddvmc" Jun 09 20:56:16.962968 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:56:16.962907 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-metrics-certs\") pod \"network-metrics-daemon-dwxkr\" (UID: \"c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae\") " pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:56:16.963497 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:56:16.963087 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 20:56:16.963497 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:56:16.963177 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-metrics-certs podName:c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae nodeName:}" failed. No retries permitted until 2026-06-09 20:58:18.963156062 +0000 UTC m=+251.298845244 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-metrics-certs") pod "network-metrics-daemon-dwxkr" (UID: "c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae") : secret "metrics-daemon-secret" not found Jun 09 20:56:46.596075 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:56:46.596020 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" podUID="3c5209e7-8425-499a-8987-9d9377addd60" Jun 09 20:56:46.609689 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:56:46.609656 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pnvwt" podUID="f27bc7c7-a410-4ec4-9b29-c9f1160d2271" Jun 09 20:56:46.742231 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:56:46.742203 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pnvwt" Jun 09 20:56:46.742231 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:56:46.742240 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:56:47.213760 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:56:47.213711 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dwxkr" podUID="c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae" Jun 09 20:56:51.508952 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:56:51.508905 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:56:51.508952 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:56:51.508956 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-metrics-tls\") pod \"dns-default-pnvwt\" (UID: \"f27bc7c7-a410-4ec4-9b29-c9f1160d2271\") " pod="openshift-dns/dns-default-pnvwt" Jun 09 20:56:51.509424 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:56:51.509061 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 20:56:51.509424 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:56:51.509089 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf67c8ff7-crdj6: secret "image-registry-tls" not found Jun 09 20:56:51.509424 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:56:51.509070 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 20:56:51.509424 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:56:51.509151 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls podName:3c5209e7-8425-499a-8987-9d9377addd60 nodeName:}" failed. No retries permitted until 2026-06-09 20:58:53.509135187 +0000 UTC m=+285.844824371 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls") pod "image-registry-5bf67c8ff7-crdj6" (UID: "3c5209e7-8425-499a-8987-9d9377addd60") : secret "image-registry-tls" not found Jun 09 20:56:51.509424 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:56:51.509219 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-metrics-tls podName:f27bc7c7-a410-4ec4-9b29-c9f1160d2271 nodeName:}" failed. No retries permitted until 2026-06-09 20:58:53.509204691 +0000 UTC m=+285.844893872 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-metrics-tls") pod "dns-default-pnvwt" (UID: "f27bc7c7-a410-4ec4-9b29-c9f1160d2271") : secret "dns-default-metrics-tls" not found Jun 09 20:57:02.185440 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:02.185325 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:57:37.420099 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.420067 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9kr2d"] Jun 09 20:57:37.423075 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.423052 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9kr2d" Jun 09 20:57:37.423342 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.423290 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tbw6z"] Jun 09 20:57:37.425145 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.425124 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rmvlk\"" Jun 09 20:57:37.425526 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.425510 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 09 20:57:37.425603 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.425548 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 09 20:57:37.425603 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.425594 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 09 20:57:37.425958 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.425939 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cwzdg"] Jun 09 20:57:37.426079 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.426051 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tbw6z" Jun 09 20:57:37.428176 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.428154 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 09 20:57:37.428176 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.428180 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 09 20:57:37.428344 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.428164 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 09 20:57:37.428344 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.428206 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6dvgs\"" Jun 09 20:57:37.428344 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.428211 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 09 20:57:37.428742 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.428719 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cwzdg" Jun 09 20:57:37.430513 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.430490 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-5q6sv\"" Jun 09 20:57:37.430614 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.430567 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 09 20:57:37.430614 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.430583 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 09 20:57:37.443407 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.443365 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9kr2d"] Jun 09 20:57:37.445482 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.445457 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tbw6z"] Jun 09 20:57:37.445595 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.445532 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cwzdg"] Jun 09 20:57:37.515565 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.515527 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-dz7rq"] Jun 09 20:57:37.518508 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.518490 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-dz7rq" Jun 09 20:57:37.520155 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.520125 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-znt5k"] Jun 09 20:57:37.520462 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.520445 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-dgt95\"" Jun 09 20:57:37.522929 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.522905 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-znt5k" Jun 09 20:57:37.524139 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.524119 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-rht6r"] Jun 09 20:57:37.524972 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.524950 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9lrps\"" Jun 09 20:57:37.525064 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.524992 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 09 20:57:37.525064 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.525021 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 09 20:57:37.527729 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.527706 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-dz7rq"] Jun 09 20:57:37.527828 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.527806 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-rht6r" Jun 09 20:57:37.530924 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.530906 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 09 20:57:37.531662 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.531503 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 09 20:57:37.531662 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.531533 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 09 20:57:37.531662 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.531554 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-28ts6\"" Jun 09 20:57:37.531662 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.531503 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 09 20:57:37.539369 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.536176 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-9kr2d\" (UID: \"09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9kr2d" Jun 09 20:57:37.539369 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.536231 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/407c0bf3-a878-482d-87dd-dc4c78cb7d71-config\") pod \"service-ca-operator-6bc5ff68f5-tbw6z\" (UID: \"407c0bf3-a878-482d-87dd-dc4c78cb7d71\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tbw6z" Jun 09 20:57:37.539369 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.536299 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/407c0bf3-a878-482d-87dd-dc4c78cb7d71-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-tbw6z\" (UID: \"407c0bf3-a878-482d-87dd-dc4c78cb7d71\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tbw6z" Jun 09 20:57:37.539369 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.536342 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwfbg\" (UniqueName: \"kubernetes.io/projected/09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c-kube-api-access-mwfbg\") pod \"cluster-samples-operator-854f8b96b6-9kr2d\" (UID: \"09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9kr2d" Jun 09 20:57:37.539369 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.536433 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7hx7\" (UniqueName: \"kubernetes.io/projected/83ffa3f7-8b6a-4e90-b801-171b0e5e5154-kube-api-access-x7hx7\") pod \"volume-data-source-validator-78dd696465-cwzdg\" (UID: \"83ffa3f7-8b6a-4e90-b801-171b0e5e5154\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cwzdg" Jun 09 20:57:37.539369 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.536567 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvck4\" (UniqueName: \"kubernetes.io/projected/407c0bf3-a878-482d-87dd-dc4c78cb7d71-kube-api-access-dvck4\") pod \"service-ca-operator-6bc5ff68f5-tbw6z\" (UID: \"407c0bf3-a878-482d-87dd-dc4c78cb7d71\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tbw6z" Jun 09 20:57:37.539369 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.538521 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 09 20:57:37.539369 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.538812 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-rht6r"] Jun 09 20:57:37.541554 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.541530 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-znt5k"] Jun 09 20:57:37.637709 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.637678 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/16863009-e8d0-462f-a57e-3c4e82142141-serving-cert\") pod \"console-operator-668fdbf85c-rht6r\" (UID: \"16863009-e8d0-462f-a57e-3c4e82142141\") " pod="openshift-console-operator/console-operator-668fdbf85c-rht6r" Jun 09 20:57:37.637709 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.637713 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wv2v\" (UniqueName: \"kubernetes.io/projected/fc03d9b9-3ff2-4120-9c48-1c926ca9bf9a-kube-api-access-4wv2v\") pod \"network-check-source-dbd9cf844-dz7rq\" (UID: \"fc03d9b9-3ff2-4120-9c48-1c926ca9bf9a\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-dz7rq" Jun 09 20:57:37.637922 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.637741 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/407c0bf3-a878-482d-87dd-dc4c78cb7d71-config\") pod \"service-ca-operator-6bc5ff68f5-tbw6z\" (UID: \"407c0bf3-a878-482d-87dd-dc4c78cb7d71\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tbw6z" Jun 09 20:57:37.637922 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.637891 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7hx7\" (UniqueName: \"kubernetes.io/projected/83ffa3f7-8b6a-4e90-b801-171b0e5e5154-kube-api-access-x7hx7\") pod \"volume-data-source-validator-78dd696465-cwzdg\" (UID: \"83ffa3f7-8b6a-4e90-b801-171b0e5e5154\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cwzdg" Jun 09 20:57:37.637986 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.637954 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc5m9\" (UniqueName: \"kubernetes.io/projected/16863009-e8d0-462f-a57e-3c4e82142141-kube-api-access-dc5m9\") pod \"console-operator-668fdbf85c-rht6r\" (UID: \"16863009-e8d0-462f-a57e-3c4e82142141\") " pod="openshift-console-operator/console-operator-668fdbf85c-rht6r" Jun 09 20:57:37.637986 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.637979 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-9kr2d\" (UID: \"09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9kr2d" Jun 09 20:57:37.638060 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.637996 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/16863009-e8d0-462f-a57e-3c4e82142141-config\") pod \"console-operator-668fdbf85c-rht6r\" (UID: \"16863009-e8d0-462f-a57e-3c4e82142141\") " pod="openshift-console-operator/console-operator-668fdbf85c-rht6r" Jun 09 20:57:37.638060 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.638042 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/407c0bf3-a878-482d-87dd-dc4c78cb7d71-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-tbw6z\" (UID: \"407c0bf3-a878-482d-87dd-dc4c78cb7d71\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tbw6z" Jun 09 20:57:37.638156 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:57:37.638107 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 20:57:37.638200 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:57:37.638183 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c-samples-operator-tls podName:09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c nodeName:}" failed. No retries permitted until 2026-06-09 20:57:38.138162471 +0000 UTC m=+210.473851656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-9kr2d" (UID: "09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c") : secret "samples-operator-tls" not found Jun 09 20:57:37.638287 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.638203 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwfbg\" (UniqueName: \"kubernetes.io/projected/09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c-kube-api-access-mwfbg\") pod \"cluster-samples-operator-854f8b96b6-9kr2d\" (UID: \"09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9kr2d" Jun 09 20:57:37.638287 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.638221 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/407c0bf3-a878-482d-87dd-dc4c78cb7d71-config\") pod \"service-ca-operator-6bc5ff68f5-tbw6z\" (UID: \"407c0bf3-a878-482d-87dd-dc4c78cb7d71\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tbw6z" Jun 09 20:57:37.638287 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.638231 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5080444f-d21e-402b-bd46-e0b5c24a6baf-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-znt5k\" (UID: \"5080444f-d21e-402b-bd46-e0b5c24a6baf\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-znt5k" Jun 09 20:57:37.638467 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.638346 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5080444f-d21e-402b-bd46-e0b5c24a6baf-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-znt5k\" (UID: \"5080444f-d21e-402b-bd46-e0b5c24a6baf\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-znt5k" Jun 09 20:57:37.638467 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.638420 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/16863009-e8d0-462f-a57e-3c4e82142141-trusted-ca\") pod \"console-operator-668fdbf85c-rht6r\" (UID: \"16863009-e8d0-462f-a57e-3c4e82142141\") " pod="openshift-console-operator/console-operator-668fdbf85c-rht6r" Jun 09 20:57:37.638565 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.638477 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvck4\" (UniqueName: \"kubernetes.io/projected/407c0bf3-a878-482d-87dd-dc4c78cb7d71-kube-api-access-dvck4\") pod \"service-ca-operator-6bc5ff68f5-tbw6z\" (UID: \"407c0bf3-a878-482d-87dd-dc4c78cb7d71\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tbw6z" Jun 09 20:57:37.640489 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.640468 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/407c0bf3-a878-482d-87dd-dc4c78cb7d71-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-tbw6z\" (UID: \"407c0bf3-a878-482d-87dd-dc4c78cb7d71\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tbw6z" Jun 09 20:57:37.650511 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.650489 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvck4\" (UniqueName: \"kubernetes.io/projected/407c0bf3-a878-482d-87dd-dc4c78cb7d71-kube-api-access-dvck4\") pod \"service-ca-operator-6bc5ff68f5-tbw6z\" (UID: \"407c0bf3-a878-482d-87dd-dc4c78cb7d71\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tbw6z" Jun 09 20:57:37.650738 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.650718 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwfbg\" (UniqueName: \"kubernetes.io/projected/09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c-kube-api-access-mwfbg\") pod \"cluster-samples-operator-854f8b96b6-9kr2d\" (UID: \"09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9kr2d" Jun 09 20:57:37.650900 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.650880 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7hx7\" (UniqueName: \"kubernetes.io/projected/83ffa3f7-8b6a-4e90-b801-171b0e5e5154-kube-api-access-x7hx7\") pod \"volume-data-source-validator-78dd696465-cwzdg\" (UID: \"83ffa3f7-8b6a-4e90-b801-171b0e5e5154\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cwzdg" Jun 09 20:57:37.738833 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.738794 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tbw6z" Jun 09 20:57:37.739029 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.738919 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc5m9\" (UniqueName: \"kubernetes.io/projected/16863009-e8d0-462f-a57e-3c4e82142141-kube-api-access-dc5m9\") pod \"console-operator-668fdbf85c-rht6r\" (UID: \"16863009-e8d0-462f-a57e-3c4e82142141\") " pod="openshift-console-operator/console-operator-668fdbf85c-rht6r" Jun 09 20:57:37.739029 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.738960 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/16863009-e8d0-462f-a57e-3c4e82142141-config\") pod \"console-operator-668fdbf85c-rht6r\" (UID: \"16863009-e8d0-462f-a57e-3c4e82142141\") " pod="openshift-console-operator/console-operator-668fdbf85c-rht6r" Jun 09 20:57:37.739029 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.738990 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5080444f-d21e-402b-bd46-e0b5c24a6baf-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-znt5k\" (UID: \"5080444f-d21e-402b-bd46-e0b5c24a6baf\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-znt5k" Jun 09 20:57:37.739154 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.739087 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5080444f-d21e-402b-bd46-e0b5c24a6baf-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-znt5k\" (UID: \"5080444f-d21e-402b-bd46-e0b5c24a6baf\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-znt5k" Jun 09 20:57:37.739154 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.739131 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/16863009-e8d0-462f-a57e-3c4e82142141-trusted-ca\") pod \"console-operator-668fdbf85c-rht6r\" (UID: \"16863009-e8d0-462f-a57e-3c4e82142141\") " pod="openshift-console-operator/console-operator-668fdbf85c-rht6r" Jun 09 20:57:37.739252 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:57:37.739230 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 20:57:37.739313 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.739283 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/16863009-e8d0-462f-a57e-3c4e82142141-serving-cert\") pod \"console-operator-668fdbf85c-rht6r\" (UID: \"16863009-e8d0-462f-a57e-3c4e82142141\") " pod="openshift-console-operator/console-operator-668fdbf85c-rht6r" Jun 09 20:57:37.739313 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:57:37.739300 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5080444f-d21e-402b-bd46-e0b5c24a6baf-networking-console-plugin-cert podName:5080444f-d21e-402b-bd46-e0b5c24a6baf nodeName:}" failed. No retries permitted until 2026-06-09 20:57:38.239280609 +0000 UTC m=+210.574969791 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5080444f-d21e-402b-bd46-e0b5c24a6baf-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-znt5k" (UID: "5080444f-d21e-402b-bd46-e0b5c24a6baf") : secret "networking-console-plugin-cert" not found Jun 09 20:57:37.739437 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.739334 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wv2v\" (UniqueName: \"kubernetes.io/projected/fc03d9b9-3ff2-4120-9c48-1c926ca9bf9a-kube-api-access-4wv2v\") pod \"network-check-source-dbd9cf844-dz7rq\" (UID: \"fc03d9b9-3ff2-4120-9c48-1c926ca9bf9a\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-dz7rq" Jun 09 20:57:37.739697 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.739674 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5080444f-d21e-402b-bd46-e0b5c24a6baf-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-znt5k\" (UID: \"5080444f-d21e-402b-bd46-e0b5c24a6baf\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-znt5k" Jun 09 20:57:37.739806 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.739780 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/16863009-e8d0-462f-a57e-3c4e82142141-config\") pod \"console-operator-668fdbf85c-rht6r\" (UID: \"16863009-e8d0-462f-a57e-3c4e82142141\") " pod="openshift-console-operator/console-operator-668fdbf85c-rht6r" Jun 09 20:57:37.739970 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.739954 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/16863009-e8d0-462f-a57e-3c4e82142141-trusted-ca\") pod \"console-operator-668fdbf85c-rht6r\" (UID: \"16863009-e8d0-462f-a57e-3c4e82142141\") " pod="openshift-console-operator/console-operator-668fdbf85c-rht6r" Jun 09 20:57:37.741758 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.741741 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/16863009-e8d0-462f-a57e-3c4e82142141-serving-cert\") pod \"console-operator-668fdbf85c-rht6r\" (UID: \"16863009-e8d0-462f-a57e-3c4e82142141\") " pod="openshift-console-operator/console-operator-668fdbf85c-rht6r" Jun 09 20:57:37.745742 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.745719 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cwzdg" Jun 09 20:57:37.747112 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.747085 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wv2v\" (UniqueName: \"kubernetes.io/projected/fc03d9b9-3ff2-4120-9c48-1c926ca9bf9a-kube-api-access-4wv2v\") pod \"network-check-source-dbd9cf844-dz7rq\" (UID: \"fc03d9b9-3ff2-4120-9c48-1c926ca9bf9a\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-dz7rq" Jun 09 20:57:37.747247 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.747231 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc5m9\" (UniqueName: \"kubernetes.io/projected/16863009-e8d0-462f-a57e-3c4e82142141-kube-api-access-dc5m9\") pod \"console-operator-668fdbf85c-rht6r\" (UID: \"16863009-e8d0-462f-a57e-3c4e82142141\") " pod="openshift-console-operator/console-operator-668fdbf85c-rht6r" Jun 09 20:57:37.829931 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.829714 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-dz7rq" Jun 09 20:57:37.847176 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.846827 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-rht6r" Jun 09 20:57:37.876499 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.876467 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tbw6z"] Jun 09 20:57:37.882385 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:57:37.882327 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod407c0bf3_a878_482d_87dd_dc4c78cb7d71.slice/crio-ee18788b4dfe73d6d30c32051d0f8e1cc474c6a7422d9357d6427903baebeb91 WatchSource:0}: Error finding container ee18788b4dfe73d6d30c32051d0f8e1cc474c6a7422d9357d6427903baebeb91: Status 404 returned error can't find the container with id ee18788b4dfe73d6d30c32051d0f8e1cc474c6a7422d9357d6427903baebeb91 Jun 09 20:57:37.897280 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.897247 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cwzdg"] Jun 09 20:57:37.903187 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:57:37.903021 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83ffa3f7_8b6a_4e90_b801_171b0e5e5154.slice/crio-808df6fd63864ef921f9d84ab83286511f572646104fefb35d036b4dea52fd93 WatchSource:0}: Error finding container 808df6fd63864ef921f9d84ab83286511f572646104fefb35d036b4dea52fd93: Status 404 returned error can't find the container with id 808df6fd63864ef921f9d84ab83286511f572646104fefb35d036b4dea52fd93 Jun 09 20:57:37.976949 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.976915 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-dz7rq"] Jun 09 20:57:37.980333 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:57:37.980304 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc03d9b9_3ff2_4120_9c48_1c926ca9bf9a.slice/crio-a2b6691d2bfd47619d82f66b71a3ad80f454820f3b47f573960157535e9e22f0 WatchSource:0}: Error finding container a2b6691d2bfd47619d82f66b71a3ad80f454820f3b47f573960157535e9e22f0: Status 404 returned error can't find the container with id a2b6691d2bfd47619d82f66b71a3ad80f454820f3b47f573960157535e9e22f0 Jun 09 20:57:37.995209 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:37.995181 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-rht6r"] Jun 09 20:57:38.006292 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:57:38.006267 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16863009_e8d0_462f_a57e_3c4e82142141.slice/crio-86fdee7ad50c9fb6ce61c362e042312f51ba960478423abf1f403756ffa9111d WatchSource:0}: Error finding container 86fdee7ad50c9fb6ce61c362e042312f51ba960478423abf1f403756ffa9111d: Status 404 returned error can't find the container with id 86fdee7ad50c9fb6ce61c362e042312f51ba960478423abf1f403756ffa9111d Jun 09 20:57:38.142873 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:38.142836 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-9kr2d\" (UID: \"09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9kr2d" Jun 09 20:57:38.143058 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:57:38.142994 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 20:57:38.143058 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:57:38.143055 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c-samples-operator-tls podName:09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c nodeName:}" failed. No retries permitted until 2026-06-09 20:57:39.14303728 +0000 UTC m=+211.478726476 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-9kr2d" (UID: "09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c") : secret "samples-operator-tls" not found Jun 09 20:57:38.243980 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:38.243882 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5080444f-d21e-402b-bd46-e0b5c24a6baf-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-znt5k\" (UID: \"5080444f-d21e-402b-bd46-e0b5c24a6baf\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-znt5k" Jun 09 20:57:38.244124 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:57:38.244048 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 20:57:38.244124 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:57:38.244113 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5080444f-d21e-402b-bd46-e0b5c24a6baf-networking-console-plugin-cert podName:5080444f-d21e-402b-bd46-e0b5c24a6baf nodeName:}" failed. No retries permitted until 2026-06-09 20:57:39.244097039 +0000 UTC m=+211.579786221 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5080444f-d21e-402b-bd46-e0b5c24a6baf-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-znt5k" (UID: "5080444f-d21e-402b-bd46-e0b5c24a6baf") : secret "networking-console-plugin-cert" not found Jun 09 20:57:38.870048 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:38.869977 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cwzdg" event={"ID":"83ffa3f7-8b6a-4e90-b801-171b0e5e5154","Type":"ContainerStarted","Data":"808df6fd63864ef921f9d84ab83286511f572646104fefb35d036b4dea52fd93"} Jun 09 20:57:38.871834 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:38.871513 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-rht6r" event={"ID":"16863009-e8d0-462f-a57e-3c4e82142141","Type":"ContainerStarted","Data":"86fdee7ad50c9fb6ce61c362e042312f51ba960478423abf1f403756ffa9111d"} Jun 09 20:57:38.873112 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:38.873058 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tbw6z" event={"ID":"407c0bf3-a878-482d-87dd-dc4c78cb7d71","Type":"ContainerStarted","Data":"ee18788b4dfe73d6d30c32051d0f8e1cc474c6a7422d9357d6427903baebeb91"} Jun 09 20:57:38.875676 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:38.875419 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-dz7rq" event={"ID":"fc03d9b9-3ff2-4120-9c48-1c926ca9bf9a","Type":"ContainerStarted","Data":"4aecbff8172f6aaf2032cbb32e081a1ae1f21fcbbcad429ad1d359938f17e562"} Jun 09 20:57:38.875676 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:38.875464 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-dz7rq" event={"ID":"fc03d9b9-3ff2-4120-9c48-1c926ca9bf9a","Type":"ContainerStarted","Data":"a2b6691d2bfd47619d82f66b71a3ad80f454820f3b47f573960157535e9e22f0"} Jun 09 20:57:39.151807 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:39.151714 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-9kr2d\" (UID: \"09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9kr2d" Jun 09 20:57:39.151970 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:57:39.151892 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 20:57:39.152037 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:57:39.151973 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c-samples-operator-tls podName:09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c nodeName:}" failed. No retries permitted until 2026-06-09 20:57:41.151953601 +0000 UTC m=+213.487642798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-9kr2d" (UID: "09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c") : secret "samples-operator-tls" not found Jun 09 20:57:39.252794 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:39.252753 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5080444f-d21e-402b-bd46-e0b5c24a6baf-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-znt5k\" (UID: \"5080444f-d21e-402b-bd46-e0b5c24a6baf\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-znt5k" Jun 09 20:57:39.252979 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:57:39.252924 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 20:57:39.253047 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:57:39.253006 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5080444f-d21e-402b-bd46-e0b5c24a6baf-networking-console-plugin-cert podName:5080444f-d21e-402b-bd46-e0b5c24a6baf nodeName:}" failed. No retries permitted until 2026-06-09 20:57:41.252985919 +0000 UTC m=+213.588675104 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5080444f-d21e-402b-bd46-e0b5c24a6baf-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-znt5k" (UID: "5080444f-d21e-402b-bd46-e0b5c24a6baf") : secret "networking-console-plugin-cert" not found Jun 09 20:57:39.881535 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:39.881496 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cwzdg" event={"ID":"83ffa3f7-8b6a-4e90-b801-171b0e5e5154","Type":"ContainerStarted","Data":"9d522be4e27b7f63a1e703a7412abbf1a3494537bf1537aa99c06d0dace3058c"} Jun 09 20:57:39.895033 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:39.894970 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cwzdg" podStartSLOduration=1.50585719 podStartE2EDuration="2.894950789s" totalImagesPullingTime="1.389093599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 20:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:57:39.894606966 +0000 UTC m=+212.230296171" watchObservedRunningTime="2026-06-09 20:57:39.894950789 +0000 UTC m=+212.230639994" Jun 09 20:57:39.895226 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:39.895075 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-dz7rq" podStartSLOduration=2.895067642 podStartE2EDuration="2.895067642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 20:57:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:57:38.889244167 +0000 UTC m=+211.224933370" watchObservedRunningTime="2026-06-09 20:57:39.895067642 +0000 UTC m=+212.230756846" Jun 09 20:57:40.886751 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:40.886670 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rht6r_16863009-e8d0-462f-a57e-3c4e82142141/console-operator/0.log" Jun 09 20:57:40.886751 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:40.886714 2557 generic.go:356] "Generic (PLEG): container finished" podID="16863009-e8d0-462f-a57e-3c4e82142141" containerID="de37c37a05751646a9e6c74e75cb4d703a01d3ee3e466cb51d67db7276aa8269" exitCode=255 Jun 09 20:57:40.887241 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:40.886793 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-rht6r" event={"ID":"16863009-e8d0-462f-a57e-3c4e82142141","Type":"ContainerDied","Data":"de37c37a05751646a9e6c74e75cb4d703a01d3ee3e466cb51d67db7276aa8269"} Jun 09 20:57:40.887241 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:40.887001 2557 scope.go:117] "RemoveContainer" containerID="de37c37a05751646a9e6c74e75cb4d703a01d3ee3e466cb51d67db7276aa8269" Jun 09 20:57:40.888359 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:40.888323 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tbw6z" event={"ID":"407c0bf3-a878-482d-87dd-dc4c78cb7d71","Type":"ContainerStarted","Data":"35f712513ab7e616cc5c4f3ac8fd229445eede0fb220a9be2442a9d426d934a8"} Jun 09 20:57:40.914194 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:40.914144 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tbw6z" podStartSLOduration=1.312171004 podStartE2EDuration="3.914126339s" totalImagesPullingTime="2.601955335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 20:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:57:40.913479777 +0000 UTC m=+213.249168982" watchObservedRunningTime="2026-06-09 20:57:40.914126339 +0000 UTC m=+213.249815574" Jun 09 20:57:41.170554 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:41.170467 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-9kr2d\" (UID: \"09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9kr2d" Jun 09 20:57:41.170700 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:57:41.170623 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 20:57:41.170700 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:57:41.170695 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c-samples-operator-tls podName:09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c nodeName:}" failed. No retries permitted until 2026-06-09 20:57:45.170678712 +0000 UTC m=+217.506367894 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-9kr2d" (UID: "09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c") : secret "samples-operator-tls" not found Jun 09 20:57:41.271511 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:41.271467 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5080444f-d21e-402b-bd46-e0b5c24a6baf-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-znt5k\" (UID: \"5080444f-d21e-402b-bd46-e0b5c24a6baf\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-znt5k" Jun 09 20:57:41.271682 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:57:41.271614 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 20:57:41.271682 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:57:41.271671 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5080444f-d21e-402b-bd46-e0b5c24a6baf-networking-console-plugin-cert podName:5080444f-d21e-402b-bd46-e0b5c24a6baf nodeName:}" failed. No retries permitted until 2026-06-09 20:57:45.27165789 +0000 UTC m=+217.607347072 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5080444f-d21e-402b-bd46-e0b5c24a6baf-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-znt5k" (UID: "5080444f-d21e-402b-bd46-e0b5c24a6baf") : secret "networking-console-plugin-cert" not found Jun 09 20:57:41.893471 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:41.893438 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rht6r_16863009-e8d0-462f-a57e-3c4e82142141/console-operator/1.log" Jun 09 20:57:41.893911 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:41.893894 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rht6r_16863009-e8d0-462f-a57e-3c4e82142141/console-operator/0.log" Jun 09 20:57:41.893954 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:41.893935 2557 generic.go:356] "Generic (PLEG): container finished" podID="16863009-e8d0-462f-a57e-3c4e82142141" containerID="4fbb54bfff69ace8552057735dbbfb54ebd0b65c6eeb249fc9ef444e46ccea93" exitCode=255 Jun 09 20:57:41.894049 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:41.894027 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-rht6r" event={"ID":"16863009-e8d0-462f-a57e-3c4e82142141","Type":"ContainerDied","Data":"4fbb54bfff69ace8552057735dbbfb54ebd0b65c6eeb249fc9ef444e46ccea93"} Jun 09 20:57:41.894107 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:41.894093 2557 scope.go:117] "RemoveContainer" containerID="de37c37a05751646a9e6c74e75cb4d703a01d3ee3e466cb51d67db7276aa8269" Jun 09 20:57:41.894333 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:41.894313 2557 scope.go:117] "RemoveContainer" containerID="4fbb54bfff69ace8552057735dbbfb54ebd0b65c6eeb249fc9ef444e46ccea93" Jun 09 20:57:41.894556 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:57:41.894533 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-rht6r_openshift-console-operator(16863009-e8d0-462f-a57e-3c4e82142141)\"" pod="openshift-console-operator/console-operator-668fdbf85c-rht6r" podUID="16863009-e8d0-462f-a57e-3c4e82142141" Jun 09 20:57:42.898391 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:42.898347 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rht6r_16863009-e8d0-462f-a57e-3c4e82142141/console-operator/1.log" Jun 09 20:57:42.898955 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:42.898709 2557 scope.go:117] "RemoveContainer" containerID="4fbb54bfff69ace8552057735dbbfb54ebd0b65c6eeb249fc9ef444e46ccea93" Jun 09 20:57:42.898955 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:57:42.898869 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-rht6r_openshift-console-operator(16863009-e8d0-462f-a57e-3c4e82142141)\"" pod="openshift-console-operator/console-operator-668fdbf85c-rht6r" podUID="16863009-e8d0-462f-a57e-3c4e82142141" Jun 09 20:57:43.834989 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:43.834956 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-cknzk"] Jun 09 20:57:43.839142 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:43.839120 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-cknzk" Jun 09 20:57:43.841187 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:43.841169 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 09 20:57:43.841593 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:43.841556 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 09 20:57:43.841714 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:43.841622 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 09 20:57:43.843174 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:43.842141 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-9qs2f\"" Jun 09 20:57:43.843174 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:43.842141 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 09 20:57:43.846241 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:43.845495 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-cknzk"] Jun 09 20:57:43.992144 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:43.992103 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tfs8\" (UniqueName: \"kubernetes.io/projected/d36ad6a3-8964-4429-936e-fa7f06118f4f-kube-api-access-6tfs8\") pod \"service-ca-7d74d578b8-cknzk\" (UID: \"d36ad6a3-8964-4429-936e-fa7f06118f4f\") " pod="openshift-service-ca/service-ca-7d74d578b8-cknzk" Jun 09 20:57:43.992144 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:43.992145 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d36ad6a3-8964-4429-936e-fa7f06118f4f-signing-cabundle\") pod \"service-ca-7d74d578b8-cknzk\" (UID: \"d36ad6a3-8964-4429-936e-fa7f06118f4f\") " pod="openshift-service-ca/service-ca-7d74d578b8-cknzk" Jun 09 20:57:43.992633 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:43.992279 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d36ad6a3-8964-4429-936e-fa7f06118f4f-signing-key\") pod \"service-ca-7d74d578b8-cknzk\" (UID: \"d36ad6a3-8964-4429-936e-fa7f06118f4f\") " pod="openshift-service-ca/service-ca-7d74d578b8-cknzk" Jun 09 20:57:44.093584 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:44.093499 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tfs8\" (UniqueName: \"kubernetes.io/projected/d36ad6a3-8964-4429-936e-fa7f06118f4f-kube-api-access-6tfs8\") pod \"service-ca-7d74d578b8-cknzk\" (UID: \"d36ad6a3-8964-4429-936e-fa7f06118f4f\") " pod="openshift-service-ca/service-ca-7d74d578b8-cknzk" Jun 09 20:57:44.093584 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:44.093539 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d36ad6a3-8964-4429-936e-fa7f06118f4f-signing-cabundle\") pod \"service-ca-7d74d578b8-cknzk\" (UID: \"d36ad6a3-8964-4429-936e-fa7f06118f4f\") " pod="openshift-service-ca/service-ca-7d74d578b8-cknzk" Jun 09 20:57:44.093796 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:44.093638 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d36ad6a3-8964-4429-936e-fa7f06118f4f-signing-key\") pod \"service-ca-7d74d578b8-cknzk\" (UID: \"d36ad6a3-8964-4429-936e-fa7f06118f4f\") " pod="openshift-service-ca/service-ca-7d74d578b8-cknzk" Jun 09 20:57:44.094269 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:44.094240 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d36ad6a3-8964-4429-936e-fa7f06118f4f-signing-cabundle\") pod \"service-ca-7d74d578b8-cknzk\" (UID: \"d36ad6a3-8964-4429-936e-fa7f06118f4f\") " pod="openshift-service-ca/service-ca-7d74d578b8-cknzk" Jun 09 20:57:44.096152 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:44.096118 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d36ad6a3-8964-4429-936e-fa7f06118f4f-signing-key\") pod \"service-ca-7d74d578b8-cknzk\" (UID: \"d36ad6a3-8964-4429-936e-fa7f06118f4f\") " pod="openshift-service-ca/service-ca-7d74d578b8-cknzk" Jun 09 20:57:44.101458 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:44.101430 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tfs8\" (UniqueName: \"kubernetes.io/projected/d36ad6a3-8964-4429-936e-fa7f06118f4f-kube-api-access-6tfs8\") pod \"service-ca-7d74d578b8-cknzk\" (UID: \"d36ad6a3-8964-4429-936e-fa7f06118f4f\") " pod="openshift-service-ca/service-ca-7d74d578b8-cknzk" Jun 09 20:57:44.150275 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:44.150237 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-cknzk" Jun 09 20:57:44.276510 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:44.276480 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-cknzk"] Jun 09 20:57:44.279994 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:57:44.279959 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd36ad6a3_8964_4429_936e_fa7f06118f4f.slice/crio-fdb666583069794c963a4883c8f39e0af5f32d4d682c5bc71297da72b1542973 WatchSource:0}: Error finding container fdb666583069794c963a4883c8f39e0af5f32d4d682c5bc71297da72b1542973: Status 404 returned error can't find the container with id fdb666583069794c963a4883c8f39e0af5f32d4d682c5bc71297da72b1542973 Jun 09 20:57:44.285317 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:44.285296 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jzlgv_48ea32f0-3aed-49d4-bd34-2c0bc6a8b251/dns-node-resolver/0.log" Jun 09 20:57:44.886454 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:44.886427 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7dxwm_84c09f0a-64ef-41e7-b1ca-c16ae3eeb4f9/node-ca/0.log" Jun 09 20:57:44.905228 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:44.905190 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-cknzk" event={"ID":"d36ad6a3-8964-4429-936e-fa7f06118f4f","Type":"ContainerStarted","Data":"8b1392e39a0469b5b31815f0a8ed160a70a7ffcd916aa4e0adc31933e73d261f"} Jun 09 20:57:44.905408 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:44.905257 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-cknzk" event={"ID":"d36ad6a3-8964-4429-936e-fa7f06118f4f","Type":"ContainerStarted","Data":"fdb666583069794c963a4883c8f39e0af5f32d4d682c5bc71297da72b1542973"} Jun 09 20:57:44.922508 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:44.922452 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-cknzk" podStartSLOduration=1.922435547 podStartE2EDuration="1.922435547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 20:57:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:57:44.9212869 +0000 UTC m=+217.256976103" watchObservedRunningTime="2026-06-09 20:57:44.922435547 +0000 UTC m=+217.258124751" Jun 09 20:57:45.203784 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:45.203738 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-9kr2d\" (UID: \"09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9kr2d" Jun 09 20:57:45.204175 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:57:45.203895 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 20:57:45.204175 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:57:45.203967 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c-samples-operator-tls podName:09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c nodeName:}" failed. No retries permitted until 2026-06-09 20:57:53.203948925 +0000 UTC m=+225.539638108 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-9kr2d" (UID: "09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c") : secret "samples-operator-tls" not found Jun 09 20:57:45.304298 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:45.304255 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5080444f-d21e-402b-bd46-e0b5c24a6baf-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-znt5k\" (UID: \"5080444f-d21e-402b-bd46-e0b5c24a6baf\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-znt5k" Jun 09 20:57:45.304483 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:57:45.304393 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 20:57:45.304483 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:57:45.304449 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5080444f-d21e-402b-bd46-e0b5c24a6baf-networking-console-plugin-cert podName:5080444f-d21e-402b-bd46-e0b5c24a6baf nodeName:}" failed. No retries permitted until 2026-06-09 20:57:53.304434486 +0000 UTC m=+225.640123668 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5080444f-d21e-402b-bd46-e0b5c24a6baf-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-znt5k" (UID: "5080444f-d21e-402b-bd46-e0b5c24a6baf") : secret "networking-console-plugin-cert" not found Jun 09 20:57:46.086343 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:46.086304 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vdjv9_24a48d8d-ec0f-4be8-9c45-791c56450da6/serve-healthcheck-canary/0.log" Jun 09 20:57:47.848199 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:47.848152 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-rht6r" Jun 09 20:57:47.848614 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:47.848232 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-rht6r" Jun 09 20:57:47.848614 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:47.848602 2557 scope.go:117] "RemoveContainer" containerID="4fbb54bfff69ace8552057735dbbfb54ebd0b65c6eeb249fc9ef444e46ccea93" Jun 09 20:57:47.848777 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:57:47.848755 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-rht6r_openshift-console-operator(16863009-e8d0-462f-a57e-3c4e82142141)\"" pod="openshift-console-operator/console-operator-668fdbf85c-rht6r" podUID="16863009-e8d0-462f-a57e-3c4e82142141" Jun 09 20:57:53.272273 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:53.272231 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-9kr2d\" (UID: \"09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9kr2d" Jun 09 20:57:53.274825 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:53.274804 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-9kr2d\" (UID: \"09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9kr2d" Jun 09 20:57:53.333079 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:53.333021 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9kr2d" Jun 09 20:57:53.373237 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:53.373196 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5080444f-d21e-402b-bd46-e0b5c24a6baf-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-znt5k\" (UID: \"5080444f-d21e-402b-bd46-e0b5c24a6baf\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-znt5k" Jun 09 20:57:53.373400 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:57:53.373357 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 20:57:53.373460 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:57:53.373444 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5080444f-d21e-402b-bd46-e0b5c24a6baf-networking-console-plugin-cert podName:5080444f-d21e-402b-bd46-e0b5c24a6baf nodeName:}" failed. No retries permitted until 2026-06-09 20:58:09.373427858 +0000 UTC m=+241.709117039 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5080444f-d21e-402b-bd46-e0b5c24a6baf-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-znt5k" (UID: "5080444f-d21e-402b-bd46-e0b5c24a6baf") : secret "networking-console-plugin-cert" not found Jun 09 20:57:53.462357 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:53.462324 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9kr2d"] Jun 09 20:57:53.933999 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:53.933961 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9kr2d" event={"ID":"09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c","Type":"ContainerStarted","Data":"a91b494200561d71f38f8053f853deb4e8f51383bacc8043d7bbb5b87e925ce7"} Jun 09 20:57:55.942363 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:55.942320 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9kr2d" event={"ID":"09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c","Type":"ContainerStarted","Data":"d6238dd4a3eb70380fff609eb3478f9a2b25b9c0c16aad80e7e677868e9335e3"} Jun 09 20:57:55.942747 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:55.942406 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9kr2d" event={"ID":"09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c","Type":"ContainerStarted","Data":"3df912abb4b80b54383a949eb238211e22013ca8db34ee7c0fbef9e59b8356dc"} Jun 09 20:57:55.957456 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:57:55.957404 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9kr2d" podStartSLOduration=17.195020436 podStartE2EDuration="18.95738762s" totalImagesPullingTime="1.762367184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 20:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:57:55.956537901 +0000 UTC m=+228.292227105" watchObservedRunningTime="2026-06-09 20:57:55.95738762 +0000 UTC m=+228.293076815" Jun 09 20:58:00.185526 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:00.185488 2557 scope.go:117] "RemoveContainer" containerID="4fbb54bfff69ace8552057735dbbfb54ebd0b65c6eeb249fc9ef444e46ccea93" Jun 09 20:58:00.958254 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:00.958225 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rht6r_16863009-e8d0-462f-a57e-3c4e82142141/console-operator/2.log" Jun 09 20:58:00.958666 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:00.958650 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rht6r_16863009-e8d0-462f-a57e-3c4e82142141/console-operator/1.log" Jun 09 20:58:00.958733 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:00.958687 2557 generic.go:356] "Generic (PLEG): container finished" podID="16863009-e8d0-462f-a57e-3c4e82142141" containerID="67e9a3f74bfc416872b3741dfe71aa825619e14ccf146b16704682e4066861db" exitCode=255 Jun 09 20:58:00.958781 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:00.958762 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-rht6r" event={"ID":"16863009-e8d0-462f-a57e-3c4e82142141","Type":"ContainerDied","Data":"67e9a3f74bfc416872b3741dfe71aa825619e14ccf146b16704682e4066861db"} Jun 09 20:58:00.958830 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:00.958820 2557 scope.go:117] "RemoveContainer" containerID="4fbb54bfff69ace8552057735dbbfb54ebd0b65c6eeb249fc9ef444e46ccea93" Jun 09 20:58:00.959179 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:00.959158 2557 scope.go:117] "RemoveContainer" containerID="67e9a3f74bfc416872b3741dfe71aa825619e14ccf146b16704682e4066861db" Jun 09 20:58:00.959368 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:58:00.959343 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-rht6r_openshift-console-operator(16863009-e8d0-462f-a57e-3c4e82142141)\"" pod="openshift-console-operator/console-operator-668fdbf85c-rht6r" podUID="16863009-e8d0-462f-a57e-3c4e82142141" Jun 09 20:58:01.962966 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:01.962928 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rht6r_16863009-e8d0-462f-a57e-3c4e82142141/console-operator/2.log" Jun 09 20:58:02.340962 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.340881 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-trd6h"] Jun 09 20:58:02.345362 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.345333 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-trd6h" Jun 09 20:58:02.348305 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.348149 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 20:58:02.348973 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.348827 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 20:58:02.350764 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.349052 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 20:58:02.350764 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.349124 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4j9nx\"" Jun 09 20:58:02.350764 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.349330 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 20:58:02.354515 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.354488 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-trd6h"] Jun 09 20:58:02.398519 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.398486 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-q62l2"] Jun 09 20:58:02.401637 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.401614 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-q62l2" Jun 09 20:58:02.403746 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.403717 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-sddv9\"" Jun 09 20:58:02.403922 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.403758 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 09 20:58:02.416492 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.416467 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-q62l2"] Jun 09 20:58:02.445805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.445707 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xkfl\" (UniqueName: \"kubernetes.io/projected/eb084e3b-33da-4cbd-bb7f-510feafccb62-kube-api-access-5xkfl\") pod \"insights-runtime-extractor-trd6h\" (UID: \"eb084e3b-33da-4cbd-bb7f-510feafccb62\") " pod="openshift-insights/insights-runtime-extractor-trd6h" Jun 09 20:58:02.445805 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.445782 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eb084e3b-33da-4cbd-bb7f-510feafccb62-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trd6h\" (UID: \"eb084e3b-33da-4cbd-bb7f-510feafccb62\") " pod="openshift-insights/insights-runtime-extractor-trd6h" Jun 09 20:58:02.446012 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.445858 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eb084e3b-33da-4cbd-bb7f-510feafccb62-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trd6h\" (UID: \"eb084e3b-33da-4cbd-bb7f-510feafccb62\") " pod="openshift-insights/insights-runtime-extractor-trd6h" Jun 09 20:58:02.446012 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.445911 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb084e3b-33da-4cbd-bb7f-510feafccb62-data-volume\") pod \"insights-runtime-extractor-trd6h\" (UID: \"eb084e3b-33da-4cbd-bb7f-510feafccb62\") " pod="openshift-insights/insights-runtime-extractor-trd6h" Jun 09 20:58:02.446012 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.445941 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eb084e3b-33da-4cbd-bb7f-510feafccb62-crio-socket\") pod \"insights-runtime-extractor-trd6h\" (UID: \"eb084e3b-33da-4cbd-bb7f-510feafccb62\") " pod="openshift-insights/insights-runtime-extractor-trd6h" Jun 09 20:58:02.546759 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.546722 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3dd9dd28-71b3-4dae-86db-cb13d03308f4-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-q62l2\" (UID: \"3dd9dd28-71b3-4dae-86db-cb13d03308f4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-q62l2" Jun 09 20:58:02.546949 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.546792 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xkfl\" (UniqueName: \"kubernetes.io/projected/eb084e3b-33da-4cbd-bb7f-510feafccb62-kube-api-access-5xkfl\") pod \"insights-runtime-extractor-trd6h\" (UID: \"eb084e3b-33da-4cbd-bb7f-510feafccb62\") " pod="openshift-insights/insights-runtime-extractor-trd6h" Jun 09 20:58:02.546949 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.546840 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eb084e3b-33da-4cbd-bb7f-510feafccb62-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trd6h\" (UID: \"eb084e3b-33da-4cbd-bb7f-510feafccb62\") " pod="openshift-insights/insights-runtime-extractor-trd6h" Jun 09 20:58:02.546949 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.546871 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eb084e3b-33da-4cbd-bb7f-510feafccb62-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trd6h\" (UID: \"eb084e3b-33da-4cbd-bb7f-510feafccb62\") " pod="openshift-insights/insights-runtime-extractor-trd6h" Jun 09 20:58:02.546949 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.546908 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb084e3b-33da-4cbd-bb7f-510feafccb62-data-volume\") pod \"insights-runtime-extractor-trd6h\" (UID: \"eb084e3b-33da-4cbd-bb7f-510feafccb62\") " pod="openshift-insights/insights-runtime-extractor-trd6h" Jun 09 20:58:02.547140 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.547022 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eb084e3b-33da-4cbd-bb7f-510feafccb62-crio-socket\") pod \"insights-runtime-extractor-trd6h\" (UID: \"eb084e3b-33da-4cbd-bb7f-510feafccb62\") " pod="openshift-insights/insights-runtime-extractor-trd6h" Jun 09 20:58:02.547140 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.547112 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eb084e3b-33da-4cbd-bb7f-510feafccb62-crio-socket\") pod \"insights-runtime-extractor-trd6h\" (UID: \"eb084e3b-33da-4cbd-bb7f-510feafccb62\") " pod="openshift-insights/insights-runtime-extractor-trd6h" Jun 09 20:58:02.547312 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.547293 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb084e3b-33da-4cbd-bb7f-510feafccb62-data-volume\") pod \"insights-runtime-extractor-trd6h\" (UID: \"eb084e3b-33da-4cbd-bb7f-510feafccb62\") " pod="openshift-insights/insights-runtime-extractor-trd6h" Jun 09 20:58:02.547525 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.547510 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eb084e3b-33da-4cbd-bb7f-510feafccb62-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trd6h\" (UID: \"eb084e3b-33da-4cbd-bb7f-510feafccb62\") " pod="openshift-insights/insights-runtime-extractor-trd6h" Jun 09 20:58:02.549365 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.549347 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eb084e3b-33da-4cbd-bb7f-510feafccb62-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trd6h\" (UID: \"eb084e3b-33da-4cbd-bb7f-510feafccb62\") " pod="openshift-insights/insights-runtime-extractor-trd6h" Jun 09 20:58:02.560190 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.560160 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xkfl\" (UniqueName: \"kubernetes.io/projected/eb084e3b-33da-4cbd-bb7f-510feafccb62-kube-api-access-5xkfl\") pod \"insights-runtime-extractor-trd6h\" (UID: \"eb084e3b-33da-4cbd-bb7f-510feafccb62\") " pod="openshift-insights/insights-runtime-extractor-trd6h" Jun 09 20:58:02.647695 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.647600 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3dd9dd28-71b3-4dae-86db-cb13d03308f4-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-q62l2\" (UID: \"3dd9dd28-71b3-4dae-86db-cb13d03308f4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-q62l2" Jun 09 20:58:02.650162 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.650133 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3dd9dd28-71b3-4dae-86db-cb13d03308f4-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-q62l2\" (UID: \"3dd9dd28-71b3-4dae-86db-cb13d03308f4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-q62l2" Jun 09 20:58:02.659046 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.659021 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-trd6h" Jun 09 20:58:02.711207 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.711178 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-q62l2" Jun 09 20:58:02.805489 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.805458 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-trd6h"] Jun 09 20:58:02.809401 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:58:02.809352 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb084e3b_33da_4cbd_bb7f_510feafccb62.slice/crio-675cd880d3eb40333d4a02b193ed00ef71c0da63b318073253f528da088e5f2c WatchSource:0}: Error finding container 675cd880d3eb40333d4a02b193ed00ef71c0da63b318073253f528da088e5f2c: Status 404 returned error can't find the container with id 675cd880d3eb40333d4a02b193ed00ef71c0da63b318073253f528da088e5f2c Jun 09 20:58:02.853954 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.853923 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-q62l2"] Jun 09 20:58:02.856544 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:58:02.856518 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dd9dd28_71b3_4dae_86db_cb13d03308f4.slice/crio-0b1b2b2c1ce45df8dcc100af20ee555d4bc1763a461b9a0d9a768cb2d91be60a WatchSource:0}: Error finding container 0b1b2b2c1ce45df8dcc100af20ee555d4bc1763a461b9a0d9a768cb2d91be60a: Status 404 returned error can't find the container with id 0b1b2b2c1ce45df8dcc100af20ee555d4bc1763a461b9a0d9a768cb2d91be60a Jun 09 20:58:02.967688 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.967650 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-q62l2" event={"ID":"3dd9dd28-71b3-4dae-86db-cb13d03308f4","Type":"ContainerStarted","Data":"0b1b2b2c1ce45df8dcc100af20ee555d4bc1763a461b9a0d9a768cb2d91be60a"} Jun 09 20:58:02.969070 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.969041 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-trd6h" event={"ID":"eb084e3b-33da-4cbd-bb7f-510feafccb62","Type":"ContainerStarted","Data":"0dec0c6a646b0aabd251e953f9d7b280c5de7bf270cdb5d8a9e820d1f058ef82"} Jun 09 20:58:02.969189 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:02.969101 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-trd6h" event={"ID":"eb084e3b-33da-4cbd-bb7f-510feafccb62","Type":"ContainerStarted","Data":"675cd880d3eb40333d4a02b193ed00ef71c0da63b318073253f528da088e5f2c"} Jun 09 20:58:03.975286 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:03.975252 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-trd6h" event={"ID":"eb084e3b-33da-4cbd-bb7f-510feafccb62","Type":"ContainerStarted","Data":"6ad28d41ac50277778108c9e1027486847dab9640d84dc43bbaa3df954a4b9de"} Jun 09 20:58:04.980923 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:04.980887 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-q62l2" event={"ID":"3dd9dd28-71b3-4dae-86db-cb13d03308f4","Type":"ContainerStarted","Data":"5f9dd73386d680fb0ee927d89cc547fd4368be22f1a79a41af0dd16bb89f1dff"} Jun 09 20:58:04.981350 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:04.980955 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-q62l2" Jun 09 20:58:04.986240 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:04.986202 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-q62l2" Jun 09 20:58:04.996709 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:04.996648 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-q62l2" podStartSLOduration=1.891153837 podStartE2EDuration="2.996628248s" totalImagesPullingTime="1.105474411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 20:58:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:58:04.996086725 +0000 UTC m=+237.331775931" watchObservedRunningTime="2026-06-09 20:58:04.996628248 +0000 UTC m=+237.332317450" Jun 09 20:58:05.197999 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:05.197975 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-rrl6m"] Jun 09 20:58:05.200960 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:05.200941 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-rrl6m" Jun 09 20:58:05.203965 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:05.203939 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 09 20:58:05.204076 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:05.203972 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 20:58:05.204076 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:05.204002 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xkz7p\"" Jun 09 20:58:05.204391 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:05.204359 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 09 20:58:05.204391 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:05.204390 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 20:58:05.204529 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:05.204360 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 20:58:05.210915 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:05.210883 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-rrl6m"] Jun 09 20:58:05.369414 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:05.369292 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b86458c7-8635-4327-afa3-7e361d17d87e-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-rrl6m\" (UID: \"b86458c7-8635-4327-afa3-7e361d17d87e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-rrl6m" Jun 09 20:58:05.369556 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:05.369439 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b86458c7-8635-4327-afa3-7e361d17d87e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-rrl6m\" (UID: \"b86458c7-8635-4327-afa3-7e361d17d87e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-rrl6m" Jun 09 20:58:05.369556 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:05.369468 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b86458c7-8635-4327-afa3-7e361d17d87e-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-rrl6m\" (UID: \"b86458c7-8635-4327-afa3-7e361d17d87e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-rrl6m" Jun 09 20:58:05.369556 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:05.369487 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq75r\" (UniqueName: \"kubernetes.io/projected/b86458c7-8635-4327-afa3-7e361d17d87e-kube-api-access-xq75r\") pod \"prometheus-operator-7f7d445d84-rrl6m\" (UID: \"b86458c7-8635-4327-afa3-7e361d17d87e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-rrl6m" Jun 09 20:58:05.470831 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:05.470781 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b86458c7-8635-4327-afa3-7e361d17d87e-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-rrl6m\" (UID: \"b86458c7-8635-4327-afa3-7e361d17d87e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-rrl6m" Jun 09 20:58:05.470986 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:05.470886 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b86458c7-8635-4327-afa3-7e361d17d87e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-rrl6m\" (UID: \"b86458c7-8635-4327-afa3-7e361d17d87e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-rrl6m" Jun 09 20:58:05.470986 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:05.470910 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b86458c7-8635-4327-afa3-7e361d17d87e-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-rrl6m\" (UID: \"b86458c7-8635-4327-afa3-7e361d17d87e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-rrl6m" Jun 09 20:58:05.470986 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:05.470929 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq75r\" (UniqueName: \"kubernetes.io/projected/b86458c7-8635-4327-afa3-7e361d17d87e-kube-api-access-xq75r\") pod \"prometheus-operator-7f7d445d84-rrl6m\" (UID: \"b86458c7-8635-4327-afa3-7e361d17d87e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-rrl6m" Jun 09 20:58:05.471516 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:05.471492 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b86458c7-8635-4327-afa3-7e361d17d87e-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-rrl6m\" (UID: \"b86458c7-8635-4327-afa3-7e361d17d87e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-rrl6m" Jun 09 20:58:05.473499 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:05.473476 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b86458c7-8635-4327-afa3-7e361d17d87e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-rrl6m\" (UID: \"b86458c7-8635-4327-afa3-7e361d17d87e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-rrl6m" Jun 09 20:58:05.473564 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:05.473549 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b86458c7-8635-4327-afa3-7e361d17d87e-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-rrl6m\" (UID: \"b86458c7-8635-4327-afa3-7e361d17d87e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-rrl6m" Jun 09 20:58:05.480487 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:05.480458 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq75r\" (UniqueName: \"kubernetes.io/projected/b86458c7-8635-4327-afa3-7e361d17d87e-kube-api-access-xq75r\") pod \"prometheus-operator-7f7d445d84-rrl6m\" (UID: \"b86458c7-8635-4327-afa3-7e361d17d87e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-rrl6m" Jun 09 20:58:05.509544 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:05.509506 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-rrl6m" Jun 09 20:58:05.655502 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:05.655414 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-rrl6m"] Jun 09 20:58:05.658860 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:58:05.658835 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb86458c7_8635_4327_afa3_7e361d17d87e.slice/crio-97e372050738856bd49e5e1ec6d5bde17366f4aa40036b963e9dcb2b9b1b2b10 WatchSource:0}: Error finding container 97e372050738856bd49e5e1ec6d5bde17366f4aa40036b963e9dcb2b9b1b2b10: Status 404 returned error can't find the container with id 97e372050738856bd49e5e1ec6d5bde17366f4aa40036b963e9dcb2b9b1b2b10 Jun 09 20:58:05.986271 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:05.986232 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-trd6h" event={"ID":"eb084e3b-33da-4cbd-bb7f-510feafccb62","Type":"ContainerStarted","Data":"bf80a4fc2753e3153b5b01d551903d5a68ee9317c2f761a7c7bc14ff2ab9c9ab"} Jun 09 20:58:05.987339 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:05.987317 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-rrl6m" event={"ID":"b86458c7-8635-4327-afa3-7e361d17d87e","Type":"ContainerStarted","Data":"97e372050738856bd49e5e1ec6d5bde17366f4aa40036b963e9dcb2b9b1b2b10"} Jun 09 20:58:06.003113 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:06.003062 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-trd6h" podStartSLOduration=1.8030572710000001 podStartE2EDuration="4.00304756s" totalImagesPullingTime="2.199990289s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 20:58:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:58:06.00175063 +0000 UTC m=+238.337439833" watchObservedRunningTime="2026-06-09 20:58:06.00304756 +0000 UTC m=+238.338736764" Jun 09 20:58:07.848141 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:07.848095 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-rht6r" Jun 09 20:58:07.848601 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:07.848166 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-rht6r" Jun 09 20:58:07.848601 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:07.848518 2557 scope.go:117] "RemoveContainer" containerID="67e9a3f74bfc416872b3741dfe71aa825619e14ccf146b16704682e4066861db" Jun 09 20:58:07.848698 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:58:07.848656 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-rht6r_openshift-console-operator(16863009-e8d0-462f-a57e-3c4e82142141)\"" pod="openshift-console-operator/console-operator-668fdbf85c-rht6r" podUID="16863009-e8d0-462f-a57e-3c4e82142141" Jun 09 20:58:07.994793 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:07.994739 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-rrl6m" event={"ID":"b86458c7-8635-4327-afa3-7e361d17d87e","Type":"ContainerStarted","Data":"3579ad17f5e960b61670144f628b72506600fb15e98f740dd7a8418067da3f35"} Jun 09 20:58:07.994970 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:07.994822 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-rrl6m" event={"ID":"b86458c7-8635-4327-afa3-7e361d17d87e","Type":"ContainerStarted","Data":"a801e35d28a10d841cc0401d8fc4b8c3a2fb9178bd65f7b03077afe5f50f3140"} Jun 09 20:58:08.011273 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:08.011217 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-rrl6m" podStartSLOduration=1.29925909 podStartE2EDuration="3.011199882s" totalImagesPullingTime="1.711940792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 20:58:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:58:08.010519024 +0000 UTC m=+240.346208219" watchObservedRunningTime="2026-06-09 20:58:08.011199882 +0000 UTC m=+240.346889085" Jun 09 20:58:09.405912 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.405858 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5080444f-d21e-402b-bd46-e0b5c24a6baf-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-znt5k\" (UID: \"5080444f-d21e-402b-bd46-e0b5c24a6baf\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-znt5k" Jun 09 20:58:09.408512 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.408478 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5080444f-d21e-402b-bd46-e0b5c24a6baf-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-znt5k\" (UID: \"5080444f-d21e-402b-bd46-e0b5c24a6baf\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-znt5k" Jun 09 20:58:09.515057 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.515015 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-6xbpf"] Jun 09 20:58:09.520139 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.520117 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xbpf" Jun 09 20:58:09.524196 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.524140 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 09 20:58:09.524347 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.524254 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-bxw46\"" Jun 09 20:58:09.524596 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.524568 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 09 20:58:09.529790 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.529764 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-6xbpf"] Jun 09 20:58:09.591064 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.591030 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6927g"] Jun 09 20:58:09.594419 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.594396 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6927g" Jun 09 20:58:09.596337 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.596314 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 20:58:09.596567 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.596544 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 20:58:09.596755 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.596661 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tspqd\"" Jun 09 20:58:09.596883 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.596808 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 20:58:09.639888 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.639858 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9lrps\"" Jun 09 20:58:09.648751 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.648727 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-znt5k" Jun 09 20:58:09.708192 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.708157 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhl78\" (UniqueName: \"kubernetes.io/projected/fad38352-fac6-4a9f-9ba0-088e5a9c7569-kube-api-access-rhl78\") pod \"openshift-state-metrics-65f78d5c66-6xbpf\" (UID: \"fad38352-fac6-4a9f-9ba0-088e5a9c7569\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xbpf" Jun 09 20:58:09.708349 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.708202 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e22b6d64-f9c2-4387-9534-92af9d1654e8-metrics-client-ca\") pod \"node-exporter-6927g\" (UID: \"e22b6d64-f9c2-4387-9534-92af9d1654e8\") " pod="openshift-monitoring/node-exporter-6927g" Jun 09 20:58:09.708349 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.708233 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e22b6d64-f9c2-4387-9534-92af9d1654e8-sys\") pod \"node-exporter-6927g\" (UID: \"e22b6d64-f9c2-4387-9534-92af9d1654e8\") " pod="openshift-monitoring/node-exporter-6927g" Jun 09 20:58:09.708349 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.708250 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e22b6d64-f9c2-4387-9534-92af9d1654e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-6927g\" (UID: \"e22b6d64-f9c2-4387-9534-92af9d1654e8\") " pod="openshift-monitoring/node-exporter-6927g" Jun 09 20:58:09.708349 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.708280 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fad38352-fac6-4a9f-9ba0-088e5a9c7569-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-6xbpf\" (UID: \"fad38352-fac6-4a9f-9ba0-088e5a9c7569\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xbpf" Jun 09 20:58:09.708349 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.708343 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e22b6d64-f9c2-4387-9534-92af9d1654e8-root\") pod \"node-exporter-6927g\" (UID: \"e22b6d64-f9c2-4387-9534-92af9d1654e8\") " pod="openshift-monitoring/node-exporter-6927g" Jun 09 20:58:09.708646 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.708388 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e22b6d64-f9c2-4387-9534-92af9d1654e8-node-exporter-textfile\") pod \"node-exporter-6927g\" (UID: \"e22b6d64-f9c2-4387-9534-92af9d1654e8\") " pod="openshift-monitoring/node-exporter-6927g" Jun 09 20:58:09.708646 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.708432 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e22b6d64-f9c2-4387-9534-92af9d1654e8-node-exporter-wtmp\") pod \"node-exporter-6927g\" (UID: \"e22b6d64-f9c2-4387-9534-92af9d1654e8\") " pod="openshift-monitoring/node-exporter-6927g" Jun 09 20:58:09.708646 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.708449 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e22b6d64-f9c2-4387-9534-92af9d1654e8-node-exporter-tls\") pod \"node-exporter-6927g\" (UID: \"e22b6d64-f9c2-4387-9534-92af9d1654e8\") " pod="openshift-monitoring/node-exporter-6927g" Jun 09 20:58:09.708646 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.708476 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e22b6d64-f9c2-4387-9534-92af9d1654e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6927g\" (UID: \"e22b6d64-f9c2-4387-9534-92af9d1654e8\") " pod="openshift-monitoring/node-exporter-6927g" Jun 09 20:58:09.708646 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.708525 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbnsg\" (UniqueName: \"kubernetes.io/projected/e22b6d64-f9c2-4387-9534-92af9d1654e8-kube-api-access-hbnsg\") pod \"node-exporter-6927g\" (UID: \"e22b6d64-f9c2-4387-9534-92af9d1654e8\") " pod="openshift-monitoring/node-exporter-6927g" Jun 09 20:58:09.708646 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.708565 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fad38352-fac6-4a9f-9ba0-088e5a9c7569-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-6xbpf\" (UID: \"fad38352-fac6-4a9f-9ba0-088e5a9c7569\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xbpf" Jun 09 20:58:09.708646 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.708605 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fad38352-fac6-4a9f-9ba0-088e5a9c7569-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-6xbpf\" (UID: \"fad38352-fac6-4a9f-9ba0-088e5a9c7569\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xbpf" Jun 09 20:58:09.786719 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.786686 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-znt5k"] Jun 09 20:58:09.790562 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:58:09.790528 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5080444f_d21e_402b_bd46_e0b5c24a6baf.slice/crio-aed83719d78231fa1df404240dd4351722ba707c19ce6ebc70bd0916ba5567fe WatchSource:0}: Error finding container aed83719d78231fa1df404240dd4351722ba707c19ce6ebc70bd0916ba5567fe: Status 404 returned error can't find the container with id aed83719d78231fa1df404240dd4351722ba707c19ce6ebc70bd0916ba5567fe Jun 09 20:58:09.809702 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.809677 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fad38352-fac6-4a9f-9ba0-088e5a9c7569-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-6xbpf\" (UID: \"fad38352-fac6-4a9f-9ba0-088e5a9c7569\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xbpf" Jun 09 20:58:09.809865 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.809723 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fad38352-fac6-4a9f-9ba0-088e5a9c7569-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-6xbpf\" (UID: \"fad38352-fac6-4a9f-9ba0-088e5a9c7569\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xbpf" Jun 09 20:58:09.809865 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:58:09.809841 2557 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 09 20:58:09.809962 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:58:09.809899 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fad38352-fac6-4a9f-9ba0-088e5a9c7569-openshift-state-metrics-tls podName:fad38352-fac6-4a9f-9ba0-088e5a9c7569 nodeName:}" failed. No retries permitted until 2026-06-09 20:58:10.309882233 +0000 UTC m=+242.645571414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/fad38352-fac6-4a9f-9ba0-088e5a9c7569-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-6xbpf" (UID: "fad38352-fac6-4a9f-9ba0-088e5a9c7569") : secret "openshift-state-metrics-tls" not found Jun 09 20:58:09.809962 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.809927 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhl78\" (UniqueName: \"kubernetes.io/projected/fad38352-fac6-4a9f-9ba0-088e5a9c7569-kube-api-access-rhl78\") pod \"openshift-state-metrics-65f78d5c66-6xbpf\" (UID: \"fad38352-fac6-4a9f-9ba0-088e5a9c7569\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xbpf" Jun 09 20:58:09.810066 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.809982 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e22b6d64-f9c2-4387-9534-92af9d1654e8-metrics-client-ca\") pod \"node-exporter-6927g\" (UID: \"e22b6d64-f9c2-4387-9534-92af9d1654e8\") " pod="openshift-monitoring/node-exporter-6927g" Jun 09 20:58:09.810066 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.810017 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e22b6d64-f9c2-4387-9534-92af9d1654e8-sys\") pod \"node-exporter-6927g\" (UID: \"e22b6d64-f9c2-4387-9534-92af9d1654e8\") " pod="openshift-monitoring/node-exporter-6927g" Jun 09 20:58:09.810066 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.810043 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e22b6d64-f9c2-4387-9534-92af9d1654e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-6927g\" (UID: \"e22b6d64-f9c2-4387-9534-92af9d1654e8\") " pod="openshift-monitoring/node-exporter-6927g" Jun 09 20:58:09.810200 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.810079 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fad38352-fac6-4a9f-9ba0-088e5a9c7569-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-6xbpf\" (UID: \"fad38352-fac6-4a9f-9ba0-088e5a9c7569\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xbpf" Jun 09 20:58:09.810200 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.810123 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e22b6d64-f9c2-4387-9534-92af9d1654e8-root\") pod \"node-exporter-6927g\" (UID: \"e22b6d64-f9c2-4387-9534-92af9d1654e8\") " pod="openshift-monitoring/node-exporter-6927g" Jun 09 20:58:09.810200 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.810153 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e22b6d64-f9c2-4387-9534-92af9d1654e8-node-exporter-textfile\") pod \"node-exporter-6927g\" (UID: \"e22b6d64-f9c2-4387-9534-92af9d1654e8\") " pod="openshift-monitoring/node-exporter-6927g" Jun 09 20:58:09.810200 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.810157 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e22b6d64-f9c2-4387-9534-92af9d1654e8-sys\") pod \"node-exporter-6927g\" (UID: \"e22b6d64-f9c2-4387-9534-92af9d1654e8\") " pod="openshift-monitoring/node-exporter-6927g" Jun 09 20:58:09.810200 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.810188 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e22b6d64-f9c2-4387-9534-92af9d1654e8-node-exporter-wtmp\") pod \"node-exporter-6927g\" (UID: \"e22b6d64-f9c2-4387-9534-92af9d1654e8\") " pod="openshift-monitoring/node-exporter-6927g" Jun 09 20:58:09.810461 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.810213 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e22b6d64-f9c2-4387-9534-92af9d1654e8-node-exporter-tls\") pod \"node-exporter-6927g\" (UID: \"e22b6d64-f9c2-4387-9534-92af9d1654e8\") " pod="openshift-monitoring/node-exporter-6927g" Jun 09 20:58:09.810461 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.810221 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e22b6d64-f9c2-4387-9534-92af9d1654e8-root\") pod \"node-exporter-6927g\" (UID: \"e22b6d64-f9c2-4387-9534-92af9d1654e8\") " pod="openshift-monitoring/node-exporter-6927g" Jun 09 20:58:09.810461 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.810237 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e22b6d64-f9c2-4387-9534-92af9d1654e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6927g\" (UID: \"e22b6d64-f9c2-4387-9534-92af9d1654e8\") " pod="openshift-monitoring/node-exporter-6927g" Jun 09 20:58:09.810461 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.810281 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbnsg\" (UniqueName: \"kubernetes.io/projected/e22b6d64-f9c2-4387-9534-92af9d1654e8-kube-api-access-hbnsg\") pod \"node-exporter-6927g\" (UID: \"e22b6d64-f9c2-4387-9534-92af9d1654e8\") " pod="openshift-monitoring/node-exporter-6927g" Jun 09 20:58:09.810461 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.810400 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e22b6d64-f9c2-4387-9534-92af9d1654e8-node-exporter-wtmp\") pod \"node-exporter-6927g\" (UID: \"e22b6d64-f9c2-4387-9534-92af9d1654e8\") " pod="openshift-monitoring/node-exporter-6927g" Jun 09 20:58:09.810697 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:58:09.810511 2557 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 09 20:58:09.810697 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:58:09.810576 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e22b6d64-f9c2-4387-9534-92af9d1654e8-node-exporter-tls podName:e22b6d64-f9c2-4387-9534-92af9d1654e8 nodeName:}" failed. No retries permitted until 2026-06-09 20:58:10.310557921 +0000 UTC m=+242.646247121 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e22b6d64-f9c2-4387-9534-92af9d1654e8-node-exporter-tls") pod "node-exporter-6927g" (UID: "e22b6d64-f9c2-4387-9534-92af9d1654e8") : secret "node-exporter-tls" not found Jun 09 20:58:09.810697 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.810611 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e22b6d64-f9c2-4387-9534-92af9d1654e8-metrics-client-ca\") pod \"node-exporter-6927g\" (UID: \"e22b6d64-f9c2-4387-9534-92af9d1654e8\") " pod="openshift-monitoring/node-exporter-6927g" Jun 09 20:58:09.810845 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.810797 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e22b6d64-f9c2-4387-9534-92af9d1654e8-node-exporter-textfile\") pod \"node-exporter-6927g\" (UID: \"e22b6d64-f9c2-4387-9534-92af9d1654e8\") " pod="openshift-monitoring/node-exporter-6927g" Jun 09 20:58:09.810956 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.810934 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fad38352-fac6-4a9f-9ba0-088e5a9c7569-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-6xbpf\" (UID: \"fad38352-fac6-4a9f-9ba0-088e5a9c7569\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xbpf" Jun 09 20:58:09.811033 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.811018 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e22b6d64-f9c2-4387-9534-92af9d1654e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-6927g\" (UID: \"e22b6d64-f9c2-4387-9534-92af9d1654e8\") " pod="openshift-monitoring/node-exporter-6927g" Jun 09 20:58:09.812693 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.812663 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fad38352-fac6-4a9f-9ba0-088e5a9c7569-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-6xbpf\" (UID: \"fad38352-fac6-4a9f-9ba0-088e5a9c7569\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xbpf" Jun 09 20:58:09.812993 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.812973 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e22b6d64-f9c2-4387-9534-92af9d1654e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6927g\" (UID: \"e22b6d64-f9c2-4387-9534-92af9d1654e8\") " pod="openshift-monitoring/node-exporter-6927g" Jun 09 20:58:09.817841 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.817815 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhl78\" (UniqueName: \"kubernetes.io/projected/fad38352-fac6-4a9f-9ba0-088e5a9c7569-kube-api-access-rhl78\") pod \"openshift-state-metrics-65f78d5c66-6xbpf\" (UID: \"fad38352-fac6-4a9f-9ba0-088e5a9c7569\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xbpf" Jun 09 20:58:09.818242 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:09.818223 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbnsg\" (UniqueName: \"kubernetes.io/projected/e22b6d64-f9c2-4387-9534-92af9d1654e8-kube-api-access-hbnsg\") pod \"node-exporter-6927g\" (UID: \"e22b6d64-f9c2-4387-9534-92af9d1654e8\") " pod="openshift-monitoring/node-exporter-6927g" Jun 09 20:58:10.002861 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.002825 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-znt5k" event={"ID":"5080444f-d21e-402b-bd46-e0b5c24a6baf","Type":"ContainerStarted","Data":"aed83719d78231fa1df404240dd4351722ba707c19ce6ebc70bd0916ba5567fe"} Jun 09 20:58:10.314746 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.314661 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e22b6d64-f9c2-4387-9534-92af9d1654e8-node-exporter-tls\") pod \"node-exporter-6927g\" (UID: \"e22b6d64-f9c2-4387-9534-92af9d1654e8\") " pod="openshift-monitoring/node-exporter-6927g" Jun 09 20:58:10.314746 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.314714 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fad38352-fac6-4a9f-9ba0-088e5a9c7569-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-6xbpf\" (UID: \"fad38352-fac6-4a9f-9ba0-088e5a9c7569\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xbpf" Jun 09 20:58:10.317151 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.317131 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e22b6d64-f9c2-4387-9534-92af9d1654e8-node-exporter-tls\") pod \"node-exporter-6927g\" (UID: \"e22b6d64-f9c2-4387-9534-92af9d1654e8\") " pod="openshift-monitoring/node-exporter-6927g" Jun 09 20:58:10.317281 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.317263 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fad38352-fac6-4a9f-9ba0-088e5a9c7569-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-6xbpf\" (UID: \"fad38352-fac6-4a9f-9ba0-088e5a9c7569\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xbpf" Jun 09 20:58:10.432481 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.432448 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xbpf" Jun 09 20:58:10.505784 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.505724 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6927g" Jun 09 20:58:10.522151 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:58:10.522110 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode22b6d64_f9c2_4387_9534_92af9d1654e8.slice/crio-ae6755807821d9214ba5d4701053cc83fe967d7b5629a343efd4bcb73c37d0ca WatchSource:0}: Error finding container ae6755807821d9214ba5d4701053cc83fe967d7b5629a343efd4bcb73c37d0ca: Status 404 returned error can't find the container with id ae6755807821d9214ba5d4701053cc83fe967d7b5629a343efd4bcb73c37d0ca Jun 09 20:58:10.581699 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.581618 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 20:58:10.586772 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.586745 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.588728 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.588699 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 20:58:10.590962 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.590925 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 20:58:10.591241 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.591221 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 20:58:10.591480 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.591341 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 20:58:10.591480 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.591426 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 20:58:10.591480 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.591032 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jpt5c\"" Jun 09 20:58:10.591480 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.591222 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 20:58:10.591695 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.591066 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 20:58:10.591695 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.591429 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 20:58:10.591897 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.591620 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 20:58:10.605773 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.605722 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 20:58:10.606772 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:58:10.606741 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfad38352_fac6_4a9f_9ba0_088e5a9c7569.slice/crio-d25ab0c0de372bf0252882156724534f39d980dbf4f3b746625b07432aa08aec WatchSource:0}: Error finding container d25ab0c0de372bf0252882156724534f39d980dbf4f3b746625b07432aa08aec: Status 404 returned error can't find the container with id d25ab0c0de372bf0252882156724534f39d980dbf4f3b746625b07432aa08aec Jun 09 20:58:10.607200 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.607163 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-6xbpf"] Jun 09 20:58:10.618476 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.618437 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-web-config\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.618573 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.618489 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbde15b6-bd7f-4971-a247-bcc088775d8a-config-out\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.618616 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.618571 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-config-volume\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.618658 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.618618 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbde15b6-bd7f-4971-a247-bcc088775d8a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.618695 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.618684 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.618736 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.618724 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbde15b6-bd7f-4971-a247-bcc088775d8a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.618792 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.618754 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.618859 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.618828 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.618914 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.618883 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.619012 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.618993 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbde15b6-bd7f-4971-a247-bcc088775d8a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.619065 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.619036 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbde15b6-bd7f-4971-a247-bcc088775d8a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.619112 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.619066 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.619167 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.619092 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qqfn\" (UniqueName: \"kubernetes.io/projected/dbde15b6-bd7f-4971-a247-bcc088775d8a-kube-api-access-6qqfn\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.720506 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.720398 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-config-volume\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.720506 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.720459 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbde15b6-bd7f-4971-a247-bcc088775d8a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.720506 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.720496 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.720697 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.720521 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbde15b6-bd7f-4971-a247-bcc088775d8a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.720697 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.720547 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.720697 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.720573 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.720697 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.720605 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.720697 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.720685 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbde15b6-bd7f-4971-a247-bcc088775d8a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.720876 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.720719 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbde15b6-bd7f-4971-a247-bcc088775d8a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.720876 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.720756 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.720876 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.720780 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qqfn\" (UniqueName: \"kubernetes.io/projected/dbde15b6-bd7f-4971-a247-bcc088775d8a-kube-api-access-6qqfn\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.720876 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.720815 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-web-config\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.720876 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.720838 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbde15b6-bd7f-4971-a247-bcc088775d8a-config-out\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.721083 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:58:10.720977 2557 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 09 20:58:10.721083 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:58:10.721052 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-secret-alertmanager-main-tls podName:dbde15b6-bd7f-4971-a247-bcc088775d8a nodeName:}" failed. No retries permitted until 2026-06-09 20:58:11.221030373 +0000 UTC m=+243.556719559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "dbde15b6-bd7f-4971-a247-bcc088775d8a") : secret "alertmanager-main-tls" not found Jun 09 20:58:10.721608 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.721247 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbde15b6-bd7f-4971-a247-bcc088775d8a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.721608 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:58:10.721409 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dbde15b6-bd7f-4971-a247-bcc088775d8a-alertmanager-trusted-ca-bundle podName:dbde15b6-bd7f-4971-a247-bcc088775d8a nodeName:}" failed. No retries permitted until 2026-06-09 20:58:11.221368898 +0000 UTC m=+243.557058100 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/dbde15b6-bd7f-4971-a247-bcc088775d8a-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "dbde15b6-bd7f-4971-a247-bcc088775d8a") : configmap references non-existent config key: ca-bundle.crt Jun 09 20:58:10.722156 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.722112 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbde15b6-bd7f-4971-a247-bcc088775d8a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.725053 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.724648 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-config-volume\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.725053 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.724767 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.725053 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.725011 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-web-config\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.725362 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.725182 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.725695 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.725644 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.726094 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.726073 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbde15b6-bd7f-4971-a247-bcc088775d8a-config-out\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.726773 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.726735 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.727182 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.727155 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbde15b6-bd7f-4971-a247-bcc088775d8a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:10.729862 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:10.729840 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qqfn\" (UniqueName: \"kubernetes.io/projected/dbde15b6-bd7f-4971-a247-bcc088775d8a-kube-api-access-6qqfn\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:11.008601 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:11.008558 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xbpf" event={"ID":"fad38352-fac6-4a9f-9ba0-088e5a9c7569","Type":"ContainerStarted","Data":"48eb65dbca970e26e0970247e0c7a4fa2a0b228e6c915fd90d2d41299f6da7a9"} Jun 09 20:58:11.008773 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:11.008635 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xbpf" event={"ID":"fad38352-fac6-4a9f-9ba0-088e5a9c7569","Type":"ContainerStarted","Data":"7361b691c15cc1a34e5c22c040c67c6f3a66e279ef8cd0137d904eb31b435118"} Jun 09 20:58:11.008773 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:11.008666 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xbpf" event={"ID":"fad38352-fac6-4a9f-9ba0-088e5a9c7569","Type":"ContainerStarted","Data":"d25ab0c0de372bf0252882156724534f39d980dbf4f3b746625b07432aa08aec"} Jun 09 20:58:11.009884 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:11.009848 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6927g" event={"ID":"e22b6d64-f9c2-4387-9534-92af9d1654e8","Type":"ContainerStarted","Data":"ae6755807821d9214ba5d4701053cc83fe967d7b5629a343efd4bcb73c37d0ca"} Jun 09 20:58:11.225730 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:11.225696 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbde15b6-bd7f-4971-a247-bcc088775d8a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:11.225920 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:11.225826 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:11.226822 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:11.226794 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbde15b6-bd7f-4971-a247-bcc088775d8a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:11.228758 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:11.228726 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:11.502263 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:11.502220 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:58:11.995204 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:11.995176 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 20:58:11.997701 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:58:11.997662 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbde15b6_bd7f_4971_a247_bcc088775d8a.slice/crio-f13722e00606887f98212fc66ab9e00f05a4ccf495ebfabbbace43389f64681a WatchSource:0}: Error finding container f13722e00606887f98212fc66ab9e00f05a4ccf495ebfabbbace43389f64681a: Status 404 returned error can't find the container with id f13722e00606887f98212fc66ab9e00f05a4ccf495ebfabbbace43389f64681a Jun 09 20:58:12.016449 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:12.016403 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xbpf" event={"ID":"fad38352-fac6-4a9f-9ba0-088e5a9c7569","Type":"ContainerStarted","Data":"40a981886d5c5fc67dc96e1dd34f05b85e96fd7d84cb24905ed4fb005e9ec2f1"} Jun 09 20:58:12.018140 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:12.018002 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-znt5k" event={"ID":"5080444f-d21e-402b-bd46-e0b5c24a6baf","Type":"ContainerStarted","Data":"51ebd9fa65dc9e3cd457a4e500916b194148a8ce2869ae7ff9e5921f9a726196"} Jun 09 20:58:12.019795 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:12.019743 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6927g" event={"ID":"e22b6d64-f9c2-4387-9534-92af9d1654e8","Type":"ContainerStarted","Data":"7ec3bcf484c8f67a5a5f53fa4a92df7240c2c0a729e22396b949fdafa4bc2926"} Jun 09 20:58:12.020947 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:12.020921 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbde15b6-bd7f-4971-a247-bcc088775d8a","Type":"ContainerStarted","Data":"f13722e00606887f98212fc66ab9e00f05a4ccf495ebfabbbace43389f64681a"} Jun 09 20:58:12.032142 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:12.032087 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xbpf" podStartSLOduration=1.929916476 podStartE2EDuration="3.032067067s" totalImagesPullingTime="1.102150591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 20:58:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:58:12.031741572 +0000 UTC m=+244.367430777" watchObservedRunningTime="2026-06-09 20:58:12.032067067 +0000 UTC m=+244.367756272" Jun 09 20:58:12.059136 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:12.059013 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-znt5k" podStartSLOduration=33.750592042 podStartE2EDuration="35.058992275s" totalImagesPullingTime="1.308400233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 20:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:58:12.05892803 +0000 UTC m=+244.394617233" watchObservedRunningTime="2026-06-09 20:58:12.058992275 +0000 UTC m=+244.394681478" Jun 09 20:58:13.028569 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:13.028531 2557 generic.go:356] "Generic (PLEG): container finished" podID="e22b6d64-f9c2-4387-9534-92af9d1654e8" containerID="7ec3bcf484c8f67a5a5f53fa4a92df7240c2c0a729e22396b949fdafa4bc2926" exitCode=0 Jun 09 20:58:13.029055 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:13.028622 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6927g" event={"ID":"e22b6d64-f9c2-4387-9534-92af9d1654e8","Type":"ContainerDied","Data":"7ec3bcf484c8f67a5a5f53fa4a92df7240c2c0a729e22396b949fdafa4bc2926"} Jun 09 20:58:14.034468 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:14.034433 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6927g" event={"ID":"e22b6d64-f9c2-4387-9534-92af9d1654e8","Type":"ContainerStarted","Data":"acf1cb43eba668e06131a0fa0b1772f7d11efafe3f86f717fe0e26bf859f0be4"} Jun 09 20:58:14.034942 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:14.034523 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6927g" event={"ID":"e22b6d64-f9c2-4387-9534-92af9d1654e8","Type":"ContainerStarted","Data":"1ee07eba48cc856f71692483d20fab2bdbcd87011da70fac6ead5e0cc400834a"} Jun 09 20:58:14.036089 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:14.036067 2557 generic.go:356] "Generic (PLEG): container finished" podID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerID="adc3db6446905a5bf320ec2692f61a1985165b54a4d5a7804dc09656953b3901" exitCode=0 Jun 09 20:58:14.036170 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:14.036142 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbde15b6-bd7f-4971-a247-bcc088775d8a","Type":"ContainerDied","Data":"adc3db6446905a5bf320ec2692f61a1985165b54a4d5a7804dc09656953b3901"} Jun 09 20:58:14.052202 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:14.052153 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6927g" podStartSLOduration=3.643129602 podStartE2EDuration="5.052135306s" totalImagesPullingTime="1.327327715s" totalInitContainerRuntime="81.677989ms" isStatefulPod=true podCreationTimestamp="2026-06-09 20:58:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:58:14.051021478 +0000 UTC m=+246.386710682" watchObservedRunningTime="2026-06-09 20:58:14.052135306 +0000 UTC m=+246.387824513" Jun 09 20:58:15.702214 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.702190 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 20:58:15.707227 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.707210 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.709486 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.709456 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 20:58:15.709627 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.709520 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 20:58:15.709627 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.709565 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 20:58:15.709770 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.709649 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 20:58:15.710317 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.710035 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 20:58:15.710317 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.710048 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-pfgb6\"" Jun 09 20:58:15.710317 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.710107 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 20:58:15.710317 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.710144 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 20:58:15.710317 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.710155 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 20:58:15.710317 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.710295 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 20:58:15.710668 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.710329 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-763t329t7nbto\"" Jun 09 20:58:15.711268 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.711224 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 20:58:15.711459 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.711440 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 20:58:15.711630 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.711608 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 20:58:15.712241 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.712220 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 20:58:15.712620 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.712591 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 20:58:15.719687 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.716964 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 20:58:15.726772 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.724258 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 20:58:15.771638 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.771609 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-web-config\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.771806 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.771678 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.771806 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.771707 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.771806 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.771728 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.771806 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.771755 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10d61c5a-3e40-4978-8270-9f75aa722147-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.771806 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.771782 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.771806 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.771804 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.772103 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.771829 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqnkx\" (UniqueName: \"kubernetes.io/projected/10d61c5a-3e40-4978-8270-9f75aa722147-kube-api-access-rqnkx\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.772103 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.771874 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/10d61c5a-3e40-4978-8270-9f75aa722147-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.772103 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.771912 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.772103 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.771957 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.772103 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.771986 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10d61c5a-3e40-4978-8270-9f75aa722147-config-out\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.772103 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.772011 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.772103 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.772040 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.772103 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.772090 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.772517 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.772122 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.772517 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.772170 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.772517 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.772197 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-config\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.772517 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.772223 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.772517 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.772247 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.872933 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.872891 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.872933 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.872935 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.873205 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.872960 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.873205 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.872978 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-config\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.873205 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.872999 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.873205 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.873020 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.873205 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.873050 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-web-config\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.873205 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.873085 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.873205 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.873110 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.873205 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.873125 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.873205 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.873141 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10d61c5a-3e40-4978-8270-9f75aa722147-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.873205 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.873165 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.873205 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.873183 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.873205 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.873199 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqnkx\" (UniqueName: \"kubernetes.io/projected/10d61c5a-3e40-4978-8270-9f75aa722147-kube-api-access-rqnkx\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.873817 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.873223 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/10d61c5a-3e40-4978-8270-9f75aa722147-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.873817 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.873258 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.873817 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.873285 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.873817 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.873303 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10d61c5a-3e40-4978-8270-9f75aa722147-config-out\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.873817 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.873320 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.873817 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.873349 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.874108 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.873886 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.874108 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.874037 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.874516 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.874491 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.876555 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.875542 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.876555 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.876181 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/10d61c5a-3e40-4978-8270-9f75aa722147-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.876555 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.876350 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-config\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.876792 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.876683 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.876792 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.876753 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.877186 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.877157 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.877362 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.877335 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-web-config\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.877454 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.877428 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.877638 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.877613 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.878214 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.878182 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.878440 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.878413 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.878744 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.878720 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.879175 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.879154 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.879486 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.879467 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10d61c5a-3e40-4978-8270-9f75aa722147-config-out\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.879559 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.879542 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.879660 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.879644 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10d61c5a-3e40-4978-8270-9f75aa722147-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:15.882277 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:15.882260 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqnkx\" (UniqueName: \"kubernetes.io/projected/10d61c5a-3e40-4978-8270-9f75aa722147-kube-api-access-rqnkx\") pod \"prometheus-k8s-0\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:16.027134 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:16.027044 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:16.047544 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:16.047505 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbde15b6-bd7f-4971-a247-bcc088775d8a","Type":"ContainerStarted","Data":"fd4a997072da637704d0e4a7dbf9fc490ca8fd3622fea77022b9aede32da71a5"} Jun 09 20:58:16.047677 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:16.047598 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbde15b6-bd7f-4971-a247-bcc088775d8a","Type":"ContainerStarted","Data":"3034cf0a23cd3ecde2296e7d34b5942d84d2f28d12d2229ec755470bb7f79ea2"} Jun 09 20:58:16.047677 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:16.047643 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbde15b6-bd7f-4971-a247-bcc088775d8a","Type":"ContainerStarted","Data":"b8e70255b40a68f495cf404410cb7a11fbba01de5d8cef81d2a6130c25ae0342"} Jun 09 20:58:16.047748 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:16.047682 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbde15b6-bd7f-4971-a247-bcc088775d8a","Type":"ContainerStarted","Data":"f3e8b8f560fa70d7deca3ad1eef6d593c0182e9cbc965e9a32062d5271be1eb6"} Jun 09 20:58:16.047748 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:16.047723 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbde15b6-bd7f-4971-a247-bcc088775d8a","Type":"ContainerStarted","Data":"cd65fddea0af7076f95cc0fce446b4c5b1b7ea395912a3b378de264cbd692a76"} Jun 09 20:58:16.195427 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:16.195161 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 20:58:16.197814 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:58:16.197782 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10d61c5a_3e40_4978_8270_9f75aa722147.slice/crio-020ebd8d16b3c5e849ec2a705d40f822199822b146cc64c028ce8c402e6f11f8 WatchSource:0}: Error finding container 020ebd8d16b3c5e849ec2a705d40f822199822b146cc64c028ce8c402e6f11f8: Status 404 returned error can't find the container with id 020ebd8d16b3c5e849ec2a705d40f822199822b146cc64c028ce8c402e6f11f8 Jun 09 20:58:17.054669 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:17.054628 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbde15b6-bd7f-4971-a247-bcc088775d8a","Type":"ContainerStarted","Data":"9e5b13e867b9f9ae079c2c56ce1026715a9443eefc0483f300efb6bf5e2ba43c"} Jun 09 20:58:17.056122 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:17.056098 2557 generic.go:356] "Generic (PLEG): container finished" podID="10d61c5a-3e40-4978-8270-9f75aa722147" containerID="c11f10cc3190e49b0e7472988b188008c3906ad85b7179f3c916c925cef3eed6" exitCode=0 Jun 09 20:58:17.056231 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:17.056150 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10d61c5a-3e40-4978-8270-9f75aa722147","Type":"ContainerDied","Data":"c11f10cc3190e49b0e7472988b188008c3906ad85b7179f3c916c925cef3eed6"} Jun 09 20:58:17.056231 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:17.056195 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10d61c5a-3e40-4978-8270-9f75aa722147","Type":"ContainerStarted","Data":"020ebd8d16b3c5e849ec2a705d40f822199822b146cc64c028ce8c402e6f11f8"} Jun 09 20:58:17.078695 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:17.078644 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.756950324 podStartE2EDuration="7.078627931s" totalImagesPullingTime="3.302365786s" totalInitContainerRuntime="19.311821ms" isStatefulPod=false podCreationTimestamp="2026-06-09 20:58:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:58:17.077841585 +0000 UTC m=+249.413530790" watchObservedRunningTime="2026-06-09 20:58:17.078627931 +0000 UTC m=+249.414317135" Jun 09 20:58:19.006385 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:19.006328 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-metrics-certs\") pod \"network-metrics-daemon-dwxkr\" (UID: \"c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae\") " pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:58:19.008977 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:19.008947 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae-metrics-certs\") pod \"network-metrics-daemon-dwxkr\" (UID: \"c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae\") " pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:58:19.288741 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:19.288658 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zlm4s\"" Jun 09 20:58:19.297340 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:19.297304 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwxkr" Jun 09 20:58:20.360781 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:20.360743 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dwxkr"] Jun 09 20:58:20.363777 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:58:20.363750 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6334f3e_2887_4d3a_80b3_d5e5e1e0a3ae.slice/crio-7d86f790272c35ba3e8a348e64e6c15fedf47a349717afea3bb085c93643aa76 WatchSource:0}: Error finding container 7d86f790272c35ba3e8a348e64e6c15fedf47a349717afea3bb085c93643aa76: Status 404 returned error can't find the container with id 7d86f790272c35ba3e8a348e64e6c15fedf47a349717afea3bb085c93643aa76 Jun 09 20:58:21.094279 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:21.094214 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10d61c5a-3e40-4978-8270-9f75aa722147","Type":"ContainerStarted","Data":"b49011eb470823d3eae939a177f539cb3e1a38c1c56e3c91893743790632d19f"} Jun 09 20:58:21.094497 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:21.094426 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10d61c5a-3e40-4978-8270-9f75aa722147","Type":"ContainerStarted","Data":"a3cc4db6fa7d835837c1e000308db9d507382cbbe99f8f543adf00d334495357"} Jun 09 20:58:21.096156 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:21.096124 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dwxkr" event={"ID":"c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae","Type":"ContainerStarted","Data":"7d86f790272c35ba3e8a348e64e6c15fedf47a349717afea3bb085c93643aa76"} Jun 09 20:58:22.102571 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:22.102523 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dwxkr" event={"ID":"c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae","Type":"ContainerStarted","Data":"7d4f38bab240e1ae13cc012e167308f94fc4ac4c5a09c946d6a4df1f25597bad"} Jun 09 20:58:22.103042 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:22.102592 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dwxkr" event={"ID":"c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae","Type":"ContainerStarted","Data":"811c3a94904fcb7a9e2bb54e25db8b426110240fea51ee6469d133c066e00df3"} Jun 09 20:58:22.116774 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:22.116431 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dwxkr" podStartSLOduration=253.135204136 podStartE2EDuration="4m14.116407679s" totalImagesPullingTime="981.203543ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 20:54:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:58:22.115593816 +0000 UTC m=+254.451283028" watchObservedRunningTime="2026-06-09 20:58:22.116407679 +0000 UTC m=+254.452096887" Jun 09 20:58:22.185830 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:22.185425 2557 scope.go:117] "RemoveContainer" containerID="67e9a3f74bfc416872b3741dfe71aa825619e14ccf146b16704682e4066861db" Jun 09 20:58:23.109850 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:23.109815 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10d61c5a-3e40-4978-8270-9f75aa722147","Type":"ContainerStarted","Data":"ce1aa40ca0b5501fff89bab33038db6654d3417d6628fb1c7f4532a41b0fe929"} Jun 09 20:58:23.110334 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:23.109896 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10d61c5a-3e40-4978-8270-9f75aa722147","Type":"ContainerStarted","Data":"0002bfa97bf319e2931ddbac57a409597c7394e8e61f20952b897353ad8fe627"} Jun 09 20:58:23.110334 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:23.109940 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10d61c5a-3e40-4978-8270-9f75aa722147","Type":"ContainerStarted","Data":"8a453e880769c5a0ef23aff71f27150b281cc62fbcb3120884453e46805ca769"} Jun 09 20:58:23.110334 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:23.110017 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10d61c5a-3e40-4978-8270-9f75aa722147","Type":"ContainerStarted","Data":"5fefdd8570ae9bfcd11772adcf0651ed92f58855b84d006d1be386d7b8f6e126"} Jun 09 20:58:23.111561 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:23.111539 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rht6r_16863009-e8d0-462f-a57e-3c4e82142141/console-operator/2.log" Jun 09 20:58:23.111663 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:23.111589 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-rht6r" event={"ID":"16863009-e8d0-462f-a57e-3c4e82142141","Type":"ContainerStarted","Data":"5a92f93f96a1e924b86dbd2438646af3a2c15548b6c158bd0fd6b78c6868824d"} Jun 09 20:58:23.112017 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:23.112002 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-rht6r" Jun 09 20:58:23.118928 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:23.118901 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-rht6r" Jun 09 20:58:23.153798 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:23.153744 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.090372654 podStartE2EDuration="8.153725413s" totalImagesPullingTime="5.037215143s" totalInitContainerRuntime="26.137616ms" isStatefulPod=false podCreationTimestamp="2026-06-09 20:58:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:58:23.14893189 +0000 UTC m=+255.484621093" watchObservedRunningTime="2026-06-09 20:58:23.153725413 +0000 UTC m=+255.489414617" Jun 09 20:58:23.169138 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:23.169080 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-rht6r" podStartSLOduration=43.651276837 podStartE2EDuration="46.169064725s" totalImagesPullingTime="2.517787888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 20:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:58:23.168852632 +0000 UTC m=+255.504541837" watchObservedRunningTime="2026-06-09 20:58:23.169064725 +0000 UTC m=+255.504753953" Jun 09 20:58:26.027521 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:26.027428 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:58:46.206332 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:46.206295 2557 generic.go:356] "Generic (PLEG): container finished" podID="407c0bf3-a878-482d-87dd-dc4c78cb7d71" containerID="35f712513ab7e616cc5c4f3ac8fd229445eede0fb220a9be2442a9d426d934a8" exitCode=0 Jun 09 20:58:46.206777 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:46.206363 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tbw6z" event={"ID":"407c0bf3-a878-482d-87dd-dc4c78cb7d71","Type":"ContainerDied","Data":"35f712513ab7e616cc5c4f3ac8fd229445eede0fb220a9be2442a9d426d934a8"} Jun 09 20:58:46.206777 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:46.206723 2557 scope.go:117] "RemoveContainer" containerID="35f712513ab7e616cc5c4f3ac8fd229445eede0fb220a9be2442a9d426d934a8" Jun 09 20:58:47.212927 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:47.212888 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tbw6z" event={"ID":"407c0bf3-a878-482d-87dd-dc4c78cb7d71","Type":"ContainerStarted","Data":"2b0a3fc68d2297e943d1b5270ee8e22d259b93410e1954804aea6f4bdbdb938a"} Jun 09 20:58:49.743127 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:58:49.743086 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pnvwt" podUID="f27bc7c7-a410-4ec4-9b29-c9f1160d2271" Jun 09 20:58:49.743490 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:58:49.743086 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" podUID="3c5209e7-8425-499a-8987-9d9377addd60" Jun 09 20:58:50.225803 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:50.225762 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:58:50.228683 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:50.226303 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pnvwt" Jun 09 20:58:53.529316 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:53.529273 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:58:53.529316 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:53.529323 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-metrics-tls\") pod \"dns-default-pnvwt\" (UID: \"f27bc7c7-a410-4ec4-9b29-c9f1160d2271\") " pod="openshift-dns/dns-default-pnvwt" Jun 09 20:58:53.531928 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:53.531889 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f27bc7c7-a410-4ec4-9b29-c9f1160d2271-metrics-tls\") pod \"dns-default-pnvwt\" (UID: \"f27bc7c7-a410-4ec4-9b29-c9f1160d2271\") " pod="openshift-dns/dns-default-pnvwt" Jun 09 20:58:53.532048 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:53.531892 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls\") pod \"image-registry-5bf67c8ff7-crdj6\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:58:53.828114 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:53.828031 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wzshz\"" Jun 09 20:58:53.829152 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:53.829132 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d85mb\"" Jun 09 20:58:53.836599 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:53.836572 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:58:53.837806 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:53.837788 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pnvwt" Jun 09 20:58:54.029762 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:54.029728 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bf67c8ff7-crdj6"] Jun 09 20:58:54.033892 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:58:54.033858 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c5209e7_8425_499a_8987_9d9377addd60.slice/crio-f018f37b0a2b6a07d88716a61d36fdaf478753909c11a19193ea3d28d79c9997 WatchSource:0}: Error finding container f018f37b0a2b6a07d88716a61d36fdaf478753909c11a19193ea3d28d79c9997: Status 404 returned error can't find the container with id f018f37b0a2b6a07d88716a61d36fdaf478753909c11a19193ea3d28d79c9997 Jun 09 20:58:54.059770 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:54.059742 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pnvwt"] Jun 09 20:58:54.063490 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:58:54.063454 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf27bc7c7_a410_4ec4_9b29_c9f1160d2271.slice/crio-80cbc5d6be718da18c10955410146844efe388922dc6e9860cddc0475f10f55c WatchSource:0}: Error finding container 80cbc5d6be718da18c10955410146844efe388922dc6e9860cddc0475f10f55c: Status 404 returned error can't find the container with id 80cbc5d6be718da18c10955410146844efe388922dc6e9860cddc0475f10f55c Jun 09 20:58:54.244473 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:54.244425 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" event={"ID":"3c5209e7-8425-499a-8987-9d9377addd60","Type":"ContainerStarted","Data":"289a49261eab1d5a47509bb4c7aec0747038a5e613ded785052c85b6f03dbaf4"} Jun 09 20:58:54.244473 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:54.244480 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" event={"ID":"3c5209e7-8425-499a-8987-9d9377addd60","Type":"ContainerStarted","Data":"f018f37b0a2b6a07d88716a61d36fdaf478753909c11a19193ea3d28d79c9997"} Jun 09 20:58:54.244695 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:54.244513 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:58:54.245709 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:54.245689 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pnvwt" event={"ID":"f27bc7c7-a410-4ec4-9b29-c9f1160d2271","Type":"ContainerStarted","Data":"80cbc5d6be718da18c10955410146844efe388922dc6e9860cddc0475f10f55c"} Jun 09 20:58:54.262570 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:54.262506 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" podStartSLOduration=286.262482583 podStartE2EDuration="4m46.262482583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 20:54:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:58:54.261437085 +0000 UTC m=+286.597126289" watchObservedRunningTime="2026-06-09 20:58:54.262482583 +0000 UTC m=+286.598171791" Jun 09 20:58:56.257062 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:56.257023 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pnvwt" event={"ID":"f27bc7c7-a410-4ec4-9b29-c9f1160d2271","Type":"ContainerStarted","Data":"5730ee235581a3400b4c76ba3bccb95f460fe1c608ad596c60d64c92493fce12"} Jun 09 20:58:56.257469 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:56.257082 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pnvwt" event={"ID":"f27bc7c7-a410-4ec4-9b29-c9f1160d2271","Type":"ContainerStarted","Data":"dd08e9b8063143e5171f3f5dba66e3084ffd7d8d56bd46ea93e5293537ee7a4d"} Jun 09 20:58:56.257469 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:56.257174 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pnvwt" Jun 09 20:58:56.272001 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:58:56.271942 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pnvwt" podStartSLOduration=251.598551137 podStartE2EDuration="4m13.271922394s" totalImagesPullingTime="1.673371257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 20:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:58:56.271693883 +0000 UTC m=+288.607383101" watchObservedRunningTime="2026-06-09 20:58:56.271922394 +0000 UTC m=+288.607611599" Jun 09 20:59:06.263533 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:06.263497 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pnvwt" Jun 09 20:59:08.127293 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:08.127261 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rht6r_16863009-e8d0-462f-a57e-3c4e82142141/console-operator/2.log" Jun 09 20:59:08.129698 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:08.129676 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rht6r_16863009-e8d0-462f-a57e-3c4e82142141/console-operator/2.log" Jun 09 20:59:08.135236 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:08.135200 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l764_4010dd68-a50f-479f-a86f-2aecbc8e67e1/ovn-acl-logging/0.log" Jun 09 20:59:08.138162 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:08.138142 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l764_4010dd68-a50f-479f-a86f-2aecbc8e67e1/ovn-acl-logging/0.log" Jun 09 20:59:08.139421 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:08.139402 2557 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 20:59:10.866166 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:10.866118 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dbde15b6-bd7f-4971-a247-bcc088775d8a/init-config-reloader/0.log" Jun 09 20:59:11.066053 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:11.066020 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dbde15b6-bd7f-4971-a247-bcc088775d8a/alertmanager/0.log" Jun 09 20:59:11.265845 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:11.265812 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dbde15b6-bd7f-4971-a247-bcc088775d8a/config-reloader/0.log" Jun 09 20:59:11.466394 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:11.466327 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dbde15b6-bd7f-4971-a247-bcc088775d8a/kube-rbac-proxy-web/0.log" Jun 09 20:59:11.665857 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:11.665753 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dbde15b6-bd7f-4971-a247-bcc088775d8a/kube-rbac-proxy/0.log" Jun 09 20:59:11.865866 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:11.865835 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dbde15b6-bd7f-4971-a247-bcc088775d8a/kube-rbac-proxy-metric/0.log" Jun 09 20:59:12.066355 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:12.066322 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dbde15b6-bd7f-4971-a247-bcc088775d8a/prom-label-proxy/0.log" Jun 09 20:59:13.465643 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:13.465616 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6927g_e22b6d64-f9c2-4387-9534-92af9d1654e8/init-textfile/0.log" Jun 09 20:59:13.667087 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:13.667047 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6927g_e22b6d64-f9c2-4387-9534-92af9d1654e8/node-exporter/0.log" Jun 09 20:59:13.841430 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:13.841339 2557 patch_prober.go:28] interesting pod/image-registry-5bf67c8ff7-crdj6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 20:59:13.841563 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:13.841420 2557 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" podUID="3c5209e7-8425-499a-8987-9d9377addd60" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 20:59:13.866229 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:13.866203 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6927g_e22b6d64-f9c2-4387-9534-92af9d1654e8/kube-rbac-proxy/0.log" Jun 09 20:59:15.255081 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:15.255050 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:59:15.265529 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:15.265496 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-6xbpf_fad38352-fac6-4a9f-9ba0-088e5a9c7569/kube-rbac-proxy-main/0.log" Jun 09 20:59:15.465024 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:15.464991 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-6xbpf_fad38352-fac6-4a9f-9ba0-088e5a9c7569/kube-rbac-proxy-self/0.log" Jun 09 20:59:15.666163 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:15.666073 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-6xbpf_fad38352-fac6-4a9f-9ba0-088e5a9c7569/openshift-state-metrics/0.log" Jun 09 20:59:15.866611 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:15.866576 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_10d61c5a-3e40-4978-8270-9f75aa722147/init-config-reloader/0.log" Jun 09 20:59:16.028074 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:16.028040 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:16.048693 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:16.048662 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:16.067474 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:16.067446 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_10d61c5a-3e40-4978-8270-9f75aa722147/prometheus/0.log" Jun 09 20:59:16.266954 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:16.266923 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_10d61c5a-3e40-4978-8270-9f75aa722147/config-reloader/0.log" Jun 09 20:59:16.356109 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:16.356035 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:16.466753 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:16.466717 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_10d61c5a-3e40-4978-8270-9f75aa722147/thanos-sidecar/0.log" Jun 09 20:59:16.666719 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:16.666635 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_10d61c5a-3e40-4978-8270-9f75aa722147/kube-rbac-proxy-web/0.log" Jun 09 20:59:16.866023 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:16.865992 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_10d61c5a-3e40-4978-8270-9f75aa722147/kube-rbac-proxy/0.log" Jun 09 20:59:17.066955 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:17.066890 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_10d61c5a-3e40-4978-8270-9f75aa722147/kube-rbac-proxy-thanos/0.log" Jun 09 20:59:17.268292 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:17.268250 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-rrl6m_b86458c7-8635-4327-afa3-7e361d17d87e/prometheus-operator/0.log" Jun 09 20:59:17.465885 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:17.465855 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-rrl6m_b86458c7-8635-4327-afa3-7e361d17d87e/kube-rbac-proxy/0.log" Jun 09 20:59:17.666281 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:17.666245 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-q62l2_3dd9dd28-71b3-4dae-86db-cb13d03308f4/prometheus-operator-admission-webhook/0.log" Jun 09 20:59:19.066152 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:19.066120 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-znt5k_5080444f-d21e-402b-bd46-e0b5c24a6baf/networking-console-plugin/0.log" Jun 09 20:59:19.266209 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:19.266187 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rht6r_16863009-e8d0-462f-a57e-3c4e82142141/console-operator/2.log" Jun 09 20:59:19.469565 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:19.469529 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rht6r_16863009-e8d0-462f-a57e-3c4e82142141/console-operator/3.log" Jun 09 20:59:20.666056 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:20.666025 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pnvwt_f27bc7c7-a410-4ec4-9b29-c9f1160d2271/dns/0.log" Jun 09 20:59:20.865943 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:20.865912 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pnvwt_f27bc7c7-a410-4ec4-9b29-c9f1160d2271/kube-rbac-proxy/0.log" Jun 09 20:59:21.865274 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:21.865248 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jzlgv_48ea32f0-3aed-49d4-bd34-2c0bc6a8b251/dns-node-resolver/0.log" Jun 09 20:59:22.066320 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:22.066290 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5bf67c8ff7-crdj6_3c5209e7-8425-499a-8987-9d9377addd60/registry/0.log" Jun 09 20:59:22.666768 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:22.666730 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7dxwm_84c09f0a-64ef-41e7-b1ca-c16ae3eeb4f9/node-ca/0.log" Jun 09 20:59:23.865734 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:23.865700 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vdjv9_24a48d8d-ec0f-4be8-9c45-791c56450da6/serve-healthcheck-canary/0.log" Jun 09 20:59:29.744803 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:29.744765 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 20:59:29.745306 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:29.745145 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerName="alertmanager" containerID="cri-o://cd65fddea0af7076f95cc0fce446b4c5b1b7ea395912a3b378de264cbd692a76" gracePeriod=120 Jun 09 20:59:29.745306 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:29.745193 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerName="kube-rbac-proxy-metric" containerID="cri-o://fd4a997072da637704d0e4a7dbf9fc490ca8fd3622fea77022b9aede32da71a5" gracePeriod=120 Jun 09 20:59:29.745306 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:29.745284 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerName="kube-rbac-proxy" containerID="cri-o://3034cf0a23cd3ecde2296e7d34b5942d84d2f28d12d2229ec755470bb7f79ea2" gracePeriod=120 Jun 09 20:59:29.745306 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:29.745250 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerName="kube-rbac-proxy-web" containerID="cri-o://b8e70255b40a68f495cf404410cb7a11fbba01de5d8cef81d2a6130c25ae0342" gracePeriod=120 Jun 09 20:59:29.745557 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:29.745291 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerName="prom-label-proxy" containerID="cri-o://9e5b13e867b9f9ae079c2c56ce1026715a9443eefc0483f300efb6bf5e2ba43c" gracePeriod=120 Jun 09 20:59:29.745557 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:29.745293 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerName="config-reloader" containerID="cri-o://f3e8b8f560fa70d7deca3ad1eef6d593c0182e9cbc965e9a32062d5271be1eb6" gracePeriod=120 Jun 09 20:59:30.002796 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:30.002704 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bf67c8ff7-crdj6"] Jun 09 20:59:30.413097 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:30.413009 2557 generic.go:356] "Generic (PLEG): container finished" podID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerID="9e5b13e867b9f9ae079c2c56ce1026715a9443eefc0483f300efb6bf5e2ba43c" exitCode=0 Jun 09 20:59:30.413097 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:30.413040 2557 generic.go:356] "Generic (PLEG): container finished" podID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerID="3034cf0a23cd3ecde2296e7d34b5942d84d2f28d12d2229ec755470bb7f79ea2" exitCode=0 Jun 09 20:59:30.413097 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:30.413048 2557 generic.go:356] "Generic (PLEG): container finished" podID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerID="f3e8b8f560fa70d7deca3ad1eef6d593c0182e9cbc965e9a32062d5271be1eb6" exitCode=0 Jun 09 20:59:30.413097 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:30.413054 2557 generic.go:356] "Generic (PLEG): container finished" podID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerID="cd65fddea0af7076f95cc0fce446b4c5b1b7ea395912a3b378de264cbd692a76" exitCode=0 Jun 09 20:59:30.413097 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:30.413080 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbde15b6-bd7f-4971-a247-bcc088775d8a","Type":"ContainerDied","Data":"9e5b13e867b9f9ae079c2c56ce1026715a9443eefc0483f300efb6bf5e2ba43c"} Jun 09 20:59:30.413361 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:30.413148 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbde15b6-bd7f-4971-a247-bcc088775d8a","Type":"ContainerDied","Data":"3034cf0a23cd3ecde2296e7d34b5942d84d2f28d12d2229ec755470bb7f79ea2"} Jun 09 20:59:30.413361 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:30.413174 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbde15b6-bd7f-4971-a247-bcc088775d8a","Type":"ContainerDied","Data":"f3e8b8f560fa70d7deca3ad1eef6d593c0182e9cbc965e9a32062d5271be1eb6"} Jun 09 20:59:30.413361 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:30.413198 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbde15b6-bd7f-4971-a247-bcc088775d8a","Type":"ContainerDied","Data":"cd65fddea0af7076f95cc0fce446b4c5b1b7ea395912a3b378de264cbd692a76"} Jun 09 20:59:31.002751 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.002726 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.077455 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.077426 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-cluster-tls-config\") pod \"dbde15b6-bd7f-4971-a247-bcc088775d8a\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " Jun 09 20:59:31.077640 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.077477 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-secret-alertmanager-kube-rbac-proxy\") pod \"dbde15b6-bd7f-4971-a247-bcc088775d8a\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " Jun 09 20:59:31.077640 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.077516 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qqfn\" (UniqueName: \"kubernetes.io/projected/dbde15b6-bd7f-4971-a247-bcc088775d8a-kube-api-access-6qqfn\") pod \"dbde15b6-bd7f-4971-a247-bcc088775d8a\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " Jun 09 20:59:31.077640 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.077545 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbde15b6-bd7f-4971-a247-bcc088775d8a-config-out\") pod \"dbde15b6-bd7f-4971-a247-bcc088775d8a\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " Jun 09 20:59:31.077640 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.077586 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbde15b6-bd7f-4971-a247-bcc088775d8a-tls-assets\") pod \"dbde15b6-bd7f-4971-a247-bcc088775d8a\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " Jun 09 20:59:31.077640 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.077613 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-web-config\") pod \"dbde15b6-bd7f-4971-a247-bcc088775d8a\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " Jun 09 20:59:31.077640 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.077639 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-config-volume\") pod \"dbde15b6-bd7f-4971-a247-bcc088775d8a\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " Jun 09 20:59:31.077940 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.077662 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbde15b6-bd7f-4971-a247-bcc088775d8a-metrics-client-ca\") pod \"dbde15b6-bd7f-4971-a247-bcc088775d8a\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " Jun 09 20:59:31.077940 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.077703 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"dbde15b6-bd7f-4971-a247-bcc088775d8a\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " Jun 09 20:59:31.077940 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.077759 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbde15b6-bd7f-4971-a247-bcc088775d8a-alertmanager-main-db\") pod \"dbde15b6-bd7f-4971-a247-bcc088775d8a\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " Jun 09 20:59:31.077940 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.077785 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbde15b6-bd7f-4971-a247-bcc088775d8a-alertmanager-trusted-ca-bundle\") pod \"dbde15b6-bd7f-4971-a247-bcc088775d8a\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " Jun 09 20:59:31.077940 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.077826 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-secret-alertmanager-main-tls\") pod \"dbde15b6-bd7f-4971-a247-bcc088775d8a\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " Jun 09 20:59:31.077940 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.077877 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-secret-alertmanager-kube-rbac-proxy-web\") pod \"dbde15b6-bd7f-4971-a247-bcc088775d8a\" (UID: \"dbde15b6-bd7f-4971-a247-bcc088775d8a\") " Jun 09 20:59:31.078205 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.078088 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbde15b6-bd7f-4971-a247-bcc088775d8a-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "dbde15b6-bd7f-4971-a247-bcc088775d8a" (UID: "dbde15b6-bd7f-4971-a247-bcc088775d8a"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 20:59:31.078644 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.078453 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbde15b6-bd7f-4971-a247-bcc088775d8a-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "dbde15b6-bd7f-4971-a247-bcc088775d8a" (UID: "dbde15b6-bd7f-4971-a247-bcc088775d8a"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 20:59:31.078644 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.078592 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbde15b6-bd7f-4971-a247-bcc088775d8a-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "dbde15b6-bd7f-4971-a247-bcc088775d8a" (UID: "dbde15b6-bd7f-4971-a247-bcc088775d8a"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 20:59:31.081404 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.081357 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "dbde15b6-bd7f-4971-a247-bcc088775d8a" (UID: "dbde15b6-bd7f-4971-a247-bcc088775d8a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 20:59:31.082080 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.082047 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "dbde15b6-bd7f-4971-a247-bcc088775d8a" (UID: "dbde15b6-bd7f-4971-a247-bcc088775d8a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 20:59:31.082306 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.082147 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "dbde15b6-bd7f-4971-a247-bcc088775d8a" (UID: "dbde15b6-bd7f-4971-a247-bcc088775d8a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 20:59:31.082626 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.082596 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbde15b6-bd7f-4971-a247-bcc088775d8a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "dbde15b6-bd7f-4971-a247-bcc088775d8a" (UID: "dbde15b6-bd7f-4971-a247-bcc088775d8a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 20:59:31.082626 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.082606 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "dbde15b6-bd7f-4971-a247-bcc088775d8a" (UID: "dbde15b6-bd7f-4971-a247-bcc088775d8a"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 20:59:31.082766 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.082693 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbde15b6-bd7f-4971-a247-bcc088775d8a-config-out" (OuterVolumeSpecName: "config-out") pod "dbde15b6-bd7f-4971-a247-bcc088775d8a" (UID: "dbde15b6-bd7f-4971-a247-bcc088775d8a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 20:59:31.082766 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.082696 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbde15b6-bd7f-4971-a247-bcc088775d8a-kube-api-access-6qqfn" (OuterVolumeSpecName: "kube-api-access-6qqfn") pod "dbde15b6-bd7f-4971-a247-bcc088775d8a" (UID: "dbde15b6-bd7f-4971-a247-bcc088775d8a"). InnerVolumeSpecName "kube-api-access-6qqfn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 20:59:31.083057 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.083021 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-config-volume" (OuterVolumeSpecName: "config-volume") pod "dbde15b6-bd7f-4971-a247-bcc088775d8a" (UID: "dbde15b6-bd7f-4971-a247-bcc088775d8a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 20:59:31.087910 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.087884 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "dbde15b6-bd7f-4971-a247-bcc088775d8a" (UID: "dbde15b6-bd7f-4971-a247-bcc088775d8a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 20:59:31.094744 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.094721 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-web-config" (OuterVolumeSpecName: "web-config") pod "dbde15b6-bd7f-4971-a247-bcc088775d8a" (UID: "dbde15b6-bd7f-4971-a247-bcc088775d8a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 20:59:31.179205 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.179161 2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-secret-alertmanager-main-tls\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:31.179205 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.179197 2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:31.179205 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.179213 2557 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-cluster-tls-config\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:31.179496 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.179226 2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:31.179496 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.179239 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qqfn\" (UniqueName: \"kubernetes.io/projected/dbde15b6-bd7f-4971-a247-bcc088775d8a-kube-api-access-6qqfn\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:31.179496 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.179251 2557 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbde15b6-bd7f-4971-a247-bcc088775d8a-config-out\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:31.179496 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.179261 2557 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbde15b6-bd7f-4971-a247-bcc088775d8a-tls-assets\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:31.179496 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.179272 2557 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-web-config\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:31.179496 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.179282 2557 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-config-volume\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:31.179496 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.179292 2557 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbde15b6-bd7f-4971-a247-bcc088775d8a-metrics-client-ca\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:31.179496 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.179304 2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbde15b6-bd7f-4971-a247-bcc088775d8a-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:31.179496 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.179317 2557 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbde15b6-bd7f-4971-a247-bcc088775d8a-alertmanager-main-db\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:31.179496 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.179330 2557 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbde15b6-bd7f-4971-a247-bcc088775d8a-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:31.420726 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.420633 2557 generic.go:356] "Generic (PLEG): container finished" podID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerID="fd4a997072da637704d0e4a7dbf9fc490ca8fd3622fea77022b9aede32da71a5" exitCode=0 Jun 09 20:59:31.420726 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.420662 2557 generic.go:356] "Generic (PLEG): container finished" podID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerID="b8e70255b40a68f495cf404410cb7a11fbba01de5d8cef81d2a6130c25ae0342" exitCode=0 Jun 09 20:59:31.420726 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.420686 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbde15b6-bd7f-4971-a247-bcc088775d8a","Type":"ContainerDied","Data":"fd4a997072da637704d0e4a7dbf9fc490ca8fd3622fea77022b9aede32da71a5"} Jun 09 20:59:31.420726 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.420720 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.421067 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.420758 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbde15b6-bd7f-4971-a247-bcc088775d8a","Type":"ContainerDied","Data":"b8e70255b40a68f495cf404410cb7a11fbba01de5d8cef81d2a6130c25ae0342"} Jun 09 20:59:31.421067 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.420787 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbde15b6-bd7f-4971-a247-bcc088775d8a","Type":"ContainerDied","Data":"f13722e00606887f98212fc66ab9e00f05a4ccf495ebfabbbace43389f64681a"} Jun 09 20:59:31.421067 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.420827 2557 scope.go:117] "RemoveContainer" containerID="9e5b13e867b9f9ae079c2c56ce1026715a9443eefc0483f300efb6bf5e2ba43c" Jun 09 20:59:31.429723 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.429699 2557 scope.go:117] "RemoveContainer" containerID="fd4a997072da637704d0e4a7dbf9fc490ca8fd3622fea77022b9aede32da71a5" Jun 09 20:59:31.437156 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.437138 2557 scope.go:117] "RemoveContainer" containerID="3034cf0a23cd3ecde2296e7d34b5942d84d2f28d12d2229ec755470bb7f79ea2" Jun 09 20:59:31.443907 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.443882 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 20:59:31.444892 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.444877 2557 scope.go:117] "RemoveContainer" containerID="b8e70255b40a68f495cf404410cb7a11fbba01de5d8cef81d2a6130c25ae0342" Jun 09 20:59:31.448131 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.448110 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 20:59:31.452809 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.452788 2557 scope.go:117] "RemoveContainer" containerID="f3e8b8f560fa70d7deca3ad1eef6d593c0182e9cbc965e9a32062d5271be1eb6" Jun 09 20:59:31.460294 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.460275 2557 scope.go:117] "RemoveContainer" containerID="cd65fddea0af7076f95cc0fce446b4c5b1b7ea395912a3b378de264cbd692a76" Jun 09 20:59:31.468317 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.468293 2557 scope.go:117] "RemoveContainer" containerID="adc3db6446905a5bf320ec2692f61a1985165b54a4d5a7804dc09656953b3901" Jun 09 20:59:31.474521 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.474498 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 20:59:31.474834 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.474822 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerName="prom-label-proxy" Jun 09 20:59:31.474876 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.474837 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerName="prom-label-proxy" Jun 09 20:59:31.474876 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.474845 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerName="config-reloader" Jun 09 20:59:31.474876 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.474852 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerName="config-reloader" Jun 09 20:59:31.474876 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.474865 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerName="alertmanager" Jun 09 20:59:31.474876 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.474875 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerName="alertmanager" Jun 09 20:59:31.475015 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.474885 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerName="init-config-reloader" Jun 09 20:59:31.475015 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.474891 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerName="init-config-reloader" Jun 09 20:59:31.475015 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.474899 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerName="kube-rbac-proxy-metric" Jun 09 20:59:31.475015 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.474904 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerName="kube-rbac-proxy-metric" Jun 09 20:59:31.475015 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.474913 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerName="kube-rbac-proxy-web" Jun 09 20:59:31.475015 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.474918 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerName="kube-rbac-proxy-web" Jun 09 20:59:31.475015 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.474925 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerName="kube-rbac-proxy" Jun 09 20:59:31.475015 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.474930 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerName="kube-rbac-proxy" Jun 09 20:59:31.475015 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.474979 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerName="config-reloader" Jun 09 20:59:31.475015 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.474988 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerName="alertmanager" Jun 09 20:59:31.475015 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.474995 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerName="prom-label-proxy" Jun 09 20:59:31.475015 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.475002 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerName="kube-rbac-proxy-metric" Jun 09 20:59:31.475015 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.475008 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerName="kube-rbac-proxy" Jun 09 20:59:31.475015 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.475013 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbde15b6-bd7f-4971-a247-bcc088775d8a" containerName="kube-rbac-proxy-web" Jun 09 20:59:31.478803 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.478629 2557 scope.go:117] "RemoveContainer" containerID="9e5b13e867b9f9ae079c2c56ce1026715a9443eefc0483f300efb6bf5e2ba43c" Jun 09 20:59:31.479043 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:59:31.479008 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e5b13e867b9f9ae079c2c56ce1026715a9443eefc0483f300efb6bf5e2ba43c\": container with ID starting with 9e5b13e867b9f9ae079c2c56ce1026715a9443eefc0483f300efb6bf5e2ba43c not found: ID does not exist" containerID="9e5b13e867b9f9ae079c2c56ce1026715a9443eefc0483f300efb6bf5e2ba43c" Jun 09 20:59:31.479117 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.479056 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e5b13e867b9f9ae079c2c56ce1026715a9443eefc0483f300efb6bf5e2ba43c"} err="failed to get container status \"9e5b13e867b9f9ae079c2c56ce1026715a9443eefc0483f300efb6bf5e2ba43c\": rpc error: code = NotFound desc = could not find container \"9e5b13e867b9f9ae079c2c56ce1026715a9443eefc0483f300efb6bf5e2ba43c\": container with ID starting with 9e5b13e867b9f9ae079c2c56ce1026715a9443eefc0483f300efb6bf5e2ba43c not found: ID does not exist" Jun 09 20:59:31.479117 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.479112 2557 scope.go:117] "RemoveContainer" containerID="fd4a997072da637704d0e4a7dbf9fc490ca8fd3622fea77022b9aede32da71a5" Jun 09 20:59:31.479516 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:59:31.479486 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd4a997072da637704d0e4a7dbf9fc490ca8fd3622fea77022b9aede32da71a5\": container with ID starting with fd4a997072da637704d0e4a7dbf9fc490ca8fd3622fea77022b9aede32da71a5 not found: ID does not exist" containerID="fd4a997072da637704d0e4a7dbf9fc490ca8fd3622fea77022b9aede32da71a5" Jun 09 20:59:31.479674 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.479651 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd4a997072da637704d0e4a7dbf9fc490ca8fd3622fea77022b9aede32da71a5"} err="failed to get container status \"fd4a997072da637704d0e4a7dbf9fc490ca8fd3622fea77022b9aede32da71a5\": rpc error: code = NotFound desc = could not find container \"fd4a997072da637704d0e4a7dbf9fc490ca8fd3622fea77022b9aede32da71a5\": container with ID starting with fd4a997072da637704d0e4a7dbf9fc490ca8fd3622fea77022b9aede32da71a5 not found: ID does not exist" Jun 09 20:59:31.479766 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.479753 2557 scope.go:117] "RemoveContainer" containerID="3034cf0a23cd3ecde2296e7d34b5942d84d2f28d12d2229ec755470bb7f79ea2" Jun 09 20:59:31.480435 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:59:31.480410 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3034cf0a23cd3ecde2296e7d34b5942d84d2f28d12d2229ec755470bb7f79ea2\": container with ID starting with 3034cf0a23cd3ecde2296e7d34b5942d84d2f28d12d2229ec755470bb7f79ea2 not found: ID does not exist" containerID="3034cf0a23cd3ecde2296e7d34b5942d84d2f28d12d2229ec755470bb7f79ea2" Jun 09 20:59:31.480525 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.480446 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3034cf0a23cd3ecde2296e7d34b5942d84d2f28d12d2229ec755470bb7f79ea2"} err="failed to get container status \"3034cf0a23cd3ecde2296e7d34b5942d84d2f28d12d2229ec755470bb7f79ea2\": rpc error: code = NotFound desc = could not find container \"3034cf0a23cd3ecde2296e7d34b5942d84d2f28d12d2229ec755470bb7f79ea2\": container with ID starting with 3034cf0a23cd3ecde2296e7d34b5942d84d2f28d12d2229ec755470bb7f79ea2 not found: ID does not exist" Jun 09 20:59:31.480525 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.480475 2557 scope.go:117] "RemoveContainer" containerID="b8e70255b40a68f495cf404410cb7a11fbba01de5d8cef81d2a6130c25ae0342" Jun 09 20:59:31.480878 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:59:31.480850 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8e70255b40a68f495cf404410cb7a11fbba01de5d8cef81d2a6130c25ae0342\": container with ID starting with b8e70255b40a68f495cf404410cb7a11fbba01de5d8cef81d2a6130c25ae0342 not found: ID does not exist" containerID="b8e70255b40a68f495cf404410cb7a11fbba01de5d8cef81d2a6130c25ae0342" Jun 09 20:59:31.480940 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.480888 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8e70255b40a68f495cf404410cb7a11fbba01de5d8cef81d2a6130c25ae0342"} err="failed to get container status \"b8e70255b40a68f495cf404410cb7a11fbba01de5d8cef81d2a6130c25ae0342\": rpc error: code = NotFound desc = could not find container \"b8e70255b40a68f495cf404410cb7a11fbba01de5d8cef81d2a6130c25ae0342\": container with ID starting with b8e70255b40a68f495cf404410cb7a11fbba01de5d8cef81d2a6130c25ae0342 not found: ID does not exist" Jun 09 20:59:31.480940 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.480910 2557 scope.go:117] "RemoveContainer" containerID="f3e8b8f560fa70d7deca3ad1eef6d593c0182e9cbc965e9a32062d5271be1eb6" Jun 09 20:59:31.481953 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:59:31.481929 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3e8b8f560fa70d7deca3ad1eef6d593c0182e9cbc965e9a32062d5271be1eb6\": container with ID starting with f3e8b8f560fa70d7deca3ad1eef6d593c0182e9cbc965e9a32062d5271be1eb6 not found: ID does not exist" containerID="f3e8b8f560fa70d7deca3ad1eef6d593c0182e9cbc965e9a32062d5271be1eb6" Jun 09 20:59:31.482081 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.482062 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3e8b8f560fa70d7deca3ad1eef6d593c0182e9cbc965e9a32062d5271be1eb6"} err="failed to get container status \"f3e8b8f560fa70d7deca3ad1eef6d593c0182e9cbc965e9a32062d5271be1eb6\": rpc error: code = NotFound desc = could not find container \"f3e8b8f560fa70d7deca3ad1eef6d593c0182e9cbc965e9a32062d5271be1eb6\": container with ID starting with f3e8b8f560fa70d7deca3ad1eef6d593c0182e9cbc965e9a32062d5271be1eb6 not found: ID does not exist" Jun 09 20:59:31.482165 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.482154 2557 scope.go:117] "RemoveContainer" containerID="cd65fddea0af7076f95cc0fce446b4c5b1b7ea395912a3b378de264cbd692a76" Jun 09 20:59:31.482636 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:59:31.482616 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd65fddea0af7076f95cc0fce446b4c5b1b7ea395912a3b378de264cbd692a76\": container with ID starting with cd65fddea0af7076f95cc0fce446b4c5b1b7ea395912a3b378de264cbd692a76 not found: ID does not exist" containerID="cd65fddea0af7076f95cc0fce446b4c5b1b7ea395912a3b378de264cbd692a76" Jun 09 20:59:31.482741 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.482723 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd65fddea0af7076f95cc0fce446b4c5b1b7ea395912a3b378de264cbd692a76"} err="failed to get container status \"cd65fddea0af7076f95cc0fce446b4c5b1b7ea395912a3b378de264cbd692a76\": rpc error: code = NotFound desc = could not find container \"cd65fddea0af7076f95cc0fce446b4c5b1b7ea395912a3b378de264cbd692a76\": container with ID starting with cd65fddea0af7076f95cc0fce446b4c5b1b7ea395912a3b378de264cbd692a76 not found: ID does not exist" Jun 09 20:59:31.482827 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.482817 2557 scope.go:117] "RemoveContainer" containerID="adc3db6446905a5bf320ec2692f61a1985165b54a4d5a7804dc09656953b3901" Jun 09 20:59:31.483334 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:59:31.483305 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adc3db6446905a5bf320ec2692f61a1985165b54a4d5a7804dc09656953b3901\": container with ID starting with adc3db6446905a5bf320ec2692f61a1985165b54a4d5a7804dc09656953b3901 not found: ID does not exist" containerID="adc3db6446905a5bf320ec2692f61a1985165b54a4d5a7804dc09656953b3901" Jun 09 20:59:31.483439 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.483344 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adc3db6446905a5bf320ec2692f61a1985165b54a4d5a7804dc09656953b3901"} err="failed to get container status \"adc3db6446905a5bf320ec2692f61a1985165b54a4d5a7804dc09656953b3901\": rpc error: code = NotFound desc = could not find container \"adc3db6446905a5bf320ec2692f61a1985165b54a4d5a7804dc09656953b3901\": container with ID starting with adc3db6446905a5bf320ec2692f61a1985165b54a4d5a7804dc09656953b3901 not found: ID does not exist" Jun 09 20:59:31.483439 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.483387 2557 scope.go:117] "RemoveContainer" containerID="9e5b13e867b9f9ae079c2c56ce1026715a9443eefc0483f300efb6bf5e2ba43c" Jun 09 20:59:31.483555 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.483318 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.483897 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.483865 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e5b13e867b9f9ae079c2c56ce1026715a9443eefc0483f300efb6bf5e2ba43c"} err="failed to get container status \"9e5b13e867b9f9ae079c2c56ce1026715a9443eefc0483f300efb6bf5e2ba43c\": rpc error: code = NotFound desc = could not find container \"9e5b13e867b9f9ae079c2c56ce1026715a9443eefc0483f300efb6bf5e2ba43c\": container with ID starting with 9e5b13e867b9f9ae079c2c56ce1026715a9443eefc0483f300efb6bf5e2ba43c not found: ID does not exist" Jun 09 20:59:31.484191 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.483900 2557 scope.go:117] "RemoveContainer" containerID="fd4a997072da637704d0e4a7dbf9fc490ca8fd3622fea77022b9aede32da71a5" Jun 09 20:59:31.484323 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.484293 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd4a997072da637704d0e4a7dbf9fc490ca8fd3622fea77022b9aede32da71a5"} err="failed to get container status \"fd4a997072da637704d0e4a7dbf9fc490ca8fd3622fea77022b9aede32da71a5\": rpc error: code = NotFound desc = could not find container \"fd4a997072da637704d0e4a7dbf9fc490ca8fd3622fea77022b9aede32da71a5\": container with ID starting with fd4a997072da637704d0e4a7dbf9fc490ca8fd3622fea77022b9aede32da71a5 not found: ID does not exist" Jun 09 20:59:31.484417 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.484327 2557 scope.go:117] "RemoveContainer" containerID="3034cf0a23cd3ecde2296e7d34b5942d84d2f28d12d2229ec755470bb7f79ea2" Jun 09 20:59:31.484789 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.484757 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3034cf0a23cd3ecde2296e7d34b5942d84d2f28d12d2229ec755470bb7f79ea2"} err="failed to get container status \"3034cf0a23cd3ecde2296e7d34b5942d84d2f28d12d2229ec755470bb7f79ea2\": rpc error: code = NotFound desc = could not find container \"3034cf0a23cd3ecde2296e7d34b5942d84d2f28d12d2229ec755470bb7f79ea2\": container with ID starting with 3034cf0a23cd3ecde2296e7d34b5942d84d2f28d12d2229ec755470bb7f79ea2 not found: ID does not exist" Jun 09 20:59:31.484789 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.484784 2557 scope.go:117] "RemoveContainer" containerID="b8e70255b40a68f495cf404410cb7a11fbba01de5d8cef81d2a6130c25ae0342" Jun 09 20:59:31.485415 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.485355 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8e70255b40a68f495cf404410cb7a11fbba01de5d8cef81d2a6130c25ae0342"} err="failed to get container status \"b8e70255b40a68f495cf404410cb7a11fbba01de5d8cef81d2a6130c25ae0342\": rpc error: code = NotFound desc = could not find container \"b8e70255b40a68f495cf404410cb7a11fbba01de5d8cef81d2a6130c25ae0342\": container with ID starting with b8e70255b40a68f495cf404410cb7a11fbba01de5d8cef81d2a6130c25ae0342 not found: ID does not exist" Jun 09 20:59:31.485510 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.485419 2557 scope.go:117] "RemoveContainer" containerID="f3e8b8f560fa70d7deca3ad1eef6d593c0182e9cbc965e9a32062d5271be1eb6" Jun 09 20:59:31.486273 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.486161 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3e8b8f560fa70d7deca3ad1eef6d593c0182e9cbc965e9a32062d5271be1eb6"} err="failed to get container status \"f3e8b8f560fa70d7deca3ad1eef6d593c0182e9cbc965e9a32062d5271be1eb6\": rpc error: code = NotFound desc = could not find container \"f3e8b8f560fa70d7deca3ad1eef6d593c0182e9cbc965e9a32062d5271be1eb6\": container with ID starting with f3e8b8f560fa70d7deca3ad1eef6d593c0182e9cbc965e9a32062d5271be1eb6 not found: ID does not exist" Jun 09 20:59:31.486273 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.486189 2557 scope.go:117] "RemoveContainer" containerID="cd65fddea0af7076f95cc0fce446b4c5b1b7ea395912a3b378de264cbd692a76" Jun 09 20:59:31.486457 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.486332 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 20:59:31.486457 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.486394 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jpt5c\"" Jun 09 20:59:31.486457 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.486399 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 20:59:31.486457 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.486439 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 20:59:31.486687 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.486664 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 20:59:31.486753 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.486677 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd65fddea0af7076f95cc0fce446b4c5b1b7ea395912a3b378de264cbd692a76"} err="failed to get container status \"cd65fddea0af7076f95cc0fce446b4c5b1b7ea395912a3b378de264cbd692a76\": rpc error: code = NotFound desc = could not find container \"cd65fddea0af7076f95cc0fce446b4c5b1b7ea395912a3b378de264cbd692a76\": container with ID starting with cd65fddea0af7076f95cc0fce446b4c5b1b7ea395912a3b378de264cbd692a76 not found: ID does not exist" Jun 09 20:59:31.486753 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.486708 2557 scope.go:117] "RemoveContainer" containerID="adc3db6446905a5bf320ec2692f61a1985165b54a4d5a7804dc09656953b3901" Jun 09 20:59:31.486858 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.486780 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 20:59:31.487065 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.486967 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 20:59:31.487065 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.487023 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 20:59:31.487290 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.487084 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 20:59:31.487401 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.487344 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adc3db6446905a5bf320ec2692f61a1985165b54a4d5a7804dc09656953b3901"} err="failed to get container status \"adc3db6446905a5bf320ec2692f61a1985165b54a4d5a7804dc09656953b3901\": rpc error: code = NotFound desc = could not find container \"adc3db6446905a5bf320ec2692f61a1985165b54a4d5a7804dc09656953b3901\": container with ID starting with adc3db6446905a5bf320ec2692f61a1985165b54a4d5a7804dc09656953b3901 not found: ID does not exist" Jun 09 20:59:31.491702 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.491662 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 20:59:31.492300 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.492281 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 20:59:31.582425 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.582366 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ad933abe-69dc-4bd7-aec1-a74811e4cb08-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.582425 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.582430 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ad933abe-69dc-4bd7-aec1-a74811e4cb08-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.582654 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.582452 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ad933abe-69dc-4bd7-aec1-a74811e4cb08-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.582654 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.582471 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ad933abe-69dc-4bd7-aec1-a74811e4cb08-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.582654 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.582488 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad933abe-69dc-4bd7-aec1-a74811e4cb08-web-config\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.582654 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.582533 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad933abe-69dc-4bd7-aec1-a74811e4cb08-config-out\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.582654 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.582565 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad933abe-69dc-4bd7-aec1-a74811e4cb08-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.582654 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.582591 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmnp9\" (UniqueName: \"kubernetes.io/projected/ad933abe-69dc-4bd7-aec1-a74811e4cb08-kube-api-access-nmnp9\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.582654 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.582614 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad933abe-69dc-4bd7-aec1-a74811e4cb08-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.582654 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.582629 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad933abe-69dc-4bd7-aec1-a74811e4cb08-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.582897 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.582701 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ad933abe-69dc-4bd7-aec1-a74811e4cb08-config-volume\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.582897 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.582723 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad933abe-69dc-4bd7-aec1-a74811e4cb08-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.582897 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.582774 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad933abe-69dc-4bd7-aec1-a74811e4cb08-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.683530 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.683438 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ad933abe-69dc-4bd7-aec1-a74811e4cb08-config-volume\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.683530 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.683477 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad933abe-69dc-4bd7-aec1-a74811e4cb08-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.683530 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.683514 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad933abe-69dc-4bd7-aec1-a74811e4cb08-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.683830 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.683539 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ad933abe-69dc-4bd7-aec1-a74811e4cb08-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.683830 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.683557 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ad933abe-69dc-4bd7-aec1-a74811e4cb08-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.683830 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.683573 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ad933abe-69dc-4bd7-aec1-a74811e4cb08-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.683830 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.683590 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ad933abe-69dc-4bd7-aec1-a74811e4cb08-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.684181 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.684121 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ad933abe-69dc-4bd7-aec1-a74811e4cb08-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.684181 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.684154 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad933abe-69dc-4bd7-aec1-a74811e4cb08-web-config\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.684692 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.684202 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad933abe-69dc-4bd7-aec1-a74811e4cb08-config-out\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.684692 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.684230 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad933abe-69dc-4bd7-aec1-a74811e4cb08-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.684692 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.684259 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmnp9\" (UniqueName: \"kubernetes.io/projected/ad933abe-69dc-4bd7-aec1-a74811e4cb08-kube-api-access-nmnp9\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.684692 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.684293 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad933abe-69dc-4bd7-aec1-a74811e4cb08-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.684692 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.684317 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad933abe-69dc-4bd7-aec1-a74811e4cb08-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.684692 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.684623 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad933abe-69dc-4bd7-aec1-a74811e4cb08-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.685264 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.685067 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad933abe-69dc-4bd7-aec1-a74811e4cb08-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.686915 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.686866 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ad933abe-69dc-4bd7-aec1-a74811e4cb08-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.687014 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.686922 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ad933abe-69dc-4bd7-aec1-a74811e4cb08-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.687014 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.686939 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad933abe-69dc-4bd7-aec1-a74811e4cb08-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.687436 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.687391 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ad933abe-69dc-4bd7-aec1-a74811e4cb08-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.687577 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.687559 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ad933abe-69dc-4bd7-aec1-a74811e4cb08-config-volume\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.687684 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.687662 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad933abe-69dc-4bd7-aec1-a74811e4cb08-web-config\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.687943 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.687916 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad933abe-69dc-4bd7-aec1-a74811e4cb08-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.688253 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.688233 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad933abe-69dc-4bd7-aec1-a74811e4cb08-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.688565 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.688551 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad933abe-69dc-4bd7-aec1-a74811e4cb08-config-out\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.693419 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.693401 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmnp9\" (UniqueName: \"kubernetes.io/projected/ad933abe-69dc-4bd7-aec1-a74811e4cb08-kube-api-access-nmnp9\") pod \"alertmanager-main-0\" (UID: \"ad933abe-69dc-4bd7-aec1-a74811e4cb08\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.796301 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.796249 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 20:59:31.948356 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:31.948321 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 20:59:31.952681 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:59:31.952640 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad933abe_69dc_4bd7_aec1_a74811e4cb08.slice/crio-34ef16c5bb6eabd4d68dfb7fb138f6d302475c3bbb613ecce4f2ffafd4464c85 WatchSource:0}: Error finding container 34ef16c5bb6eabd4d68dfb7fb138f6d302475c3bbb613ecce4f2ffafd4464c85: Status 404 returned error can't find the container with id 34ef16c5bb6eabd4d68dfb7fb138f6d302475c3bbb613ecce4f2ffafd4464c85 Jun 09 20:59:32.190908 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:32.190862 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbde15b6-bd7f-4971-a247-bcc088775d8a" path="/var/lib/kubelet/pods/dbde15b6-bd7f-4971-a247-bcc088775d8a/volumes" Jun 09 20:59:32.427436 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:32.427317 2557 generic.go:356] "Generic (PLEG): container finished" podID="ad933abe-69dc-4bd7-aec1-a74811e4cb08" containerID="aa0bd6135c8d88f137a56a1067589a178acccd85c96aa8ab23436c8a28991c09" exitCode=0 Jun 09 20:59:32.427436 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:32.427361 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad933abe-69dc-4bd7-aec1-a74811e4cb08","Type":"ContainerDied","Data":"aa0bd6135c8d88f137a56a1067589a178acccd85c96aa8ab23436c8a28991c09"} Jun 09 20:59:32.427679 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:32.427440 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad933abe-69dc-4bd7-aec1-a74811e4cb08","Type":"ContainerStarted","Data":"34ef16c5bb6eabd4d68dfb7fb138f6d302475c3bbb613ecce4f2ffafd4464c85"} Jun 09 20:59:33.435868 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:33.435830 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad933abe-69dc-4bd7-aec1-a74811e4cb08","Type":"ContainerStarted","Data":"ec17567aeee3ac05ad79c285697457fe7e638580bfdf95bab776d952044e9c69"} Jun 09 20:59:33.436349 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:33.435910 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad933abe-69dc-4bd7-aec1-a74811e4cb08","Type":"ContainerStarted","Data":"d1f66533598c1474954a0eab95c0ef9d13628f55b47b7f44f53cd53b96239bf2"} Jun 09 20:59:33.436349 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:33.435950 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad933abe-69dc-4bd7-aec1-a74811e4cb08","Type":"ContainerStarted","Data":"e2362ecd6e06932d2c53cc75c096f2ceb2802b7041c3202bb24934af11a78c2b"} Jun 09 20:59:33.436349 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:33.435994 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad933abe-69dc-4bd7-aec1-a74811e4cb08","Type":"ContainerStarted","Data":"85ac3d8aea3cca481e0f7cf367a4d8d80dc8e3620e409a5f18f7c2b18801f355"} Jun 09 20:59:33.436349 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:33.436041 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad933abe-69dc-4bd7-aec1-a74811e4cb08","Type":"ContainerStarted","Data":"08d0a7a763c1c35f390042f315255e5e2088efda1b1c0081a35ab02e156e2bdf"} Jun 09 20:59:33.436349 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:33.436081 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad933abe-69dc-4bd7-aec1-a74811e4cb08","Type":"ContainerStarted","Data":"654491ec2db7859b523c4554fd9f1a5bef3ce37f53fd7186ab195b05f162af4c"} Jun 09 20:59:33.459041 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:33.458974 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.437514723 podStartE2EDuration="2.458950035s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.435312ms" isStatefulPod=false podCreationTimestamp="2026-06-09 20:59:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:59:33.457084333 +0000 UTC m=+325.792773538" watchObservedRunningTime="2026-06-09 20:59:33.458950035 +0000 UTC m=+325.794639240" Jun 09 20:59:34.059917 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:34.059872 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 20:59:34.060354 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:34.060313 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="10d61c5a-3e40-4978-8270-9f75aa722147" containerName="kube-rbac-proxy-thanos" containerID="cri-o://ce1aa40ca0b5501fff89bab33038db6654d3417d6628fb1c7f4532a41b0fe929" gracePeriod=600 Jun 09 20:59:34.061007 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:34.060973 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="10d61c5a-3e40-4978-8270-9f75aa722147" containerName="kube-rbac-proxy-web" containerID="cri-o://8a453e880769c5a0ef23aff71f27150b281cc62fbcb3120884453e46805ca769" gracePeriod=600 Jun 09 20:59:34.061125 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:34.061105 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="10d61c5a-3e40-4978-8270-9f75aa722147" containerName="kube-rbac-proxy" containerID="cri-o://0002bfa97bf319e2931ddbac57a409597c7394e8e61f20952b897353ad8fe627" gracePeriod=600 Jun 09 20:59:34.061231 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:34.061213 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="10d61c5a-3e40-4978-8270-9f75aa722147" containerName="thanos-sidecar" containerID="cri-o://5fefdd8570ae9bfcd11772adcf0651ed92f58855b84d006d1be386d7b8f6e126" gracePeriod=600 Jun 09 20:59:34.061327 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:34.061308 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="10d61c5a-3e40-4978-8270-9f75aa722147" containerName="config-reloader" containerID="cri-o://b49011eb470823d3eae939a177f539cb3e1a38c1c56e3c91893743790632d19f" gracePeriod=600 Jun 09 20:59:34.063034 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:34.062410 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="10d61c5a-3e40-4978-8270-9f75aa722147" containerName="prometheus" containerID="cri-o://a3cc4db6fa7d835837c1e000308db9d507382cbbe99f8f543adf00d334495357" gracePeriod=600 Jun 09 20:59:34.443211 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:34.443177 2557 generic.go:356] "Generic (PLEG): container finished" podID="10d61c5a-3e40-4978-8270-9f75aa722147" containerID="ce1aa40ca0b5501fff89bab33038db6654d3417d6628fb1c7f4532a41b0fe929" exitCode=0 Jun 09 20:59:34.443211 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:34.443203 2557 generic.go:356] "Generic (PLEG): container finished" podID="10d61c5a-3e40-4978-8270-9f75aa722147" containerID="0002bfa97bf319e2931ddbac57a409597c7394e8e61f20952b897353ad8fe627" exitCode=0 Jun 09 20:59:34.443211 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:34.443210 2557 generic.go:356] "Generic (PLEG): container finished" podID="10d61c5a-3e40-4978-8270-9f75aa722147" containerID="5fefdd8570ae9bfcd11772adcf0651ed92f58855b84d006d1be386d7b8f6e126" exitCode=0 Jun 09 20:59:34.443211 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:34.443216 2557 generic.go:356] "Generic (PLEG): container finished" podID="10d61c5a-3e40-4978-8270-9f75aa722147" containerID="b49011eb470823d3eae939a177f539cb3e1a38c1c56e3c91893743790632d19f" exitCode=0 Jun 09 20:59:34.443211 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:34.443222 2557 generic.go:356] "Generic (PLEG): container finished" podID="10d61c5a-3e40-4978-8270-9f75aa722147" containerID="a3cc4db6fa7d835837c1e000308db9d507382cbbe99f8f543adf00d334495357" exitCode=0 Jun 09 20:59:34.443793 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:34.443257 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10d61c5a-3e40-4978-8270-9f75aa722147","Type":"ContainerDied","Data":"ce1aa40ca0b5501fff89bab33038db6654d3417d6628fb1c7f4532a41b0fe929"} Jun 09 20:59:34.443793 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:34.443345 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10d61c5a-3e40-4978-8270-9f75aa722147","Type":"ContainerDied","Data":"0002bfa97bf319e2931ddbac57a409597c7394e8e61f20952b897353ad8fe627"} Jun 09 20:59:34.443793 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:34.443418 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10d61c5a-3e40-4978-8270-9f75aa722147","Type":"ContainerDied","Data":"5fefdd8570ae9bfcd11772adcf0651ed92f58855b84d006d1be386d7b8f6e126"} Jun 09 20:59:34.443793 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:34.443461 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10d61c5a-3e40-4978-8270-9f75aa722147","Type":"ContainerDied","Data":"b49011eb470823d3eae939a177f539cb3e1a38c1c56e3c91893743790632d19f"} Jun 09 20:59:34.443793 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:34.443501 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10d61c5a-3e40-4978-8270-9f75aa722147","Type":"ContainerDied","Data":"a3cc4db6fa7d835837c1e000308db9d507382cbbe99f8f543adf00d334495357"} Jun 09 20:59:35.312895 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.312868 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.420448 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.420323 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10d61c5a-3e40-4978-8270-9f75aa722147-tls-assets\") pod \"10d61c5a-3e40-4978-8270-9f75aa722147\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " Jun 09 20:59:35.420448 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.420396 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"10d61c5a-3e40-4978-8270-9f75aa722147\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " Jun 09 20:59:35.420448 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.420421 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-configmap-serving-certs-ca-bundle\") pod \"10d61c5a-3e40-4978-8270-9f75aa722147\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " Jun 09 20:59:35.420712 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.420525 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10d61c5a-3e40-4978-8270-9f75aa722147-config-out\") pod \"10d61c5a-3e40-4978-8270-9f75aa722147\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " Jun 09 20:59:35.420712 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.420578 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-prometheus-k8s-rulefiles-0\") pod \"10d61c5a-3e40-4978-8270-9f75aa722147\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " Jun 09 20:59:35.420712 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.420601 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-configmap-metrics-client-ca\") pod \"10d61c5a-3e40-4978-8270-9f75aa722147\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " Jun 09 20:59:35.420712 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.420633 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"10d61c5a-3e40-4978-8270-9f75aa722147\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " Jun 09 20:59:35.420712 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.420664 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-prometheus-k8s-rulefiles-2\") pod \"10d61c5a-3e40-4978-8270-9f75aa722147\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " Jun 09 20:59:35.420712 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.420699 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-prometheus-trusted-ca-bundle\") pod \"10d61c5a-3e40-4978-8270-9f75aa722147\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " Jun 09 20:59:35.420955 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.420743 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-prometheus-k8s-rulefiles-1\") pod \"10d61c5a-3e40-4978-8270-9f75aa722147\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " Jun 09 20:59:35.420955 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.420743 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "10d61c5a-3e40-4978-8270-9f75aa722147" (UID: "10d61c5a-3e40-4978-8270-9f75aa722147"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 20:59:35.420955 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.420769 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-kube-rbac-proxy\") pod \"10d61c5a-3e40-4978-8270-9f75aa722147\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " Jun 09 20:59:35.420955 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.420799 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-configmap-kubelet-serving-ca-bundle\") pod \"10d61c5a-3e40-4978-8270-9f75aa722147\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " Jun 09 20:59:35.420955 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.420824 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-config\") pod \"10d61c5a-3e40-4978-8270-9f75aa722147\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " Jun 09 20:59:35.420955 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.420856 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-metrics-client-certs\") pod \"10d61c5a-3e40-4978-8270-9f75aa722147\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " Jun 09 20:59:35.420955 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.420881 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-web-config\") pod \"10d61c5a-3e40-4978-8270-9f75aa722147\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " Jun 09 20:59:35.420955 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.420909 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/10d61c5a-3e40-4978-8270-9f75aa722147-prometheus-k8s-db\") pod \"10d61c5a-3e40-4978-8270-9f75aa722147\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " Jun 09 20:59:35.420955 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.420944 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqnkx\" (UniqueName: \"kubernetes.io/projected/10d61c5a-3e40-4978-8270-9f75aa722147-kube-api-access-rqnkx\") pod \"10d61c5a-3e40-4978-8270-9f75aa722147\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " Jun 09 20:59:35.421507 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.420974 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-thanos-prometheus-http-client-file\") pod \"10d61c5a-3e40-4978-8270-9f75aa722147\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " Jun 09 20:59:35.421507 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.421004 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-prometheus-k8s-tls\") pod \"10d61c5a-3e40-4978-8270-9f75aa722147\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " Jun 09 20:59:35.421507 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.421031 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-grpc-tls\") pod \"10d61c5a-3e40-4978-8270-9f75aa722147\" (UID: \"10d61c5a-3e40-4978-8270-9f75aa722147\") " Jun 09 20:59:35.421507 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.421111 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "10d61c5a-3e40-4978-8270-9f75aa722147" (UID: "10d61c5a-3e40-4978-8270-9f75aa722147"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 20:59:35.421507 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.421117 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "10d61c5a-3e40-4978-8270-9f75aa722147" (UID: "10d61c5a-3e40-4978-8270-9f75aa722147"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 20:59:35.421507 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.421342 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "10d61c5a-3e40-4978-8270-9f75aa722147" (UID: "10d61c5a-3e40-4978-8270-9f75aa722147"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 20:59:35.421507 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.421405 2557 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-configmap-metrics-client-ca\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:35.421507 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.421427 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:35.421507 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.421442 2557 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:35.422029 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.421664 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "10d61c5a-3e40-4978-8270-9f75aa722147" (UID: "10d61c5a-3e40-4978-8270-9f75aa722147"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 20:59:35.422029 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.422006 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "10d61c5a-3e40-4978-8270-9f75aa722147" (UID: "10d61c5a-3e40-4978-8270-9f75aa722147"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 20:59:35.422416 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.422343 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10d61c5a-3e40-4978-8270-9f75aa722147-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "10d61c5a-3e40-4978-8270-9f75aa722147" (UID: "10d61c5a-3e40-4978-8270-9f75aa722147"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 20:59:35.423369 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.423090 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "10d61c5a-3e40-4978-8270-9f75aa722147" (UID: "10d61c5a-3e40-4978-8270-9f75aa722147"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 20:59:35.423691 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.423641 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10d61c5a-3e40-4978-8270-9f75aa722147-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "10d61c5a-3e40-4978-8270-9f75aa722147" (UID: "10d61c5a-3e40-4978-8270-9f75aa722147"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 20:59:35.423885 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.423727 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10d61c5a-3e40-4978-8270-9f75aa722147-config-out" (OuterVolumeSpecName: "config-out") pod "10d61c5a-3e40-4978-8270-9f75aa722147" (UID: "10d61c5a-3e40-4978-8270-9f75aa722147"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 20:59:35.424756 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.424727 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "10d61c5a-3e40-4978-8270-9f75aa722147" (UID: "10d61c5a-3e40-4978-8270-9f75aa722147"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 20:59:35.425695 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.425665 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "10d61c5a-3e40-4978-8270-9f75aa722147" (UID: "10d61c5a-3e40-4978-8270-9f75aa722147"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 20:59:35.425823 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.425796 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "10d61c5a-3e40-4978-8270-9f75aa722147" (UID: "10d61c5a-3e40-4978-8270-9f75aa722147"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 20:59:35.425892 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.425818 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-config" (OuterVolumeSpecName: "config") pod "10d61c5a-3e40-4978-8270-9f75aa722147" (UID: "10d61c5a-3e40-4978-8270-9f75aa722147"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 20:59:35.425892 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.425855 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "10d61c5a-3e40-4978-8270-9f75aa722147" (UID: "10d61c5a-3e40-4978-8270-9f75aa722147"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 20:59:35.425892 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.425878 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "10d61c5a-3e40-4978-8270-9f75aa722147" (UID: "10d61c5a-3e40-4978-8270-9f75aa722147"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 20:59:35.426256 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.426225 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10d61c5a-3e40-4978-8270-9f75aa722147-kube-api-access-rqnkx" (OuterVolumeSpecName: "kube-api-access-rqnkx") pod "10d61c5a-3e40-4978-8270-9f75aa722147" (UID: "10d61c5a-3e40-4978-8270-9f75aa722147"). InnerVolumeSpecName "kube-api-access-rqnkx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 20:59:35.426355 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.426332 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "10d61c5a-3e40-4978-8270-9f75aa722147" (UID: "10d61c5a-3e40-4978-8270-9f75aa722147"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 20:59:35.426827 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.426805 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "10d61c5a-3e40-4978-8270-9f75aa722147" (UID: "10d61c5a-3e40-4978-8270-9f75aa722147"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 20:59:35.436837 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.436808 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-web-config" (OuterVolumeSpecName: "web-config") pod "10d61c5a-3e40-4978-8270-9f75aa722147" (UID: "10d61c5a-3e40-4978-8270-9f75aa722147"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 20:59:35.451032 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.450996 2557 generic.go:356] "Generic (PLEG): container finished" podID="10d61c5a-3e40-4978-8270-9f75aa722147" containerID="8a453e880769c5a0ef23aff71f27150b281cc62fbcb3120884453e46805ca769" exitCode=0 Jun 09 20:59:35.451343 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.451066 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10d61c5a-3e40-4978-8270-9f75aa722147","Type":"ContainerDied","Data":"8a453e880769c5a0ef23aff71f27150b281cc62fbcb3120884453e46805ca769"} Jun 09 20:59:35.451343 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.451086 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.451343 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.451141 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10d61c5a-3e40-4978-8270-9f75aa722147","Type":"ContainerDied","Data":"020ebd8d16b3c5e849ec2a705d40f822199822b146cc64c028ce8c402e6f11f8"} Jun 09 20:59:35.451343 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.451175 2557 scope.go:117] "RemoveContainer" containerID="ce1aa40ca0b5501fff89bab33038db6654d3417d6628fb1c7f4532a41b0fe929" Jun 09 20:59:35.460555 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.460531 2557 scope.go:117] "RemoveContainer" containerID="0002bfa97bf319e2931ddbac57a409597c7394e8e61f20952b897353ad8fe627" Jun 09 20:59:35.467986 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.467969 2557 scope.go:117] "RemoveContainer" containerID="8a453e880769c5a0ef23aff71f27150b281cc62fbcb3120884453e46805ca769" Jun 09 20:59:35.473553 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.473529 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 20:59:35.479228 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.479200 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 20:59:35.479469 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.479453 2557 scope.go:117] "RemoveContainer" containerID="5fefdd8570ae9bfcd11772adcf0651ed92f58855b84d006d1be386d7b8f6e126" Jun 09 20:59:35.486817 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.486798 2557 scope.go:117] "RemoveContainer" containerID="b49011eb470823d3eae939a177f539cb3e1a38c1c56e3c91893743790632d19f" Jun 09 20:59:35.494282 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.494260 2557 scope.go:117] "RemoveContainer" containerID="a3cc4db6fa7d835837c1e000308db9d507382cbbe99f8f543adf00d334495357" Jun 09 20:59:35.502324 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.502306 2557 scope.go:117] "RemoveContainer" containerID="c11f10cc3190e49b0e7472988b188008c3906ad85b7179f3c916c925cef3eed6" Jun 09 20:59:35.504422 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.504400 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 20:59:35.504716 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.504704 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10d61c5a-3e40-4978-8270-9f75aa722147" containerName="init-config-reloader" Jun 09 20:59:35.504759 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.504718 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="10d61c5a-3e40-4978-8270-9f75aa722147" containerName="init-config-reloader" Jun 09 20:59:35.504759 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.504731 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10d61c5a-3e40-4978-8270-9f75aa722147" containerName="kube-rbac-proxy-web" Jun 09 20:59:35.504759 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.504738 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="10d61c5a-3e40-4978-8270-9f75aa722147" containerName="kube-rbac-proxy-web" Jun 09 20:59:35.504759 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.504743 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10d61c5a-3e40-4978-8270-9f75aa722147" containerName="kube-rbac-proxy-thanos" Jun 09 20:59:35.504759 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.504749 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="10d61c5a-3e40-4978-8270-9f75aa722147" containerName="kube-rbac-proxy-thanos" Jun 09 20:59:35.504759 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.504758 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10d61c5a-3e40-4978-8270-9f75aa722147" containerName="thanos-sidecar" Jun 09 20:59:35.504932 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.504763 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="10d61c5a-3e40-4978-8270-9f75aa722147" containerName="thanos-sidecar" Jun 09 20:59:35.504932 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.504770 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10d61c5a-3e40-4978-8270-9f75aa722147" containerName="kube-rbac-proxy" Jun 09 20:59:35.504932 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.504775 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="10d61c5a-3e40-4978-8270-9f75aa722147" containerName="kube-rbac-proxy" Jun 09 20:59:35.504932 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.504785 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10d61c5a-3e40-4978-8270-9f75aa722147" containerName="prometheus" Jun 09 20:59:35.504932 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.504790 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="10d61c5a-3e40-4978-8270-9f75aa722147" containerName="prometheus" Jun 09 20:59:35.504932 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.504795 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10d61c5a-3e40-4978-8270-9f75aa722147" containerName="config-reloader" Jun 09 20:59:35.504932 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.504800 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="10d61c5a-3e40-4978-8270-9f75aa722147" containerName="config-reloader" Jun 09 20:59:35.504932 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.504847 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="10d61c5a-3e40-4978-8270-9f75aa722147" containerName="config-reloader" Jun 09 20:59:35.504932 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.504855 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="10d61c5a-3e40-4978-8270-9f75aa722147" containerName="thanos-sidecar" Jun 09 20:59:35.504932 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.504862 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="10d61c5a-3e40-4978-8270-9f75aa722147" containerName="kube-rbac-proxy-web" Jun 09 20:59:35.504932 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.504867 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="10d61c5a-3e40-4978-8270-9f75aa722147" containerName="kube-rbac-proxy" Jun 09 20:59:35.504932 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.504873 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="10d61c5a-3e40-4978-8270-9f75aa722147" containerName="prometheus" Jun 09 20:59:35.504932 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.504879 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="10d61c5a-3e40-4978-8270-9f75aa722147" containerName="kube-rbac-proxy-thanos" Jun 09 20:59:35.510587 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.510531 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.512939 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.512791 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-763t329t7nbto\"" Jun 09 20:59:35.512939 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.512806 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 20:59:35.512939 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.512856 2557 scope.go:117] "RemoveContainer" containerID="ce1aa40ca0b5501fff89bab33038db6654d3417d6628fb1c7f4532a41b0fe929" Jun 09 20:59:35.512939 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.512896 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 20:59:35.512939 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.512897 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 20:59:35.512939 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.512858 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 20:59:35.513260 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.512986 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 20:59:35.513260 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.512996 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 20:59:35.513260 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.513133 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 20:59:35.513427 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.513260 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-pfgb6\"" Jun 09 20:59:35.513427 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.513260 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 20:59:35.513427 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:59:35.513335 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce1aa40ca0b5501fff89bab33038db6654d3417d6628fb1c7f4532a41b0fe929\": container with ID starting with ce1aa40ca0b5501fff89bab33038db6654d3417d6628fb1c7f4532a41b0fe929 not found: ID does not exist" containerID="ce1aa40ca0b5501fff89bab33038db6654d3417d6628fb1c7f4532a41b0fe929" Jun 09 20:59:35.513427 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.513367 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce1aa40ca0b5501fff89bab33038db6654d3417d6628fb1c7f4532a41b0fe929"} err="failed to get container status \"ce1aa40ca0b5501fff89bab33038db6654d3417d6628fb1c7f4532a41b0fe929\": rpc error: code = NotFound desc = could not find container \"ce1aa40ca0b5501fff89bab33038db6654d3417d6628fb1c7f4532a41b0fe929\": container with ID starting with ce1aa40ca0b5501fff89bab33038db6654d3417d6628fb1c7f4532a41b0fe929 not found: ID does not exist" Jun 09 20:59:35.513427 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.513417 2557 scope.go:117] "RemoveContainer" containerID="0002bfa97bf319e2931ddbac57a409597c7394e8e61f20952b897353ad8fe627" Jun 09 20:59:35.513669 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.513507 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 20:59:35.513669 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.513521 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 20:59:35.513669 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.513569 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 20:59:35.513669 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.513527 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 20:59:35.513802 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:59:35.513738 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0002bfa97bf319e2931ddbac57a409597c7394e8e61f20952b897353ad8fe627\": container with ID starting with 0002bfa97bf319e2931ddbac57a409597c7394e8e61f20952b897353ad8fe627 not found: ID does not exist" containerID="0002bfa97bf319e2931ddbac57a409597c7394e8e61f20952b897353ad8fe627" Jun 09 20:59:35.513802 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.513770 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0002bfa97bf319e2931ddbac57a409597c7394e8e61f20952b897353ad8fe627"} err="failed to get container status \"0002bfa97bf319e2931ddbac57a409597c7394e8e61f20952b897353ad8fe627\": rpc error: code = NotFound desc = could not find container \"0002bfa97bf319e2931ddbac57a409597c7394e8e61f20952b897353ad8fe627\": container with ID starting with 0002bfa97bf319e2931ddbac57a409597c7394e8e61f20952b897353ad8fe627 not found: ID does not exist" Jun 09 20:59:35.513802 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.513795 2557 scope.go:117] "RemoveContainer" containerID="8a453e880769c5a0ef23aff71f27150b281cc62fbcb3120884453e46805ca769" Jun 09 20:59:35.513919 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.513878 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 20:59:35.514075 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:59:35.514054 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a453e880769c5a0ef23aff71f27150b281cc62fbcb3120884453e46805ca769\": container with ID starting with 8a453e880769c5a0ef23aff71f27150b281cc62fbcb3120884453e46805ca769 not found: ID does not exist" containerID="8a453e880769c5a0ef23aff71f27150b281cc62fbcb3120884453e46805ca769" Jun 09 20:59:35.514147 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.514083 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a453e880769c5a0ef23aff71f27150b281cc62fbcb3120884453e46805ca769"} err="failed to get container status \"8a453e880769c5a0ef23aff71f27150b281cc62fbcb3120884453e46805ca769\": rpc error: code = NotFound desc = could not find container \"8a453e880769c5a0ef23aff71f27150b281cc62fbcb3120884453e46805ca769\": container with ID starting with 8a453e880769c5a0ef23aff71f27150b281cc62fbcb3120884453e46805ca769 not found: ID does not exist" Jun 09 20:59:35.514147 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.514103 2557 scope.go:117] "RemoveContainer" containerID="5fefdd8570ae9bfcd11772adcf0651ed92f58855b84d006d1be386d7b8f6e126" Jun 09 20:59:35.514607 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:59:35.514584 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fefdd8570ae9bfcd11772adcf0651ed92f58855b84d006d1be386d7b8f6e126\": container with ID starting with 5fefdd8570ae9bfcd11772adcf0651ed92f58855b84d006d1be386d7b8f6e126 not found: ID does not exist" containerID="5fefdd8570ae9bfcd11772adcf0651ed92f58855b84d006d1be386d7b8f6e126" Jun 09 20:59:35.514705 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.514636 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fefdd8570ae9bfcd11772adcf0651ed92f58855b84d006d1be386d7b8f6e126"} err="failed to get container status \"5fefdd8570ae9bfcd11772adcf0651ed92f58855b84d006d1be386d7b8f6e126\": rpc error: code = NotFound desc = could not find container \"5fefdd8570ae9bfcd11772adcf0651ed92f58855b84d006d1be386d7b8f6e126\": container with ID starting with 5fefdd8570ae9bfcd11772adcf0651ed92f58855b84d006d1be386d7b8f6e126 not found: ID does not exist" Jun 09 20:59:35.514705 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.514658 2557 scope.go:117] "RemoveContainer" containerID="b49011eb470823d3eae939a177f539cb3e1a38c1c56e3c91893743790632d19f" Jun 09 20:59:35.514996 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:59:35.514970 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b49011eb470823d3eae939a177f539cb3e1a38c1c56e3c91893743790632d19f\": container with ID starting with b49011eb470823d3eae939a177f539cb3e1a38c1c56e3c91893743790632d19f not found: ID does not exist" containerID="b49011eb470823d3eae939a177f539cb3e1a38c1c56e3c91893743790632d19f" Jun 09 20:59:35.515081 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.515002 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b49011eb470823d3eae939a177f539cb3e1a38c1c56e3c91893743790632d19f"} err="failed to get container status \"b49011eb470823d3eae939a177f539cb3e1a38c1c56e3c91893743790632d19f\": rpc error: code = NotFound desc = could not find container \"b49011eb470823d3eae939a177f539cb3e1a38c1c56e3c91893743790632d19f\": container with ID starting with b49011eb470823d3eae939a177f539cb3e1a38c1c56e3c91893743790632d19f not found: ID does not exist" Jun 09 20:59:35.515200 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.515096 2557 scope.go:117] "RemoveContainer" containerID="a3cc4db6fa7d835837c1e000308db9d507382cbbe99f8f543adf00d334495357" Jun 09 20:59:35.515480 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:59:35.515453 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3cc4db6fa7d835837c1e000308db9d507382cbbe99f8f543adf00d334495357\": container with ID starting with a3cc4db6fa7d835837c1e000308db9d507382cbbe99f8f543adf00d334495357 not found: ID does not exist" containerID="a3cc4db6fa7d835837c1e000308db9d507382cbbe99f8f543adf00d334495357" Jun 09 20:59:35.515544 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.515489 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3cc4db6fa7d835837c1e000308db9d507382cbbe99f8f543adf00d334495357"} err="failed to get container status \"a3cc4db6fa7d835837c1e000308db9d507382cbbe99f8f543adf00d334495357\": rpc error: code = NotFound desc = could not find container \"a3cc4db6fa7d835837c1e000308db9d507382cbbe99f8f543adf00d334495357\": container with ID starting with a3cc4db6fa7d835837c1e000308db9d507382cbbe99f8f543adf00d334495357 not found: ID does not exist" Jun 09 20:59:35.515544 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.515507 2557 scope.go:117] "RemoveContainer" containerID="c11f10cc3190e49b0e7472988b188008c3906ad85b7179f3c916c925cef3eed6" Jun 09 20:59:35.515786 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:59:35.515762 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c11f10cc3190e49b0e7472988b188008c3906ad85b7179f3c916c925cef3eed6\": container with ID starting with c11f10cc3190e49b0e7472988b188008c3906ad85b7179f3c916c925cef3eed6 not found: ID does not exist" containerID="c11f10cc3190e49b0e7472988b188008c3906ad85b7179f3c916c925cef3eed6" Jun 09 20:59:35.515870 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.515792 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c11f10cc3190e49b0e7472988b188008c3906ad85b7179f3c916c925cef3eed6"} err="failed to get container status \"c11f10cc3190e49b0e7472988b188008c3906ad85b7179f3c916c925cef3eed6\": rpc error: code = NotFound desc = could not find container \"c11f10cc3190e49b0e7472988b188008c3906ad85b7179f3c916c925cef3eed6\": container with ID starting with c11f10cc3190e49b0e7472988b188008c3906ad85b7179f3c916c925cef3eed6 not found: ID does not exist" Jun 09 20:59:35.516503 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.516488 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 20:59:35.519025 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.519006 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 20:59:35.522608 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.522588 2557 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10d61c5a-3e40-4978-8270-9f75aa722147-tls-assets\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:35.522721 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.522610 2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:35.522721 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.522621 2557 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10d61c5a-3e40-4978-8270-9f75aa722147-config-out\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:35.522721 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.522631 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:35.522721 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.522640 2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:35.522721 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.522649 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:35.522721 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.522658 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:35.522721 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.522666 2557 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-kube-rbac-proxy\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:35.522721 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.522675 2557 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d61c5a-3e40-4978-8270-9f75aa722147-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:35.522721 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.522686 2557 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-config\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:35.522721 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.522698 2557 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-metrics-client-certs\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:35.522721 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.522709 2557 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-web-config\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:35.522721 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.522722 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/10d61c5a-3e40-4978-8270-9f75aa722147-prometheus-k8s-db\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:35.523193 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.522735 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqnkx\" (UniqueName: \"kubernetes.io/projected/10d61c5a-3e40-4978-8270-9f75aa722147-kube-api-access-rqnkx\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:35.523193 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.522749 2557 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:35.523193 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.522761 2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:35.523193 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.522773 2557 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/10d61c5a-3e40-4978-8270-9f75aa722147-secret-grpc-tls\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:35.523306 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.523264 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 20:59:35.623708 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.623660 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-web-config\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.623708 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.623707 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.623914 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.623738 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.623914 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.623764 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.623914 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.623797 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.623914 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.623823 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.623914 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.623869 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.624064 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.623919 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.624064 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.623946 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.624064 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.623963 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.624064 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.623980 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.624064 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.624020 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.624064 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.624036 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-config-out\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.624064 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.624049 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zznhw\" (UniqueName: \"kubernetes.io/projected/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-kube-api-access-zznhw\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.624256 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.624067 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.624256 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.624109 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-config\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.624256 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.624129 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.624256 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.624161 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.624256 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.624178 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.624256 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.624199 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.724601 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.724559 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.724789 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.724609 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-config-out\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.724789 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.724723 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zznhw\" (UniqueName: \"kubernetes.io/projected/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-kube-api-access-zznhw\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.724789 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.724762 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.724959 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.724798 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-config\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.724959 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.724830 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.724959 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.724871 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.724959 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.724896 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.724959 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.724937 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.725201 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.724964 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-web-config\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.725201 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.724989 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.725201 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.725012 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.725201 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.725037 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.725201 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.725067 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.725201 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.725104 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.725201 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.725138 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.725201 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.725168 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.725766 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.725213 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.725766 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.725242 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.725766 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.725272 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.725766 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.725679 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.726502 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.726474 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.727224 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.727193 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-config-out\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.727885 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.727862 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.729732 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.728187 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.729732 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.728310 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.729732 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.728330 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.729732 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.728436 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.729732 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.728598 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.729732 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.729038 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.729732 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.729216 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.729732 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.729569 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.730149 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.730020 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-web-config\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.730149 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.730046 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.730534 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.730505 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.730634 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.730549 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-config\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.730688 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.730635 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.730746 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.730725 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.730970 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.730919 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.732573 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.732554 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zznhw\" (UniqueName: \"kubernetes.io/projected/a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6-kube-api-access-zznhw\") pod \"prometheus-k8s-0\" (UID: \"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.821426 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.821361 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:35.965803 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:35.965777 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 20:59:35.968248 ip-10-0-137-98 kubenswrapper[2557]: W0609 20:59:35.968218 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda99ab79b_eb1f_4c6b_a623_8fbbcaabe6a6.slice/crio-a8b73fafdee26b0f0b64e05538bfdceba5261300d2bc553f4216dddc7aa38f60 WatchSource:0}: Error finding container a8b73fafdee26b0f0b64e05538bfdceba5261300d2bc553f4216dddc7aa38f60: Status 404 returned error can't find the container with id a8b73fafdee26b0f0b64e05538bfdceba5261300d2bc553f4216dddc7aa38f60 Jun 09 20:59:36.190546 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:36.190505 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10d61c5a-3e40-4978-8270-9f75aa722147" path="/var/lib/kubelet/pods/10d61c5a-3e40-4978-8270-9f75aa722147/volumes" Jun 09 20:59:36.458196 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:36.458163 2557 generic.go:356] "Generic (PLEG): container finished" podID="a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6" containerID="eb3de22a0ba72d9e4c224604b5f45cc7241f24d7af5f00a3784b5ff0b0ab86a7" exitCode=0 Jun 09 20:59:36.458628 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:36.458231 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6","Type":"ContainerDied","Data":"eb3de22a0ba72d9e4c224604b5f45cc7241f24d7af5f00a3784b5ff0b0ab86a7"} Jun 09 20:59:36.458628 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:36.458309 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6","Type":"ContainerStarted","Data":"a8b73fafdee26b0f0b64e05538bfdceba5261300d2bc553f4216dddc7aa38f60"} Jun 09 20:59:37.465278 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:37.465242 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6","Type":"ContainerStarted","Data":"7122e9e5b6370b1dded8e014f780a7e6371a1f4c877c8105158edc903703b0a9"} Jun 09 20:59:37.465672 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:37.465310 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6","Type":"ContainerStarted","Data":"6a27e38185f73b3763ad7ac65f511fecb94265f006b6e013aef3d051a157795d"} Jun 09 20:59:37.465672 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:37.465365 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6","Type":"ContainerStarted","Data":"cc00c30d34f7062a95ecf202f9a3f9743e9da818ff912b4930c97b1abdafb415"} Jun 09 20:59:37.465672 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:37.465424 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6","Type":"ContainerStarted","Data":"6ab70f125dbeca3c734cadd66bff4ced09248279b59be2933c976b3bd953bcab"} Jun 09 20:59:37.465672 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:37.465449 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6","Type":"ContainerStarted","Data":"1a29ecf5e3030ba21953bdd493f75ef21a8e2ed2619e404bc5a4afb318014f3a"} Jun 09 20:59:37.465672 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:37.465474 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6","Type":"ContainerStarted","Data":"ed0773a059b1774247c7113c4a283255fe9b96381a45d955b451474f5ce7534b"} Jun 09 20:59:37.494171 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:37.494101 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.474547803 podStartE2EDuration="2.494083001s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.535198ms" isStatefulPod=false podCreationTimestamp="2026-06-09 20:59:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:59:37.492877114 +0000 UTC m=+329.828566319" watchObservedRunningTime="2026-06-09 20:59:37.494083001 +0000 UTC m=+329.829772388" Jun 09 20:59:40.822028 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:40.821986 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 20:59:55.028744 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.028699 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" podUID="3c5209e7-8425-499a-8987-9d9377addd60" containerName="registry" containerID="cri-o://289a49261eab1d5a47509bb4c7aec0747038a5e613ded785052c85b6f03dbaf4" gracePeriod=30 Jun 09 20:59:55.288701 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.288580 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:59:55.404077 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.404029 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3c5209e7-8425-499a-8987-9d9377addd60-image-registry-private-configuration\") pod \"3c5209e7-8425-499a-8987-9d9377addd60\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " Jun 09 20:59:55.404262 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.404093 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls\") pod \"3c5209e7-8425-499a-8987-9d9377addd60\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " Jun 09 20:59:55.404262 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.404117 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3c5209e7-8425-499a-8987-9d9377addd60-installation-pull-secrets\") pod \"3c5209e7-8425-499a-8987-9d9377addd60\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " Jun 09 20:59:55.404262 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.404168 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3c5209e7-8425-499a-8987-9d9377addd60-registry-certificates\") pod \"3c5209e7-8425-499a-8987-9d9377addd60\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " Jun 09 20:59:55.404262 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.404215 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-bound-sa-token\") pod \"3c5209e7-8425-499a-8987-9d9377addd60\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " Jun 09 20:59:55.404262 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.404247 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzrqp\" (UniqueName: \"kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-kube-api-access-mzrqp\") pod \"3c5209e7-8425-499a-8987-9d9377addd60\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " Jun 09 20:59:55.404580 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.404291 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c5209e7-8425-499a-8987-9d9377addd60-trusted-ca\") pod \"3c5209e7-8425-499a-8987-9d9377addd60\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " Jun 09 20:59:55.404580 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.404337 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3c5209e7-8425-499a-8987-9d9377addd60-ca-trust-extracted\") pod \"3c5209e7-8425-499a-8987-9d9377addd60\" (UID: \"3c5209e7-8425-499a-8987-9d9377addd60\") " Jun 09 20:59:55.404704 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.404648 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c5209e7-8425-499a-8987-9d9377addd60-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3c5209e7-8425-499a-8987-9d9377addd60" (UID: "3c5209e7-8425-499a-8987-9d9377addd60"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 20:59:55.405185 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.405143 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c5209e7-8425-499a-8987-9d9377addd60-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3c5209e7-8425-499a-8987-9d9377addd60" (UID: "3c5209e7-8425-499a-8987-9d9377addd60"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 20:59:55.406816 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.406785 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3c5209e7-8425-499a-8987-9d9377addd60" (UID: "3c5209e7-8425-499a-8987-9d9377addd60"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 20:59:55.406969 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.406943 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c5209e7-8425-499a-8987-9d9377addd60-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3c5209e7-8425-499a-8987-9d9377addd60" (UID: "3c5209e7-8425-499a-8987-9d9377addd60"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 20:59:55.406969 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.406948 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3c5209e7-8425-499a-8987-9d9377addd60" (UID: "3c5209e7-8425-499a-8987-9d9377addd60"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 20:59:55.407130 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.407109 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c5209e7-8425-499a-8987-9d9377addd60-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3c5209e7-8425-499a-8987-9d9377addd60" (UID: "3c5209e7-8425-499a-8987-9d9377addd60"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 20:59:55.407187 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.407159 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-kube-api-access-mzrqp" (OuterVolumeSpecName: "kube-api-access-mzrqp") pod "3c5209e7-8425-499a-8987-9d9377addd60" (UID: "3c5209e7-8425-499a-8987-9d9377addd60"). InnerVolumeSpecName "kube-api-access-mzrqp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 20:59:55.413441 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.413369 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c5209e7-8425-499a-8987-9d9377addd60-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3c5209e7-8425-499a-8987-9d9377addd60" (UID: "3c5209e7-8425-499a-8987-9d9377addd60"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 20:59:55.505269 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.505236 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzrqp\" (UniqueName: \"kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-kube-api-access-mzrqp\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:55.505269 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.505266 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c5209e7-8425-499a-8987-9d9377addd60-trusted-ca\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:55.505269 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.505275 2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3c5209e7-8425-499a-8987-9d9377addd60-ca-trust-extracted\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:55.505515 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.505287 2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3c5209e7-8425-499a-8987-9d9377addd60-image-registry-private-configuration\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:55.505515 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.505297 2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-registry-tls\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:55.505515 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.505306 2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3c5209e7-8425-499a-8987-9d9377addd60-installation-pull-secrets\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:55.505515 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.505313 2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3c5209e7-8425-499a-8987-9d9377addd60-registry-certificates\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:55.505515 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.505322 2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c5209e7-8425-499a-8987-9d9377addd60-bound-sa-token\") on node \"ip-10-0-137-98.ec2.internal\" DevicePath \"\"" Jun 09 20:59:55.542151 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.542035 2557 generic.go:356] "Generic (PLEG): container finished" podID="3c5209e7-8425-499a-8987-9d9377addd60" containerID="289a49261eab1d5a47509bb4c7aec0747038a5e613ded785052c85b6f03dbaf4" exitCode=0 Jun 09 20:59:55.542151 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.542082 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" Jun 09 20:59:55.542360 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.542119 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" event={"ID":"3c5209e7-8425-499a-8987-9d9377addd60","Type":"ContainerDied","Data":"289a49261eab1d5a47509bb4c7aec0747038a5e613ded785052c85b6f03dbaf4"} Jun 09 20:59:55.542360 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.542206 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" event={"ID":"3c5209e7-8425-499a-8987-9d9377addd60","Type":"ContainerDied","Data":"f018f37b0a2b6a07d88716a61d36fdaf478753909c11a19193ea3d28d79c9997"} Jun 09 20:59:55.542360 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.542236 2557 scope.go:117] "RemoveContainer" containerID="289a49261eab1d5a47509bb4c7aec0747038a5e613ded785052c85b6f03dbaf4" Jun 09 20:59:55.551219 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.551197 2557 scope.go:117] "RemoveContainer" containerID="289a49261eab1d5a47509bb4c7aec0747038a5e613ded785052c85b6f03dbaf4" Jun 09 20:59:55.551529 ip-10-0-137-98 kubenswrapper[2557]: E0609 20:59:55.551507 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"289a49261eab1d5a47509bb4c7aec0747038a5e613ded785052c85b6f03dbaf4\": container with ID starting with 289a49261eab1d5a47509bb4c7aec0747038a5e613ded785052c85b6f03dbaf4 not found: ID does not exist" containerID="289a49261eab1d5a47509bb4c7aec0747038a5e613ded785052c85b6f03dbaf4" Jun 09 20:59:55.551590 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.551538 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"289a49261eab1d5a47509bb4c7aec0747038a5e613ded785052c85b6f03dbaf4"} err="failed to get container status \"289a49261eab1d5a47509bb4c7aec0747038a5e613ded785052c85b6f03dbaf4\": rpc error: code = NotFound desc = could not find container \"289a49261eab1d5a47509bb4c7aec0747038a5e613ded785052c85b6f03dbaf4\": container with ID starting with 289a49261eab1d5a47509bb4c7aec0747038a5e613ded785052c85b6f03dbaf4 not found: ID does not exist" Jun 09 20:59:55.561716 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.561687 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bf67c8ff7-crdj6"] Jun 09 20:59:55.566674 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:55.566651 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5bf67c8ff7-crdj6"] Jun 09 20:59:56.190253 ip-10-0-137-98 kubenswrapper[2557]: I0609 20:59:56.190220 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c5209e7-8425-499a-8987-9d9377addd60" path="/var/lib/kubelet/pods/3c5209e7-8425-499a-8987-9d9377addd60/volumes" Jun 09 21:00:00.251201 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:00:00.251159 2557 patch_prober.go:28] interesting pod/image-registry-5bf67c8ff7-crdj6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.132.0.6:5000/healthz\": context deadline exceeded" start-of-body= Jun 09 21:00:00.251693 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:00:00.251224 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5bf67c8ff7-crdj6" podUID="3c5209e7-8425-499a-8987-9d9377addd60" containerName="registry" probeResult="failure" output="Get \"https://10.132.0.6:5000/healthz\": context deadline exceeded" Jun 09 21:00:35.821744 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:00:35.821687 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:00:35.838608 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:00:35.838580 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:00:36.744572 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:00:36.744541 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 21:01:48.947107 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:48.947077 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2chl4_2b57eb2c-1312-4faa-9ce2-ad5890cf41ee/global-pull-secret-syncer/0.log" Jun 09 21:01:48.951276 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:48.951258 2557 ???:1] "http: TLS handshake error from 10.0.128.117:37514: EOF" Jun 09 21:01:49.171150 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:49.171121 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-p7x4f_a5e543bf-3df6-477f-8da3-262352b84b30/konnectivity-agent/0.log" Jun 09 21:01:49.275345 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:49.275260 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-98.ec2.internal_5c7806303e812afd18dcb7a11da25a9c/haproxy/0.log" Jun 09 21:01:52.182970 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:52.182928 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ad933abe-69dc-4bd7-aec1-a74811e4cb08/alertmanager/0.log" Jun 09 21:01:52.228511 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:52.228483 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ad933abe-69dc-4bd7-aec1-a74811e4cb08/config-reloader/0.log" Jun 09 21:01:52.254200 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:52.254168 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ad933abe-69dc-4bd7-aec1-a74811e4cb08/kube-rbac-proxy-web/0.log" Jun 09 21:01:52.284629 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:52.284546 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ad933abe-69dc-4bd7-aec1-a74811e4cb08/kube-rbac-proxy/0.log" Jun 09 21:01:52.316237 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:52.316214 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ad933abe-69dc-4bd7-aec1-a74811e4cb08/kube-rbac-proxy-metric/0.log" Jun 09 21:01:52.343733 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:52.343700 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ad933abe-69dc-4bd7-aec1-a74811e4cb08/prom-label-proxy/0.log" Jun 09 21:01:52.371612 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:52.371562 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ad933abe-69dc-4bd7-aec1-a74811e4cb08/init-config-reloader/0.log" Jun 09 21:01:52.615207 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:52.615128 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6927g_e22b6d64-f9c2-4387-9534-92af9d1654e8/node-exporter/0.log" Jun 09 21:01:52.641182 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:52.641155 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6927g_e22b6d64-f9c2-4387-9534-92af9d1654e8/kube-rbac-proxy/0.log" Jun 09 21:01:52.665827 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:52.665807 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6927g_e22b6d64-f9c2-4387-9534-92af9d1654e8/init-textfile/0.log" Jun 09 21:01:52.859527 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:52.859497 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-6xbpf_fad38352-fac6-4a9f-9ba0-088e5a9c7569/kube-rbac-proxy-main/0.log" Jun 09 21:01:52.887682 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:52.887614 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-6xbpf_fad38352-fac6-4a9f-9ba0-088e5a9c7569/kube-rbac-proxy-self/0.log" Jun 09 21:01:52.917559 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:52.917530 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-6xbpf_fad38352-fac6-4a9f-9ba0-088e5a9c7569/openshift-state-metrics/0.log" Jun 09 21:01:52.965644 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:52.965616 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6/prometheus/0.log" Jun 09 21:01:52.993616 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:52.993590 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6/config-reloader/0.log" Jun 09 21:01:53.030442 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:53.030417 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6/thanos-sidecar/0.log" Jun 09 21:01:53.053655 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:53.053626 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6/kube-rbac-proxy-web/0.log" Jun 09 21:01:53.074985 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:53.074953 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6/kube-rbac-proxy/0.log" Jun 09 21:01:53.104120 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:53.104083 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6/kube-rbac-proxy-thanos/0.log" Jun 09 21:01:53.130355 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:53.130327 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a99ab79b-eb1f-4c6b-a623-8fbbcaabe6a6/init-config-reloader/0.log" Jun 09 21:01:53.157216 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:53.157127 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-rrl6m_b86458c7-8635-4327-afa3-7e361d17d87e/prometheus-operator/0.log" Jun 09 21:01:53.177435 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:53.177406 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-rrl6m_b86458c7-8635-4327-afa3-7e361d17d87e/kube-rbac-proxy/0.log" Jun 09 21:01:53.208300 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:53.208264 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-q62l2_3dd9dd28-71b3-4dae-86db-cb13d03308f4/prometheus-operator-admission-webhook/0.log" Jun 09 21:01:54.643814 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:54.643781 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-znt5k_5080444f-d21e-402b-bd46-e0b5c24a6baf/networking-console-plugin/0.log" Jun 09 21:01:55.163543 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:55.163473 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rht6r_16863009-e8d0-462f-a57e-3c4e82142141/console-operator/2.log" Jun 09 21:01:55.168282 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:55.168262 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rht6r_16863009-e8d0-462f-a57e-3c4e82142141/console-operator/3.log" Jun 09 21:01:56.083956 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:56.083913 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-cwzdg_83ffa3f7-8b6a-4e90-b801-171b0e5e5154/volume-data-source-validator/0.log" Jun 09 21:01:56.796552 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:56.796511 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xnfg8/perf-node-gather-daemonset-7r6mn"] Jun 09 21:01:56.796903 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:56.796880 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c5209e7-8425-499a-8987-9d9377addd60" containerName="registry" Jun 09 21:01:56.796954 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:56.796904 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c5209e7-8425-499a-8987-9d9377addd60" containerName="registry" Jun 09 21:01:56.796988 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:56.796972 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c5209e7-8425-499a-8987-9d9377addd60" containerName="registry" Jun 09 21:01:56.799822 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:56.799807 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xnfg8/perf-node-gather-daemonset-7r6mn" Jun 09 21:01:56.801803 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:56.801779 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xnfg8\"/\"kube-root-ca.crt\"" Jun 09 21:01:56.802350 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:56.802325 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xnfg8\"/\"default-dockercfg-6n6qj\"" Jun 09 21:01:56.802350 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:56.802337 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xnfg8\"/\"openshift-service-ca.crt\"" Jun 09 21:01:56.807693 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:56.807669 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xnfg8/perf-node-gather-daemonset-7r6mn"] Jun 09 21:01:56.877326 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:56.877295 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pnvwt_f27bc7c7-a410-4ec4-9b29-c9f1160d2271/dns/0.log" Jun 09 21:01:56.898961 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:56.898931 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pnvwt_f27bc7c7-a410-4ec4-9b29-c9f1160d2271/kube-rbac-proxy/0.log" Jun 09 21:01:56.943236 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:56.943199 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd-lib-modules\") pod \"perf-node-gather-daemonset-7r6mn\" (UID: \"8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd\") " pod="openshift-must-gather-xnfg8/perf-node-gather-daemonset-7r6mn" Jun 09 21:01:56.943236 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:56.943245 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwqb2\" (UniqueName: \"kubernetes.io/projected/8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd-kube-api-access-jwqb2\") pod \"perf-node-gather-daemonset-7r6mn\" (UID: \"8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd\") " pod="openshift-must-gather-xnfg8/perf-node-gather-daemonset-7r6mn" Jun 09 21:01:56.943544 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:56.943271 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd-podres\") pod \"perf-node-gather-daemonset-7r6mn\" (UID: \"8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd\") " pod="openshift-must-gather-xnfg8/perf-node-gather-daemonset-7r6mn" Jun 09 21:01:56.943544 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:56.943363 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd-proc\") pod \"perf-node-gather-daemonset-7r6mn\" (UID: \"8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd\") " pod="openshift-must-gather-xnfg8/perf-node-gather-daemonset-7r6mn" Jun 09 21:01:56.943544 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:56.943441 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd-sys\") pod \"perf-node-gather-daemonset-7r6mn\" (UID: \"8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd\") " pod="openshift-must-gather-xnfg8/perf-node-gather-daemonset-7r6mn" Jun 09 21:01:57.005095 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:57.005063 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jzlgv_48ea32f0-3aed-49d4-bd34-2c0bc6a8b251/dns-node-resolver/0.log" Jun 09 21:01:57.044673 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:57.044640 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwqb2\" (UniqueName: \"kubernetes.io/projected/8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd-kube-api-access-jwqb2\") pod \"perf-node-gather-daemonset-7r6mn\" (UID: \"8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd\") " pod="openshift-must-gather-xnfg8/perf-node-gather-daemonset-7r6mn" Jun 09 21:01:57.044859 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:57.044680 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd-podres\") pod \"perf-node-gather-daemonset-7r6mn\" (UID: \"8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd\") " pod="openshift-must-gather-xnfg8/perf-node-gather-daemonset-7r6mn" Jun 09 21:01:57.044859 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:57.044710 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd-proc\") pod \"perf-node-gather-daemonset-7r6mn\" (UID: \"8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd\") " pod="openshift-must-gather-xnfg8/perf-node-gather-daemonset-7r6mn" Jun 09 21:01:57.044859 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:57.044736 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd-sys\") pod \"perf-node-gather-daemonset-7r6mn\" (UID: \"8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd\") " pod="openshift-must-gather-xnfg8/perf-node-gather-daemonset-7r6mn" Jun 09 21:01:57.044859 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:57.044818 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd-lib-modules\") pod \"perf-node-gather-daemonset-7r6mn\" (UID: \"8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd\") " pod="openshift-must-gather-xnfg8/perf-node-gather-daemonset-7r6mn" Jun 09 21:01:57.044859 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:57.044837 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd-podres\") pod \"perf-node-gather-daemonset-7r6mn\" (UID: \"8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd\") " pod="openshift-must-gather-xnfg8/perf-node-gather-daemonset-7r6mn" Jun 09 21:01:57.044859 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:57.044852 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd-proc\") pod \"perf-node-gather-daemonset-7r6mn\" (UID: \"8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd\") " pod="openshift-must-gather-xnfg8/perf-node-gather-daemonset-7r6mn" Jun 09 21:01:57.045085 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:57.044929 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd-sys\") pod \"perf-node-gather-daemonset-7r6mn\" (UID: \"8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd\") " pod="openshift-must-gather-xnfg8/perf-node-gather-daemonset-7r6mn" Jun 09 21:01:57.045085 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:57.044973 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd-lib-modules\") pod \"perf-node-gather-daemonset-7r6mn\" (UID: \"8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd\") " pod="openshift-must-gather-xnfg8/perf-node-gather-daemonset-7r6mn" Jun 09 21:01:57.053253 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:57.053184 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwqb2\" (UniqueName: \"kubernetes.io/projected/8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd-kube-api-access-jwqb2\") pod \"perf-node-gather-daemonset-7r6mn\" (UID: \"8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd\") " pod="openshift-must-gather-xnfg8/perf-node-gather-daemonset-7r6mn" Jun 09 21:01:57.110493 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:57.110450 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xnfg8/perf-node-gather-daemonset-7r6mn" Jun 09 21:01:57.244680 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:57.244647 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xnfg8/perf-node-gather-daemonset-7r6mn"] Jun 09 21:01:57.249023 ip-10-0-137-98 kubenswrapper[2557]: W0609 21:01:57.248988 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8a6eef63_6ae8_44a5_93e1_8f3fbd76f8cd.slice/crio-c2fce1229043501781662431ac5e1445265fc2e55df643946e426bb08d7a8470 WatchSource:0}: Error finding container c2fce1229043501781662431ac5e1445265fc2e55df643946e426bb08d7a8470: Status 404 returned error can't find the container with id c2fce1229043501781662431ac5e1445265fc2e55df643946e426bb08d7a8470 Jun 09 21:01:57.399718 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:57.399694 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7dxwm_84c09f0a-64ef-41e7-b1ca-c16ae3eeb4f9/node-ca/0.log" Jun 09 21:01:58.049456 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:58.049413 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xnfg8/perf-node-gather-daemonset-7r6mn" event={"ID":"8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd","Type":"ContainerStarted","Data":"1fe99a69ee8d6c2d80495cd018d69391ec1968017f5f675232c9a32c6c2423a1"} Jun 09 21:01:58.049641 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:58.049480 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xnfg8/perf-node-gather-daemonset-7r6mn" event={"ID":"8a6eef63-6ae8-44a5-93e1-8f3fbd76f8cd","Type":"ContainerStarted","Data":"c2fce1229043501781662431ac5e1445265fc2e55df643946e426bb08d7a8470"} Jun 09 21:01:58.049641 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:58.049508 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xnfg8/perf-node-gather-daemonset-7r6mn" Jun 09 21:01:58.064989 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:58.064936 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xnfg8/perf-node-gather-daemonset-7r6mn" podStartSLOduration=2.064921795 podStartE2EDuration="2.064921795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 21:01:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:01:58.06353103 +0000 UTC m=+470.399220234" watchObservedRunningTime="2026-06-09 21:01:58.064921795 +0000 UTC m=+470.400610998" Jun 09 21:01:58.372616 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:58.372534 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vdjv9_24a48d8d-ec0f-4be8-9c45-791c56450da6/serve-healthcheck-canary/0.log" Jun 09 21:01:58.798037 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:58.798011 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-trd6h_eb084e3b-33da-4cbd-bb7f-510feafccb62/kube-rbac-proxy/0.log" Jun 09 21:01:58.816500 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:58.816470 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-trd6h_eb084e3b-33da-4cbd-bb7f-510feafccb62/exporter/0.log" Jun 09 21:01:58.834931 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:01:58.834902 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-trd6h_eb084e3b-33da-4cbd-bb7f-510feafccb62/extractor/0.log" Jun 09 21:02:03.201486 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:03.201453 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fgz4b_234cd6b9-9e32-4cf9-94c4-2bb0053ff04c/kube-multus-additional-cni-plugins/0.log" Jun 09 21:02:03.220907 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:03.220867 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fgz4b_234cd6b9-9e32-4cf9-94c4-2bb0053ff04c/egress-router-binary-copy/0.log" Jun 09 21:02:03.239071 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:03.239039 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fgz4b_234cd6b9-9e32-4cf9-94c4-2bb0053ff04c/cni-plugins/0.log" Jun 09 21:02:03.257286 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:03.257259 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fgz4b_234cd6b9-9e32-4cf9-94c4-2bb0053ff04c/bond-cni-plugin/0.log" Jun 09 21:02:03.276084 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:03.276052 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fgz4b_234cd6b9-9e32-4cf9-94c4-2bb0053ff04c/routeoverride-cni/0.log" Jun 09 21:02:03.295346 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:03.295309 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fgz4b_234cd6b9-9e32-4cf9-94c4-2bb0053ff04c/whereabouts-cni-bincopy/0.log" Jun 09 21:02:03.313660 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:03.313635 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fgz4b_234cd6b9-9e32-4cf9-94c4-2bb0053ff04c/whereabouts-cni/0.log" Jun 09 21:02:03.671789 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:03.671696 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pcpkv_b15205f0-3a84-48f4-ad29-fc648c18c930/kube-multus/0.log" Jun 09 21:02:03.690768 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:03.690735 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dwxkr_c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae/network-metrics-daemon/0.log" Jun 09 21:02:03.708570 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:03.708540 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dwxkr_c6334f3e-2887-4d3a-80b3-d5e5e1e0a3ae/kube-rbac-proxy/0.log" Jun 09 21:02:04.064336 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:04.064299 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xnfg8/perf-node-gather-daemonset-7r6mn" Jun 09 21:02:04.375306 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:04.375202 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l764_4010dd68-a50f-479f-a86f-2aecbc8e67e1/ovn-controller/0.log" Jun 09 21:02:04.391968 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:04.391941 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l764_4010dd68-a50f-479f-a86f-2aecbc8e67e1/ovn-acl-logging/1.log" Jun 09 21:02:04.392130 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:04.392017 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l764_4010dd68-a50f-479f-a86f-2aecbc8e67e1/ovn-acl-logging/0.log" Jun 09 21:02:04.409055 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:04.409030 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l764_4010dd68-a50f-479f-a86f-2aecbc8e67e1/kube-rbac-proxy-node/0.log" Jun 09 21:02:04.428216 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:04.428191 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l764_4010dd68-a50f-479f-a86f-2aecbc8e67e1/kube-rbac-proxy-ovn-metrics/0.log" Jun 09 21:02:04.443938 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:04.443918 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l764_4010dd68-a50f-479f-a86f-2aecbc8e67e1/northd/0.log" Jun 09 21:02:04.462560 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:04.462539 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l764_4010dd68-a50f-479f-a86f-2aecbc8e67e1/nbdb/0.log" Jun 09 21:02:04.480733 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:04.480714 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l764_4010dd68-a50f-479f-a86f-2aecbc8e67e1/sbdb/0.log" Jun 09 21:02:04.513354 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:04.513323 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l764_4010dd68-a50f-479f-a86f-2aecbc8e67e1/ovnkube-controller/0.log" Jun 09 21:02:05.869956 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:05.869919 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-dbd9cf844-dz7rq_fc03d9b9-3ff2-4120-9c48-1c926ca9bf9a/check-endpoints/0.log" Jun 09 21:02:05.943704 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:05.943677 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-ddvmc_c0a3351e-dc59-4816-87ea-7a918f8c03ab/network-check-target-container/0.log" Jun 09 21:02:06.721400 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:06.721349 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-6gdmg_6fb5611b-d203-40d5-9ec8-f34df2fde783/iptables-alerter/0.log" Jun 09 21:02:07.318877 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:07.318846 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-48922_3c52be6f-c3a2-4eae-b9c8-b5d3f3002170/tuned/0.log" Jun 09 21:02:08.791794 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:08.791760 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-854f8b96b6-9kr2d_09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c/cluster-samples-operator/0.log" Jun 09 21:02:08.806396 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:08.806339 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-854f8b96b6-9kr2d_09dc99e2-2c5b-4b3c-8a4c-77e77a65c63c/cluster-samples-operator-watch/0.log" Jun 09 21:02:09.617346 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:09.617313 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-6bc5ff68f5-tbw6z_407c0bf3-a878-482d-87dd-dc4c78cb7d71/service-ca-operator/1.log" Jun 09 21:02:09.618258 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:09.618234 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-6bc5ff68f5-tbw6z_407c0bf3-a878-482d-87dd-dc4c78cb7d71/service-ca-operator/0.log" Jun 09 21:02:09.887682 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:09.887605 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-7d74d578b8-cknzk_d36ad6a3-8964-4429-936e-fa7f06118f4f/service-ca-controller/0.log" Jun 09 21:02:10.266249 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:10.266220 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-bx82d_85c3f42d-8e0c-48fb-86fd-1f8706950ee3/csi-driver/0.log" Jun 09 21:02:10.285364 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:10.285312 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-bx82d_85c3f42d-8e0c-48fb-86fd-1f8706950ee3/csi-node-driver-registrar/0.log" Jun 09 21:02:10.304265 ip-10-0-137-98 kubenswrapper[2557]: I0609 21:02:10.304235 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-bx82d_85c3f42d-8e0c-48fb-86fd-1f8706950ee3/csi-liveness-probe/0.log"