Jun 03 00:48:49.198777 ip-10-0-134-48 systemd[1]: Starting Kubernetes Kubelet... Jun 03 00:48:49.563878 ip-10-0-134-48 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 00:48:49.563878 ip-10-0-134-48 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 00:48:49.563878 ip-10-0-134-48 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 00:48:49.563878 ip-10-0-134-48 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 00:48:49.563878 ip-10-0-134-48 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 00:48:49.565230 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.565139 2558 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 00:48:49.569697 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569681 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 00:48:49.569697 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569696 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 00:48:49.569697 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569700 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 00:48:49.569789 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569706 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 00:48:49.569789 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569711 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 00:48:49.569789 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569714 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 00:48:49.569789 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569717 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 00:48:49.569789 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569721 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 00:48:49.569789 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569724 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 00:48:49.569789 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569727 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 00:48:49.569789 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569730 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 00:48:49.569789 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569733 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 00:48:49.569789 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569735 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 00:48:49.569789 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569738 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 00:48:49.569789 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569741 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 00:48:49.569789 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569744 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 00:48:49.569789 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569747 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 00:48:49.569789 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569750 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 00:48:49.569789 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569752 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 00:48:49.569789 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569755 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 00:48:49.569789 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569758 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 00:48:49.569789 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569761 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 00:48:49.570259 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569764 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 00:48:49.570259 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569767 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 00:48:49.570259 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569769 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 00:48:49.570259 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569772 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 00:48:49.570259 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569774 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 00:48:49.570259 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569777 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 00:48:49.570259 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569779 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 00:48:49.570259 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569782 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 00:48:49.570259 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569784 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 03 00:48:49.570259 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569787 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 00:48:49.570259 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569789 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 00:48:49.570259 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569791 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 00:48:49.570259 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569794 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 00:48:49.570259 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569797 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 00:48:49.570259 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569802 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 00:48:49.570259 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569804 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 00:48:49.570259 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569807 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 00:48:49.570259 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569809 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 00:48:49.570259 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569812 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 00:48:49.570259 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569814 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 00:48:49.570808 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569817 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 00:48:49.570808 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569820 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 00:48:49.570808 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569822 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 00:48:49.570808 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569824 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 00:48:49.570808 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569827 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 00:48:49.570808 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569829 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 00:48:49.570808 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569832 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 00:48:49.570808 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569834 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 00:48:49.570808 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569837 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 00:48:49.570808 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569840 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 00:48:49.570808 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569842 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 00:48:49.570808 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569844 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 00:48:49.570808 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569847 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 00:48:49.570808 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569850 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 00:48:49.570808 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569853 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 00:48:49.570808 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569856 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 00:48:49.570808 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569859 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 00:48:49.570808 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569861 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 00:48:49.570808 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569863 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 00:48:49.570808 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569866 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 00:48:49.571303 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569869 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 00:48:49.571303 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569871 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 00:48:49.571303 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569873 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 00:48:49.571303 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569878 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 00:48:49.571303 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569880 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 00:48:49.571303 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569883 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 00:48:49.571303 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569886 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 00:48:49.571303 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569893 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 00:48:49.571303 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569896 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 00:48:49.571303 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569899 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 00:48:49.571303 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569901 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 00:48:49.571303 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569904 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 00:48:49.571303 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569906 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 00:48:49.571303 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569909 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 00:48:49.571303 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569911 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 00:48:49.571303 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569914 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 00:48:49.571303 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569916 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 00:48:49.571303 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569919 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 00:48:49.571303 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569922 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 00:48:49.571770 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569926 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 00:48:49.571770 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569929 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 00:48:49.571770 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569932 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 00:48:49.571770 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569935 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 00:48:49.571770 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.569937 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 00:48:49.571904 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571891 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 00:48:49.571904 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571902 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 00:48:49.571960 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571906 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 00:48:49.571960 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571909 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 03 00:48:49.571960 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571912 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 00:48:49.571960 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571916 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 00:48:49.571960 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571918 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 00:48:49.571960 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571921 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 00:48:49.571960 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571924 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 00:48:49.571960 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571926 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 00:48:49.571960 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571929 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 00:48:49.571960 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571931 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 00:48:49.571960 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571934 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 00:48:49.571960 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571937 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 00:48:49.571960 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571940 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 00:48:49.571960 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571944 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 00:48:49.571960 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571948 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 00:48:49.571960 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571951 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 00:48:49.571960 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571953 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 00:48:49.571960 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571956 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 00:48:49.571960 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571958 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 00:48:49.572494 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571961 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 00:48:49.572494 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571963 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 00:48:49.572494 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571966 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 00:48:49.572494 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571969 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 00:48:49.572494 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571972 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 00:48:49.572494 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571974 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 00:48:49.572494 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571977 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 00:48:49.572494 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571980 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 00:48:49.572494 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571982 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 00:48:49.572494 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571984 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 00:48:49.572494 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571987 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 00:48:49.572494 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571990 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 00:48:49.572494 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571992 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 00:48:49.572494 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571995 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 00:48:49.572494 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.571998 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 00:48:49.572494 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572000 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 00:48:49.572494 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572003 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 00:48:49.572494 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572005 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 00:48:49.572494 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572008 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 00:48:49.572494 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572010 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 00:48:49.573016 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572013 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 00:48:49.573016 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572015 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 00:48:49.573016 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572018 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 00:48:49.573016 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572020 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 00:48:49.573016 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572022 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 00:48:49.573016 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572025 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 00:48:49.573016 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572028 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 00:48:49.573016 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572031 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 00:48:49.573016 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572034 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 00:48:49.573016 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572036 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 00:48:49.573016 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572038 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 00:48:49.573016 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572041 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 00:48:49.573016 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572043 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 00:48:49.573016 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572047 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 00:48:49.573016 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572049 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 00:48:49.573016 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572052 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 00:48:49.573016 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572054 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 00:48:49.573016 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572057 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 00:48:49.573016 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572060 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 00:48:49.573016 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572062 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 00:48:49.573540 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572065 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 00:48:49.573540 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572067 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 00:48:49.573540 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572069 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 00:48:49.573540 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572072 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 00:48:49.573540 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572074 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 00:48:49.573540 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572077 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 00:48:49.573540 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572080 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 00:48:49.573540 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572082 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 00:48:49.573540 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572084 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 00:48:49.573540 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572087 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 00:48:49.573540 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572089 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 00:48:49.573540 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572092 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 00:48:49.573540 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572094 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 00:48:49.573540 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572097 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 00:48:49.573540 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572099 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 00:48:49.573540 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572103 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 00:48:49.573540 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572107 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 00:48:49.573540 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572110 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 00:48:49.573540 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572113 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 00:48:49.573540 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572116 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 00:48:49.574036 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572119 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 00:48:49.574036 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572123 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 00:48:49.574036 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572126 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 00:48:49.574036 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572128 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 00:48:49.574036 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572131 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 00:48:49.574036 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572198 2558 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 00:48:49.574036 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572206 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 00:48:49.574036 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572212 2558 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 00:48:49.574036 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572220 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 00:48:49.574036 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572227 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 00:48:49.574036 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572232 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 00:48:49.574036 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572238 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 00:48:49.574036 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572243 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 00:48:49.574036 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572247 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 00:48:49.574036 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572250 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 00:48:49.574036 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572253 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 00:48:49.574036 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572257 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 00:48:49.574036 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572260 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 00:48:49.574036 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572263 2558 flags.go:64] FLAG: --cgroup-root="" Jun 03 00:48:49.574036 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572266 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 00:48:49.574036 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572269 2558 flags.go:64] FLAG: --client-ca-file="" Jun 03 00:48:49.574036 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572272 2558 flags.go:64] FLAG: --cloud-config="" Jun 03 00:48:49.574036 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572275 2558 flags.go:64] FLAG: --cloud-provider="external" Jun 03 00:48:49.574606 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572278 2558 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 00:48:49.574606 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572282 2558 flags.go:64] FLAG: --cluster-domain="" Jun 03 00:48:49.574606 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572285 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 00:48:49.574606 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572288 2558 flags.go:64] FLAG: --config-dir="" Jun 03 00:48:49.574606 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572292 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 00:48:49.574606 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572295 2558 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 00:48:49.574606 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572300 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 00:48:49.574606 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572304 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 00:48:49.574606 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572307 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 00:48:49.574606 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572310 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 00:48:49.574606 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572314 2558 flags.go:64] FLAG: --contention-profiling="false" Jun 03 00:48:49.574606 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572317 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 00:48:49.574606 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572320 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 00:48:49.574606 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572323 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 00:48:49.574606 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572327 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 00:48:49.574606 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572331 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 00:48:49.574606 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572335 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 00:48:49.574606 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572338 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 00:48:49.574606 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572341 2558 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 00:48:49.574606 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572344 2558 flags.go:64] FLAG: --enable-server="true" Jun 03 00:48:49.574606 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572347 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 00:48:49.574606 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572350 2558 flags.go:64] FLAG: --event-burst="100" Jun 03 00:48:49.574606 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572354 2558 flags.go:64] FLAG: --event-qps="50" Jun 03 00:48:49.574606 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572356 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 00:48:49.574606 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572360 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 00:48:49.575201 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572363 2558 flags.go:64] FLAG: --eviction-hard="" Jun 03 00:48:49.575201 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572367 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 00:48:49.575201 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572370 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 00:48:49.575201 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572373 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 00:48:49.575201 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572376 2558 flags.go:64] FLAG: --eviction-soft="" Jun 03 00:48:49.575201 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572378 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 00:48:49.575201 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572382 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 00:48:49.575201 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572385 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 00:48:49.575201 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572388 2558 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 00:48:49.575201 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572390 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 00:48:49.575201 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572393 2558 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 00:48:49.575201 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572396 2558 flags.go:64] FLAG: --feature-gates="" Jun 03 00:48:49.575201 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572400 2558 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 00:48:49.575201 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572403 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 00:48:49.575201 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572407 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 00:48:49.575201 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572410 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 00:48:49.575201 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572413 2558 flags.go:64] FLAG: --healthz-port="10248" Jun 03 00:48:49.575201 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572416 2558 flags.go:64] FLAG: --help="false" Jun 03 00:48:49.575201 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572419 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-134-48.ec2.internal" Jun 03 00:48:49.575201 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572423 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 00:48:49.575201 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572425 2558 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 00:48:49.575201 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572429 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 00:48:49.575201 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572432 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 00:48:49.575201 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572436 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 00:48:49.575839 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572439 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 00:48:49.575839 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572442 2558 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 00:48:49.575839 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572445 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 00:48:49.575839 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572448 2558 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 00:48:49.575839 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572450 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 00:48:49.575839 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572454 2558 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 00:48:49.575839 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572456 2558 flags.go:64] FLAG: --kube-reserved="" Jun 03 00:48:49.575839 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572459 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 00:48:49.575839 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572462 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 00:48:49.575839 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572465 2558 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 00:48:49.575839 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572468 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 00:48:49.575839 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572471 2558 flags.go:64] FLAG: --lock-file="" Jun 03 00:48:49.575839 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572473 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 00:48:49.575839 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572476 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 00:48:49.575839 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572479 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 00:48:49.575839 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572484 2558 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 00:48:49.575839 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572487 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 00:48:49.575839 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572490 2558 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 00:48:49.575839 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572493 2558 flags.go:64] FLAG: --logging-format="text" Jun 03 00:48:49.575839 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572495 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 00:48:49.575839 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572499 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 00:48:49.575839 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572502 2558 flags.go:64] FLAG: --manifest-url="" Jun 03 00:48:49.575839 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572505 2558 flags.go:64] FLAG: --manifest-url-header="" Jun 03 00:48:49.575839 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572510 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 00:48:49.575839 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572513 2558 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 00:48:49.576451 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572529 2558 flags.go:64] FLAG: --max-pods="110" Jun 03 00:48:49.576451 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572532 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 00:48:49.576451 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572536 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 00:48:49.576451 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572539 2558 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 00:48:49.576451 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572542 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 00:48:49.576451 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572545 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 00:48:49.576451 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572548 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 00:48:49.576451 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572551 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 00:48:49.576451 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572559 2558 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 00:48:49.576451 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572562 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 00:48:49.576451 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572565 2558 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 00:48:49.576451 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572568 2558 flags.go:64] FLAG: --pod-cidr="" Jun 03 00:48:49.576451 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572571 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 00:48:49.576451 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572577 2558 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 00:48:49.576451 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572580 2558 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 00:48:49.576451 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572583 2558 flags.go:64] FLAG: --pods-per-core="0" Jun 03 00:48:49.576451 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572586 2558 flags.go:64] FLAG: --port="10250" Jun 03 00:48:49.576451 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572589 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 00:48:49.576451 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572592 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c417f1a163d19e82" Jun 03 00:48:49.576451 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572595 2558 flags.go:64] FLAG: --qos-reserved="" Jun 03 00:48:49.576451 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572598 2558 flags.go:64] FLAG: --read-only-port="10255" Jun 03 00:48:49.576451 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572602 2558 flags.go:64] FLAG: --register-node="true" Jun 03 00:48:49.576451 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572604 2558 flags.go:64] FLAG: --register-schedulable="true" Jun 03 00:48:49.576451 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572607 2558 flags.go:64] FLAG: --register-with-taints="" Jun 03 00:48:49.577041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572611 2558 flags.go:64] FLAG: --registry-burst="10" Jun 03 00:48:49.577041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572613 2558 flags.go:64] FLAG: --registry-qps="5" Jun 03 00:48:49.577041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572616 2558 flags.go:64] FLAG: --reserved-cpus="" Jun 03 00:48:49.577041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572619 2558 flags.go:64] FLAG: --reserved-memory="" Jun 03 00:48:49.577041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572623 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 00:48:49.577041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572626 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 00:48:49.577041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572629 2558 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 00:48:49.577041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572633 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 00:48:49.577041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572635 2558 flags.go:64] FLAG: --runonce="false" Jun 03 00:48:49.577041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572638 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 00:48:49.577041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572641 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 00:48:49.577041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572646 2558 flags.go:64] FLAG: --seccomp-default="false" Jun 03 00:48:49.577041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572649 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 00:48:49.577041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572652 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 00:48:49.577041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572655 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 00:48:49.577041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572658 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 00:48:49.577041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572662 2558 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 00:48:49.577041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572665 2558 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 00:48:49.577041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572668 2558 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 00:48:49.577041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572670 2558 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 00:48:49.577041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572673 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 00:48:49.577041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572676 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 00:48:49.577041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572679 2558 flags.go:64] FLAG: --system-cgroups="" Jun 03 00:48:49.577041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572682 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 00:48:49.577041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572688 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 00:48:49.577694 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572690 2558 flags.go:64] FLAG: --tls-cert-file="" Jun 03 00:48:49.577694 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572693 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 00:48:49.577694 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572697 2558 flags.go:64] FLAG: --tls-min-version="" Jun 03 00:48:49.577694 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572700 2558 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 00:48:49.577694 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572703 2558 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 00:48:49.577694 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572706 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 00:48:49.577694 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572709 2558 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 00:48:49.577694 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572712 2558 flags.go:64] FLAG: --v="2" Jun 03 00:48:49.577694 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572716 2558 flags.go:64] FLAG: --version="false" Jun 03 00:48:49.577694 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572720 2558 flags.go:64] FLAG: --vmodule="" Jun 03 00:48:49.577694 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572727 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 00:48:49.577694 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.572730 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 00:48:49.577694 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572823 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 00:48:49.577694 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572826 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 00:48:49.577694 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572829 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 00:48:49.577694 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572831 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 00:48:49.577694 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572834 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 00:48:49.577694 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572836 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 00:48:49.577694 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572839 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 00:48:49.577694 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572844 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 00:48:49.577694 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572847 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 00:48:49.577694 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572850 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 00:48:49.577694 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572852 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 00:48:49.578239 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572855 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 00:48:49.578239 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572858 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 00:48:49.578239 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572860 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 00:48:49.578239 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572863 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 00:48:49.578239 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572865 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 00:48:49.578239 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572868 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 00:48:49.578239 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572870 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 00:48:49.578239 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572873 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 00:48:49.578239 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572875 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 00:48:49.578239 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572878 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 00:48:49.578239 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572880 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 00:48:49.578239 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572883 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 00:48:49.578239 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572886 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 00:48:49.578239 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572888 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 00:48:49.578239 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572891 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 00:48:49.578239 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572894 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 00:48:49.578239 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572896 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 00:48:49.578239 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572899 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 00:48:49.578239 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572901 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 00:48:49.578239 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572905 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 00:48:49.578822 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572908 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 00:48:49.578822 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572910 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 00:48:49.578822 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572913 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 00:48:49.578822 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572916 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 00:48:49.578822 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572918 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 00:48:49.578822 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572921 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 00:48:49.578822 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572923 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 00:48:49.578822 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572926 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 00:48:49.578822 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572930 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 00:48:49.578822 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572933 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 00:48:49.578822 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572936 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 00:48:49.578822 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572939 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 00:48:49.578822 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572941 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 00:48:49.578822 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572944 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 00:48:49.578822 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572946 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 00:48:49.578822 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572949 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 00:48:49.578822 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572951 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 00:48:49.578822 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572955 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 00:48:49.578822 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572959 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 00:48:49.579397 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572961 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 00:48:49.579397 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572964 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 00:48:49.579397 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572966 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 00:48:49.579397 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572969 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 00:48:49.579397 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572972 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 00:48:49.579397 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572975 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 00:48:49.579397 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572979 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 00:48:49.579397 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572982 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 00:48:49.579397 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572984 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 00:48:49.579397 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572987 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 03 00:48:49.579397 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572989 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 00:48:49.579397 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572992 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 00:48:49.579397 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572996 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 00:48:49.579397 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.572999 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 00:48:49.579397 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.573002 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 00:48:49.579397 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.573004 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 00:48:49.579397 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.573007 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 00:48:49.579397 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.573009 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 00:48:49.579397 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.573011 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 00:48:49.579397 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.573014 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 00:48:49.580142 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.573017 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 00:48:49.580142 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.573021 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 00:48:49.580142 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.573024 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 00:48:49.580142 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.573027 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 00:48:49.580142 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.573029 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 00:48:49.580142 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.573032 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 00:48:49.580142 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.573035 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 00:48:49.580142 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.573038 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 00:48:49.580142 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.573040 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 00:48:49.580142 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.573043 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 00:48:49.580142 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.573045 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 00:48:49.580142 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.573048 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 00:48:49.580142 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.573050 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 00:48:49.580142 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.573053 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 00:48:49.580142 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.573055 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 00:48:49.580142 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.573058 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 00:48:49.580790 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.573619 2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 00:48:49.581189 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.581170 2558 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 00:48:49.581223 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.581190 2558 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 00:48:49.581253 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581244 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 00:48:49.581253 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581250 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 00:48:49.581253 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581253 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 00:48:49.581339 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581256 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 00:48:49.581339 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581259 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 00:48:49.581339 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581262 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 00:48:49.581339 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581265 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 00:48:49.581339 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581268 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 00:48:49.581339 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581272 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 00:48:49.581339 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581276 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 00:48:49.581339 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581282 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 00:48:49.581339 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581288 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 00:48:49.581339 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581291 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 00:48:49.581339 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581293 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 00:48:49.581339 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581296 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 00:48:49.581339 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581299 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 00:48:49.581339 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581301 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 00:48:49.581339 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581304 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 00:48:49.581339 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581306 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 00:48:49.581339 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581309 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 00:48:49.581339 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581313 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 00:48:49.581339 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581318 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 00:48:49.581839 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581320 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 00:48:49.581839 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581323 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 00:48:49.581839 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581327 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 00:48:49.581839 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581330 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 00:48:49.581839 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581333 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 00:48:49.581839 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581336 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 00:48:49.581839 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581338 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 00:48:49.581839 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581341 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 00:48:49.581839 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581344 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 00:48:49.581839 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581347 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 00:48:49.581839 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581352 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 00:48:49.581839 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581357 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 00:48:49.581839 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581361 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 00:48:49.581839 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581364 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 00:48:49.581839 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581366 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 00:48:49.581839 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581369 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 00:48:49.581839 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581372 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 00:48:49.581839 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581374 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 00:48:49.581839 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581377 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 00:48:49.582327 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581379 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 00:48:49.582327 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581382 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 00:48:49.582327 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581385 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 00:48:49.582327 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581388 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 00:48:49.582327 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581390 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 00:48:49.582327 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581393 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 00:48:49.582327 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581395 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 00:48:49.582327 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581398 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 00:48:49.582327 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581400 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 00:48:49.582327 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581403 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 00:48:49.582327 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581405 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 00:48:49.582327 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581408 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 00:48:49.582327 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581411 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 00:48:49.582327 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581413 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 00:48:49.582327 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581417 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 00:48:49.582327 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581419 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 03 00:48:49.582327 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581422 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 00:48:49.582327 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581425 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 00:48:49.582327 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581429 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 00:48:49.582327 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581434 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 00:48:49.582851 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581438 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 00:48:49.582851 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581441 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 00:48:49.582851 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581444 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 00:48:49.582851 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581446 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 00:48:49.582851 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581449 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 00:48:49.582851 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581452 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 00:48:49.582851 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581454 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 00:48:49.582851 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581457 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 00:48:49.582851 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581459 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 00:48:49.582851 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581462 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 00:48:49.582851 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581464 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 00:48:49.582851 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581467 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 00:48:49.582851 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581469 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 00:48:49.582851 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581472 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 00:48:49.582851 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581474 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 00:48:49.582851 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581477 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 00:48:49.582851 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581480 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 00:48:49.582851 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581483 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 00:48:49.582851 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581485 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 00:48:49.582851 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581488 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 00:48:49.583348 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581491 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 00:48:49.583348 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581493 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 00:48:49.583348 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581495 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 00:48:49.583348 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581498 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 00:48:49.583348 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581500 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 00:48:49.583348 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.581507 2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 00:48:49.583348 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581631 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 00:48:49.583348 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581637 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 00:48:49.583348 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581640 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 00:48:49.583348 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581645 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 00:48:49.583348 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581648 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 00:48:49.583348 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581651 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 00:48:49.583348 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581654 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 00:48:49.583348 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581659 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 00:48:49.583348 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581664 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 00:48:49.583764 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581669 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 00:48:49.583764 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581673 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 00:48:49.583764 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581676 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 00:48:49.583764 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581678 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 00:48:49.583764 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581681 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 00:48:49.583764 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581683 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 00:48:49.583764 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581686 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 00:48:49.583764 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581688 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 00:48:49.583764 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581691 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 00:48:49.583764 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581694 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 00:48:49.583764 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581696 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 00:48:49.583764 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581699 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 00:48:49.583764 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581701 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 00:48:49.583764 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581705 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 00:48:49.583764 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581708 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 00:48:49.583764 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581710 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 00:48:49.583764 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581712 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 00:48:49.583764 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581715 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 00:48:49.583764 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581717 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 00:48:49.584235 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581720 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 00:48:49.584235 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581722 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 00:48:49.584235 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581725 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 00:48:49.584235 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581728 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 00:48:49.584235 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581730 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 00:48:49.584235 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581734 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 00:48:49.584235 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581738 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 00:48:49.584235 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581743 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 00:48:49.584235 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581747 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 00:48:49.584235 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581749 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 00:48:49.584235 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581752 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 00:48:49.584235 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581755 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 00:48:49.584235 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581757 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 00:48:49.584235 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581760 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 00:48:49.584235 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581762 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 00:48:49.584235 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581765 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 00:48:49.584235 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581767 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 00:48:49.584235 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581770 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 00:48:49.584235 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581772 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 00:48:49.584235 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581774 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 00:48:49.584729 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581777 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 00:48:49.584729 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581779 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 00:48:49.584729 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581782 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 00:48:49.584729 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581784 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 00:48:49.584729 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581787 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 00:48:49.584729 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581789 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 00:48:49.584729 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581792 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 00:48:49.584729 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581795 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 00:48:49.584729 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581798 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 00:48:49.584729 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581800 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 00:48:49.584729 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581803 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 00:48:49.584729 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581806 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 00:48:49.584729 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581808 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 00:48:49.584729 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581812 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 00:48:49.584729 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581816 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 00:48:49.584729 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581820 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 03 00:48:49.584729 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581824 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 00:48:49.584729 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581827 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 00:48:49.584729 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581830 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 00:48:49.584729 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581832 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 00:48:49.585216 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581835 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 00:48:49.585216 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581838 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 00:48:49.585216 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581840 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 00:48:49.585216 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581843 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 00:48:49.585216 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581846 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 00:48:49.585216 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581849 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 00:48:49.585216 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581852 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 00:48:49.585216 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581854 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 00:48:49.585216 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581857 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 00:48:49.585216 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581860 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 00:48:49.585216 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581862 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 00:48:49.585216 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581865 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 00:48:49.585216 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581868 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 00:48:49.585216 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581870 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 00:48:49.585216 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581872 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 00:48:49.585216 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581875 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 00:48:49.585216 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581878 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 00:48:49.585216 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:49.581882 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 00:48:49.585661 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.581887 2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 00:48:49.585661 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.582578 2558 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 00:48:49.585661 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.585617 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 00:48:49.586397 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.586384 2558 server.go:1019] "Starting client certificate rotation" Jun 03 00:48:49.586508 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.586489 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 00:48:49.586732 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.586544 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 00:48:49.607096 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.607078 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 00:48:49.613089 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.613066 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 00:48:49.621171 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.621151 2558 log.go:25] "Validated CRI v1 runtime API" Jun 03 00:48:49.627672 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.627653 2558 log.go:25] "Validated CRI v1 image API" Jun 03 00:48:49.629500 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.629486 2558 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 00:48:49.631784 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.631760 2558 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 85061a5f-481a-4147-b873-6bd454896aec:/dev/nvme0n1p3 8aa93547-ab60-4dd3-8590-51c3813692d4:/dev/nvme0n1p4] Jun 03 00:48:49.631847 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.631784 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 00:48:49.636775 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.636756 2558 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 00:48:49.637326 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.637215 2558 manager.go:217] Machine: {Timestamp:2026-06-03 00:48:49.636633368 +0000 UTC m=+0.335003851 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102690 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b4f9c941e31d09a6196742817991d SystemUUID:ec2b4f9c-941e-31d0-9a61-96742817991d BootID:080e0d0b-821d-43c7-b96c-69137540cc69 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:64:83:67:fe:b1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:64:83:67:fe:b1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:17:f2:9a:97:e5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 00:48:49.637326 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.637323 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 00:48:49.637432 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.637405 2558 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 00:48:49.640100 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.640077 2558 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 00:48:49.640239 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.640103 2558 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-48.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 00:48:49.640290 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.640249 2558 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 00:48:49.640290 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.640258 2558 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 00:48:49.640290 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.640266 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 00:48:49.640290 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.640281 2558 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 00:48:49.641645 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.641634 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 03 00:48:49.641759 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.641750 2558 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 00:48:49.643772 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.643761 2558 kubelet.go:491] "Attempting to sync node with API server" Jun 03 00:48:49.643812 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.643775 2558 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 00:48:49.644391 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.644382 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 00:48:49.644432 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.644394 2558 kubelet.go:397] "Adding apiserver pod source" Jun 03 00:48:49.644432 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.644403 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 00:48:49.645389 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.645376 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 00:48:49.645445 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.645400 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 00:48:49.648348 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.648329 2558 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 00:48:49.650176 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.650162 2558 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 00:48:49.651813 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.651798 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 00:48:49.651813 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.651816 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 00:48:49.651913 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.651823 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 00:48:49.651913 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.651829 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 00:48:49.651913 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.651838 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 00:48:49.651913 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.651844 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 00:48:49.651913 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.651849 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 00:48:49.651913 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.651855 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 00:48:49.651913 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.651862 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 00:48:49.651913 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.651869 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 00:48:49.651913 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.651877 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 00:48:49.651913 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.651882 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 00:48:49.652581 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.652571 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 00:48:49.652581 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.652581 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 00:48:49.656023 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.656009 2558 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 00:48:49.656095 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.656045 2558 server.go:1295] "Started kubelet" Jun 03 00:48:49.656186 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.656111 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 00:48:49.656232 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.656177 2558 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 00:48:49.656315 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.656300 2558 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 00:48:49.656919 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:49.656893 2558 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-48.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 00:48:49.656919 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:49.656892 2558 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 00:48:49.657041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.656930 2558 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-48.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 00:48:49.657063 ip-10-0-134-48 systemd[1]: Started Kubernetes Kubelet. Jun 03 00:48:49.658038 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.657969 2558 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 00:48:49.658630 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.658613 2558 server.go:317] "Adding debug handlers to kubelet server" Jun 03 00:48:49.662149 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.662131 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 00:48:49.662149 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.662144 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 00:48:49.662930 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.662842 2558 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 00:48:49.662930 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.662861 2558 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 00:48:49.662930 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:49.662892 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-48.ec2.internal\" not found" Jun 03 00:48:49.663120 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.663007 2558 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 00:48:49.663120 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.663071 2558 reconstruct.go:97] "Volume reconstruction finished" Jun 03 00:48:49.663120 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.663080 2558 reconciler.go:26] "Reconciler: start to sync state" Jun 03 00:48:49.664028 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.663615 2558 factory.go:55] Registering systemd factory Jun 03 00:48:49.664028 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.663840 2558 factory.go:223] Registration of the systemd container factory successfully Jun 03 00:48:49.664644 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.664218 2558 factory.go:153] Registering CRI-O factory Jun 03 00:48:49.664644 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.664235 2558 factory.go:223] Registration of the crio container factory successfully Jun 03 00:48:49.664644 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.664325 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 00:48:49.664644 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.664342 2558 factory.go:103] Registering Raw factory Jun 03 00:48:49.664644 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.664356 2558 manager.go:1196] Started watching for new ooms in manager Jun 03 00:48:49.664931 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.664728 2558 manager.go:319] Starting recovery of all containers Jun 03 00:48:49.665176 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:49.665154 2558 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 00:48:49.665894 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:49.664963 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-48.ec2.internal.18b56bc6e34c3fd6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-48.ec2.internal,UID:ip-10-0-134-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-48.ec2.internal,},FirstTimestamp:2026-06-03 00:48:49.65602095 +0000 UTC m=+0.354391432,LastTimestamp:2026-06-03 00:48:49.65602095 +0000 UTC m=+0.354391432,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-48.ec2.internal,}" Jun 03 00:48:49.666238 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:49.666210 2558 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 00:48:49.671476 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:49.671446 2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-48.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 00:48:49.671760 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.671732 2558 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 00:48:49.675727 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.675705 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xz2w7" Jun 03 00:48:49.677551 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.677534 2558 manager.go:324] Recovery completed Jun 03 00:48:49.681561 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.681546 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 00:48:49.682720 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.682705 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xz2w7" Jun 03 00:48:49.683355 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.683338 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-48.ec2.internal" event="NodeHasSufficientMemory" Jun 03 00:48:49.683428 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.683366 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-48.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 00:48:49.683428 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.683376 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-48.ec2.internal" event="NodeHasSufficientPID" Jun 03 00:48:49.683901 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.683887 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 00:48:49.683901 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.683898 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 00:48:49.684003 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.683915 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 03 00:48:49.685257 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:49.685193 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-48.ec2.internal.18b56bc6e4ed4d20 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-48.ec2.internal,UID:ip-10-0-134-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-48.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-48.ec2.internal,},FirstTimestamp:2026-06-03 00:48:49.683352864 +0000 UTC m=+0.381723347,LastTimestamp:2026-06-03 00:48:49.683352864 +0000 UTC m=+0.381723347,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-48.ec2.internal,}" Jun 03 00:48:49.686252 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.686240 2558 policy_none.go:49] "None policy: Start" Jun 03 00:48:49.686290 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.686256 2558 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 00:48:49.686290 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.686267 2558 state_mem.go:35] "Initializing new in-memory state store" Jun 03 00:48:49.720146 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.720122 2558 manager.go:341] "Starting Device Plugin manager" Jun 03 00:48:49.732808 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:49.720170 2558 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 00:48:49.732808 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.720184 2558 server.go:85] "Starting device plugin registration server" Jun 03 00:48:49.732808 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.720473 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 00:48:49.732808 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.720486 2558 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 00:48:49.732808 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.720623 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 00:48:49.732808 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.720724 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 00:48:49.732808 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.720734 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 00:48:49.732808 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:49.721241 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 00:48:49.732808 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:49.721289 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-48.ec2.internal\" not found" Jun 03 00:48:49.761630 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.761605 2558 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 00:48:49.761726 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.761635 2558 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 00:48:49.761726 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.761655 2558 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 00:48:49.761726 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.761662 2558 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 00:48:49.761726 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:49.761707 2558 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 00:48:49.764128 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.764108 2558 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 00:48:49.821132 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.821067 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 00:48:49.822196 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.822177 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-48.ec2.internal" event="NodeHasSufficientMemory" Jun 03 00:48:49.822289 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.822207 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-48.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 00:48:49.822289 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.822223 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-48.ec2.internal" event="NodeHasSufficientPID" Jun 03 00:48:49.822289 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.822248 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-48.ec2.internal" Jun 03 00:48:49.829362 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.829346 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-48.ec2.internal" Jun 03 00:48:49.829448 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:49.829370 2558 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-48.ec2.internal\": node \"ip-10-0-134-48.ec2.internal\" not found" Jun 03 00:48:49.856793 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:49.856771 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-48.ec2.internal\" not found" Jun 03 00:48:49.861782 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.861762 2558 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-48.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-48.ec2.internal"] Jun 03 00:48:49.861853 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.861838 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 00:48:49.863192 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.863178 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-48.ec2.internal" event="NodeHasSufficientMemory" Jun 03 00:48:49.863270 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.863206 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-48.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 00:48:49.863270 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.863217 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-48.ec2.internal" event="NodeHasSufficientPID" Jun 03 00:48:49.864302 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.864287 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 00:48:49.864475 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.864460 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-48.ec2.internal" Jun 03 00:48:49.864545 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.864493 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 00:48:49.865055 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.865030 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-48.ec2.internal" event="NodeHasSufficientMemory" Jun 03 00:48:49.865147 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.865062 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-48.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 00:48:49.865147 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.865071 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-48.ec2.internal" event="NodeHasSufficientPID" Jun 03 00:48:49.865147 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.865030 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-48.ec2.internal" event="NodeHasSufficientMemory" Jun 03 00:48:49.865147 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.865140 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-48.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 00:48:49.865336 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.865157 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-48.ec2.internal" event="NodeHasSufficientPID" Jun 03 00:48:49.866207 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.866190 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-48.ec2.internal" Jun 03 00:48:49.866276 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.866213 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 00:48:49.866899 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.866885 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-48.ec2.internal" event="NodeHasSufficientMemory" Jun 03 00:48:49.866955 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.866915 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-48.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 00:48:49.866955 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.866931 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-48.ec2.internal" event="NodeHasSufficientPID" Jun 03 00:48:49.896292 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:49.896270 2558 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-48.ec2.internal\" not found" node="ip-10-0-134-48.ec2.internal" Jun 03 00:48:49.900723 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:49.900709 2558 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-48.ec2.internal\" not found" node="ip-10-0-134-48.ec2.internal" Jun 03 00:48:49.957786 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:49.957756 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-48.ec2.internal\" not found" Jun 03 00:48:49.964070 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.964049 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5d5c49d9c12538ee9e97947ca31da9a9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-48.ec2.internal\" (UID: \"5d5c49d9c12538ee9e97947ca31da9a9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-48.ec2.internal" Jun 03 00:48:49.964129 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:49.964074 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d5c49d9c12538ee9e97947ca31da9a9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-48.ec2.internal\" (UID: \"5d5c49d9c12538ee9e97947ca31da9a9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-48.ec2.internal" Jun 03 00:48:50.058243 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:50.058202 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-48.ec2.internal\" not found" Jun 03 00:48:50.064500 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:50.064479 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5d5c49d9c12538ee9e97947ca31da9a9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-48.ec2.internal\" (UID: \"5d5c49d9c12538ee9e97947ca31da9a9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-48.ec2.internal" Jun 03 00:48:50.064561 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:50.064508 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d5c49d9c12538ee9e97947ca31da9a9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-48.ec2.internal\" (UID: \"5d5c49d9c12538ee9e97947ca31da9a9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-48.ec2.internal" Jun 03 00:48:50.064561 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:50.064544 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/17fe47cc7cb9b1d18b8c5bc4ddf5b79c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-48.ec2.internal\" (UID: \"17fe47cc7cb9b1d18b8c5bc4ddf5b79c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-48.ec2.internal" Jun 03 00:48:50.064625 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:50.064572 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5d5c49d9c12538ee9e97947ca31da9a9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-48.ec2.internal\" (UID: \"5d5c49d9c12538ee9e97947ca31da9a9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-48.ec2.internal" Jun 03 00:48:50.064625 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:50.064587 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d5c49d9c12538ee9e97947ca31da9a9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-48.ec2.internal\" (UID: \"5d5c49d9c12538ee9e97947ca31da9a9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-48.ec2.internal" Jun 03 00:48:50.158980 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:50.158905 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-48.ec2.internal\" not found" Jun 03 00:48:50.165317 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:50.165295 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/17fe47cc7cb9b1d18b8c5bc4ddf5b79c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-48.ec2.internal\" (UID: \"17fe47cc7cb9b1d18b8c5bc4ddf5b79c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-48.ec2.internal" Jun 03 00:48:50.165368 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:50.165329 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/17fe47cc7cb9b1d18b8c5bc4ddf5b79c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-48.ec2.internal\" (UID: \"17fe47cc7cb9b1d18b8c5bc4ddf5b79c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-48.ec2.internal" Jun 03 00:48:50.199454 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:50.199427 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-48.ec2.internal" Jun 03 00:48:50.204140 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:50.204119 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-48.ec2.internal" Jun 03 00:48:50.259951 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:50.259919 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-48.ec2.internal\" not found" Jun 03 00:48:50.360456 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:50.360423 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-48.ec2.internal\" not found" Jun 03 00:48:50.461065 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:50.460989 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-48.ec2.internal\" not found" Jun 03 00:48:50.560980 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:50.560947 2558 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 00:48:50.561116 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:50.561042 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-48.ec2.internal\" not found" Jun 03 00:48:50.568780 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:50.568753 2558 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 00:48:50.587498 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:50.587477 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 00:48:50.587633 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:50.587616 2558 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 00:48:50.587681 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:50.587658 2558 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 00:48:50.587714 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:50.587658 2558 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 00:48:50.661834 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:50.661805 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-48.ec2.internal\" not found" Jun 03 00:48:50.662933 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:50.662912 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 00:48:50.677663 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:50.677637 2558 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 00:48:50.684369 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:50.684340 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 00:43:49 +0000 UTC" deadline="2028-02-20 05:32:41.21219091 +0000 UTC" Jun 03 00:48:50.684369 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:50.684366 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15052h43m50.527828129s" Jun 03 00:48:50.697180 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:50.697159 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v75kz" Jun 03 00:48:50.704975 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:50.704955 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v75kz" Jun 03 00:48:50.738570 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:50.738536 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d5c49d9c12538ee9e97947ca31da9a9.slice/crio-6387f701fb8e1434f34b485b37a715deb5b276cd08ae672b31a9c58d374d256b WatchSource:0}: Error finding container 6387f701fb8e1434f34b485b37a715deb5b276cd08ae672b31a9c58d374d256b: Status 404 returned error can't find the container with id 6387f701fb8e1434f34b485b37a715deb5b276cd08ae672b31a9c58d374d256b Jun 03 00:48:50.738793 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:50.738770 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17fe47cc7cb9b1d18b8c5bc4ddf5b79c.slice/crio-1e043e5983f9b37d9fa6d34ea911a7c5d007f1b5c963c094012665693a43d8d8 WatchSource:0}: Error finding container 1e043e5983f9b37d9fa6d34ea911a7c5d007f1b5c963c094012665693a43d8d8: Status 404 returned error can't find the container with id 1e043e5983f9b37d9fa6d34ea911a7c5d007f1b5c963c094012665693a43d8d8 Jun 03 00:48:50.742042 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:50.742017 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 00:48:50.762836 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:50.762812 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-48.ec2.internal\" not found" Jun 03 00:48:50.764676 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:50.764632 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-48.ec2.internal" event={"ID":"17fe47cc7cb9b1d18b8c5bc4ddf5b79c","Type":"ContainerStarted","Data":"1e043e5983f9b37d9fa6d34ea911a7c5d007f1b5c963c094012665693a43d8d8"} Jun 03 00:48:50.765501 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:50.765484 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-48.ec2.internal" event={"ID":"5d5c49d9c12538ee9e97947ca31da9a9","Type":"ContainerStarted","Data":"6387f701fb8e1434f34b485b37a715deb5b276cd08ae672b31a9c58d374d256b"} Jun 03 00:48:50.863919 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:50.863882 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-48.ec2.internal\" not found" Jun 03 00:48:50.964333 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:50.964300 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-48.ec2.internal\" not found" Jun 03 00:48:51.064794 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:51.064770 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-48.ec2.internal\" not found" Jun 03 00:48:51.165489 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:51.165457 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-48.ec2.internal\" not found" Jun 03 00:48:51.215320 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.215292 2558 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 00:48:51.262392 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.262355 2558 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-48.ec2.internal" Jun 03 00:48:51.277264 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.277243 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 00:48:51.278063 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.278037 2558 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-48.ec2.internal" Jun 03 00:48:51.286474 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.286455 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 00:48:51.645328 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.645300 2558 apiserver.go:52] "Watching apiserver" Jun 03 00:48:51.654419 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.654391 2558 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 00:48:51.656141 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.656113 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-hr85v","openshift-ovn-kubernetes/ovnkube-node-k8zww","kube-system/konnectivity-agent-ncjrr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc7sf","openshift-dns/node-resolver-2z5f7","openshift-image-registry/node-ca-b6chf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-48.ec2.internal","openshift-multus/network-metrics-daemon-x67bk","openshift-network-diagnostics/network-check-target-cg5ft","openshift-network-operator/iptables-alerter-gwfns","kube-system/kube-apiserver-proxy-ip-10-0-134-48.ec2.internal","openshift-cluster-node-tuning-operator/tuned-vwdf6","openshift-multus/multus-additional-cni-plugins-wqkw8"] Jun 03 00:48:51.657438 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.657419 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gwfns" Jun 03 00:48:51.658674 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.658619 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc7sf" Jun 03 00:48:51.659616 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.659597 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2z5f7" Jun 03 00:48:51.659906 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.659886 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 00:48:51.659989 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.659971 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 00:48:51.660087 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.660066 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j2jrw\"" Jun 03 00:48:51.660148 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.660101 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 00:48:51.660917 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.660867 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:48:51.661012 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:51.660939 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x67bk" podUID="905babfb-1634-4e78-a4b5-177ab08e7a3d" Jun 03 00:48:51.661298 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.661267 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 00:48:51.661298 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.661283 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 00:48:51.661432 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.661314 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 00:48:51.661432 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.661382 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tpgh8\"" Jun 03 00:48:51.661757 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.661727 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 00:48:51.661757 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.661731 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g7tsl\"" Jun 03 00:48:51.662240 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.662081 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.662240 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.662165 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 00:48:51.663428 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.663223 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ncjrr" Jun 03 00:48:51.664223 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.664205 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b6chf" Jun 03 00:48:51.664346 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.664330 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2cdsp\"" Jun 03 00:48:51.664580 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.664563 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 00:48:51.664646 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.664626 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 00:48:51.665204 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.665184 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 00:48:51.665728 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.665530 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 00:48:51.666486 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.666465 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 00:48:51.666788 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.666770 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 00:48:51.667512 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.667485 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 00:48:51.667665 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.667647 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qgbmj\"" Jun 03 00:48:51.669199 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.667788 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 00:48:51.669199 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.667913 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 00:48:51.669199 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.667946 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gzlnm\"" Jun 03 00:48:51.669199 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.668038 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 00:48:51.669199 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.668437 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 00:48:51.670178 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.670148 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg5ft" Jun 03 00:48:51.670264 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:51.670222 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg5ft" podUID="a5e76234-ae70-4046-8dbe-95f3f0441488" Jun 03 00:48:51.670322 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.670271 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.671512 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.671492 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.672737 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.672560 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 00:48:51.672737 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.672715 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wqkw8" Jun 03 00:48:51.673434 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673046 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c210edda-8849-4277-b258-5b40647200a9-env-overrides\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.673434 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673080 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xp4p\" (UniqueName: \"kubernetes.io/projected/c210edda-8849-4277-b258-5b40647200a9-kube-api-access-7xp4p\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.673434 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673109 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3e7de0a9-bca9-4686-b4a4-f4ebeff98128-sys-fs\") pod \"aws-ebs-csi-driver-node-bc7sf\" (UID: \"3e7de0a9-bca9-4686-b4a4-f4ebeff98128\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc7sf" Jun 03 00:48:51.673434 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673133 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-host-slash\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.673434 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673155 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/68e85fe7-9edc-4ae9-9869-ac61b5746afd-serviceca\") pod \"node-ca-b6chf\" (UID: \"68e85fe7-9edc-4ae9-9869-ac61b5746afd\") " pod="openshift-image-registry/node-ca-b6chf" Jun 03 00:48:51.673434 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673166 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 00:48:51.673434 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673202 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6790c8f2-3d7a-4e0e-99b1-16b25e762a43-host-slash\") pod \"iptables-alerter-gwfns\" (UID: \"6790c8f2-3d7a-4e0e-99b1-16b25e762a43\") " pod="openshift-network-operator/iptables-alerter-gwfns" Jun 03 00:48:51.673434 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673216 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 00:48:51.673434 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673228 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d96991ed-c416-44f8-a04e-6f13f5d02ab8-tmp-dir\") pod \"node-resolver-2z5f7\" (UID: \"d96991ed-c416-44f8-a04e-6f13f5d02ab8\") " pod="openshift-dns/node-resolver-2z5f7" Jun 03 00:48:51.673434 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673246 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 00:48:51.673434 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673246 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcq82\" (UniqueName: \"kubernetes.io/projected/d96991ed-c416-44f8-a04e-6f13f5d02ab8-kube-api-access-fcq82\") pod \"node-resolver-2z5f7\" (UID: \"d96991ed-c416-44f8-a04e-6f13f5d02ab8\") " pod="openshift-dns/node-resolver-2z5f7" Jun 03 00:48:51.673434 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673289 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hwdl\" (UniqueName: \"kubernetes.io/projected/3e7de0a9-bca9-4686-b4a4-f4ebeff98128-kube-api-access-9hwdl\") pod \"aws-ebs-csi-driver-node-bc7sf\" (UID: \"3e7de0a9-bca9-4686-b4a4-f4ebeff98128\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc7sf" Jun 03 00:48:51.673434 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673304 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68e85fe7-9edc-4ae9-9869-ac61b5746afd-host\") pod \"node-ca-b6chf\" (UID: \"68e85fe7-9edc-4ae9-9869-ac61b5746afd\") " pod="openshift-image-registry/node-ca-b6chf" Jun 03 00:48:51.673434 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673318 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b90ee857-e6a3-4a9d-b66c-9dea49751494-konnectivity-ca\") pod \"konnectivity-agent-ncjrr\" (UID: \"b90ee857-e6a3-4a9d-b66c-9dea49751494\") " pod="kube-system/konnectivity-agent-ncjrr" Jun 03 00:48:51.673434 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673354 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.673434 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673392 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ssllf\"" Jun 03 00:48:51.673434 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673383 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c210edda-8849-4277-b258-5b40647200a9-ovnkube-config\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.673434 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673434 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3e7de0a9-bca9-4686-b4a4-f4ebeff98128-device-dir\") pod \"aws-ebs-csi-driver-node-bc7sf\" (UID: \"3e7de0a9-bca9-4686-b4a4-f4ebeff98128\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc7sf" Jun 03 00:48:51.674378 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673474 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngm7t\" (UniqueName: \"kubernetes.io/projected/905babfb-1634-4e78-a4b5-177ab08e7a3d-kube-api-access-ngm7t\") pod \"network-metrics-daemon-x67bk\" (UID: \"905babfb-1634-4e78-a4b5-177ab08e7a3d\") " pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:48:51.674378 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673505 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6790c8f2-3d7a-4e0e-99b1-16b25e762a43-iptables-alerter-script\") pod \"iptables-alerter-gwfns\" (UID: \"6790c8f2-3d7a-4e0e-99b1-16b25e762a43\") " pod="openshift-network-operator/iptables-alerter-gwfns" Jun 03 00:48:51.674378 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673549 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwx25\" (UniqueName: \"kubernetes.io/projected/6790c8f2-3d7a-4e0e-99b1-16b25e762a43-kube-api-access-jwx25\") pod \"iptables-alerter-gwfns\" (UID: \"6790c8f2-3d7a-4e0e-99b1-16b25e762a43\") " pod="openshift-network-operator/iptables-alerter-gwfns" Jun 03 00:48:51.674378 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673579 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-run-ovn\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.674378 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673595 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b90ee857-e6a3-4a9d-b66c-9dea49751494-agent-certs\") pod \"konnectivity-agent-ncjrr\" (UID: \"b90ee857-e6a3-4a9d-b66c-9dea49751494\") " pod="kube-system/konnectivity-agent-ncjrr" Jun 03 00:48:51.674378 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673613 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3e7de0a9-bca9-4686-b4a4-f4ebeff98128-etc-selinux\") pod \"aws-ebs-csi-driver-node-bc7sf\" (UID: \"3e7de0a9-bca9-4686-b4a4-f4ebeff98128\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc7sf" Jun 03 00:48:51.674378 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673637 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d96991ed-c416-44f8-a04e-6f13f5d02ab8-hosts-file\") pod \"node-resolver-2z5f7\" (UID: \"d96991ed-c416-44f8-a04e-6f13f5d02ab8\") " pod="openshift-dns/node-resolver-2z5f7" Jun 03 00:48:51.674378 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673660 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c210edda-8849-4277-b258-5b40647200a9-ovnkube-script-lib\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.674378 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673685 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf528\" (UniqueName: \"kubernetes.io/projected/68e85fe7-9edc-4ae9-9869-ac61b5746afd-kube-api-access-xf528\") pod \"node-ca-b6chf\" (UID: \"68e85fe7-9edc-4ae9-9869-ac61b5746afd\") " pod="openshift-image-registry/node-ca-b6chf" Jun 03 00:48:51.674378 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673711 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-host-run-netns\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.674378 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673733 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-run-systemd\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.674378 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673755 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-run-openvswitch\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.674378 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673777 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-log-socket\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.674378 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673799 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-host-cni-netd\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.674378 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673839 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3e7de0a9-bca9-4686-b4a4-f4ebeff98128-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bc7sf\" (UID: \"3e7de0a9-bca9-4686-b4a4-f4ebeff98128\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc7sf" Jun 03 00:48:51.674378 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673862 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3e7de0a9-bca9-4686-b4a4-f4ebeff98128-registration-dir\") pod \"aws-ebs-csi-driver-node-bc7sf\" (UID: \"3e7de0a9-bca9-4686-b4a4-f4ebeff98128\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc7sf" Jun 03 00:48:51.674378 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673875 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 00:48:51.675164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673884 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/905babfb-1634-4e78-a4b5-177ab08e7a3d-metrics-certs\") pod \"network-metrics-daemon-x67bk\" (UID: \"905babfb-1634-4e78-a4b5-177ab08e7a3d\") " pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:48:51.675164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673925 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3e7de0a9-bca9-4686-b4a4-f4ebeff98128-socket-dir\") pod \"aws-ebs-csi-driver-node-bc7sf\" (UID: \"3e7de0a9-bca9-4686-b4a4-f4ebeff98128\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc7sf" Jun 03 00:48:51.675164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673933 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8v9nb\"" Jun 03 00:48:51.675164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673947 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-host-kubelet\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.675164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673969 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-systemd-units\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.675164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.673991 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-var-lib-openvswitch\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.675164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.674015 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-node-log\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.675164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.674037 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-host-run-ovn-kubernetes\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.675164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.674047 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 00:48:51.675164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.674075 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-host-cni-bin\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.675164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.674102 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c210edda-8849-4277-b258-5b40647200a9-ovn-node-metrics-cert\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.675164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.674125 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-etc-openvswitch\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.675164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.674742 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 00:48:51.675786 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.675746 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 00:48:51.676026 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.676008 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xfs87\"" Jun 03 00:48:51.705778 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.705750 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 00:43:50 +0000 UTC" deadline="2027-12-26 20:49:01.514253148 +0000 UTC" Jun 03 00:48:51.705778 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.705773 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13724h0m9.808482812s" Jun 03 00:48:51.763961 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.763935 2558 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 00:48:51.774356 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.774331 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b90ee857-e6a3-4a9d-b66c-9dea49751494-konnectivity-ca\") pod \"konnectivity-agent-ncjrr\" (UID: \"b90ee857-e6a3-4a9d-b66c-9dea49751494\") " pod="kube-system/konnectivity-agent-ncjrr" Jun 03 00:48:51.774509 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.774368 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c210edda-8849-4277-b258-5b40647200a9-ovnkube-config\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.774509 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.774397 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3e7de0a9-bca9-4686-b4a4-f4ebeff98128-device-dir\") pod \"aws-ebs-csi-driver-node-bc7sf\" (UID: \"3e7de0a9-bca9-4686-b4a4-f4ebeff98128\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc7sf" Jun 03 00:48:51.774509 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.774428 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6790c8f2-3d7a-4e0e-99b1-16b25e762a43-iptables-alerter-script\") pod \"iptables-alerter-gwfns\" (UID: \"6790c8f2-3d7a-4e0e-99b1-16b25e762a43\") " pod="openshift-network-operator/iptables-alerter-gwfns" Jun 03 00:48:51.774509 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.774451 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jwx25\" (UniqueName: \"kubernetes.io/projected/6790c8f2-3d7a-4e0e-99b1-16b25e762a43-kube-api-access-jwx25\") pod \"iptables-alerter-gwfns\" (UID: \"6790c8f2-3d7a-4e0e-99b1-16b25e762a43\") " pod="openshift-network-operator/iptables-alerter-gwfns" Jun 03 00:48:51.774509 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.774480 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-os-release\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.774773 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.774511 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3e7de0a9-bca9-4686-b4a4-f4ebeff98128-device-dir\") pod \"aws-ebs-csi-driver-node-bc7sf\" (UID: \"3e7de0a9-bca9-4686-b4a4-f4ebeff98128\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc7sf" Jun 03 00:48:51.774773 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.774504 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-hostroot\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.774773 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.774681 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-run-ovn\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.774773 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.774712 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d96991ed-c416-44f8-a04e-6f13f5d02ab8-hosts-file\") pod \"node-resolver-2z5f7\" (UID: \"d96991ed-c416-44f8-a04e-6f13f5d02ab8\") " pod="openshift-dns/node-resolver-2z5f7" Jun 03 00:48:51.774773 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.774745 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-host-var-lib-cni-multus\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.775001 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.774773 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b247bdf-26a2-4af4-bee6-ddd65313843e-multus-daemon-config\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.775001 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.774823 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-etc-kubernetes\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.775001 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.774846 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4h95\" (UniqueName: \"kubernetes.io/projected/8b247bdf-26a2-4af4-bee6-ddd65313843e-kube-api-access-z4h95\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.775001 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.774872 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xf528\" (UniqueName: \"kubernetes.io/projected/68e85fe7-9edc-4ae9-9869-ac61b5746afd-kube-api-access-xf528\") pod \"node-ca-b6chf\" (UID: \"68e85fe7-9edc-4ae9-9869-ac61b5746afd\") " pod="openshift-image-registry/node-ca-b6chf" Jun 03 00:48:51.775001 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.774879 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d96991ed-c416-44f8-a04e-6f13f5d02ab8-hosts-file\") pod \"node-resolver-2z5f7\" (UID: \"d96991ed-c416-44f8-a04e-6f13f5d02ab8\") " pod="openshift-dns/node-resolver-2z5f7" Jun 03 00:48:51.775001 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.774897 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-etc-kubernetes\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.775001 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.774922 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-var-lib-kubelet\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.775001 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.774942 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-host-var-lib-cni-bin\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.775338 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.775262 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-run-openvswitch\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.775338 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.775306 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3e7de0a9-bca9-4686-b4a4-f4ebeff98128-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bc7sf\" (UID: \"3e7de0a9-bca9-4686-b4a4-f4ebeff98128\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc7sf" Jun 03 00:48:51.775428 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.775343 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-etc-sysctl-conf\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.775428 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.775393 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-systemd-units\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.775540 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.775435 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-host-run-ovn-kubernetes\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.775540 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.775468 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c210edda-8849-4277-b258-5b40647200a9-ovn-node-metrics-cert\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.775540 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.775503 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3e7de0a9-bca9-4686-b4a4-f4ebeff98128-sys-fs\") pod \"aws-ebs-csi-driver-node-bc7sf\" (UID: \"3e7de0a9-bca9-4686-b4a4-f4ebeff98128\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc7sf" Jun 03 00:48:51.775686 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.775559 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-lib-modules\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.775686 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.775597 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4aced56a-7b13-4d13-a18f-b189410b8b07-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wqkw8\" (UID: \"4aced56a-7b13-4d13-a18f-b189410b8b07\") " pod="openshift-multus/multus-additional-cni-plugins-wqkw8" Jun 03 00:48:51.775686 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.775630 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-system-cni-dir\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.775686 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.775659 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-multus-cni-dir\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.775869 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.775686 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-etc-openvswitch\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.775869 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.775718 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c210edda-8849-4277-b258-5b40647200a9-env-overrides\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.775869 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.775747 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7xp4p\" (UniqueName: \"kubernetes.io/projected/c210edda-8849-4277-b258-5b40647200a9-kube-api-access-7xp4p\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.775869 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.775779 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-etc-sysconfig\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.775869 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.775816 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4aced56a-7b13-4d13-a18f-b189410b8b07-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wqkw8\" (UID: \"4aced56a-7b13-4d13-a18f-b189410b8b07\") " pod="openshift-multus/multus-additional-cni-plugins-wqkw8" Jun 03 00:48:51.776087 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.775791 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c210edda-8849-4277-b258-5b40647200a9-ovnkube-config\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.776087 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.776003 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6790c8f2-3d7a-4e0e-99b1-16b25e762a43-iptables-alerter-script\") pod \"iptables-alerter-gwfns\" (UID: \"6790c8f2-3d7a-4e0e-99b1-16b25e762a43\") " pod="openshift-network-operator/iptables-alerter-gwfns" Jun 03 00:48:51.776179 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.774937 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-run-ovn\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.776694 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.776238 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b90ee857-e6a3-4a9d-b66c-9dea49751494-konnectivity-ca\") pod \"konnectivity-agent-ncjrr\" (UID: \"b90ee857-e6a3-4a9d-b66c-9dea49751494\") " pod="kube-system/konnectivity-agent-ncjrr" Jun 03 00:48:51.776819 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.776790 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-host-run-netns\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.776887 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.776833 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-host-run-multus-certs\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.777092 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.777072 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-host-slash\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.777189 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.777121 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/68e85fe7-9edc-4ae9-9869-ac61b5746afd-serviceca\") pod \"node-ca-b6chf\" (UID: \"68e85fe7-9edc-4ae9-9869-ac61b5746afd\") " pod="openshift-image-registry/node-ca-b6chf" Jun 03 00:48:51.777189 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.777160 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fcq82\" (UniqueName: \"kubernetes.io/projected/d96991ed-c416-44f8-a04e-6f13f5d02ab8-kube-api-access-fcq82\") pod \"node-resolver-2z5f7\" (UID: \"d96991ed-c416-44f8-a04e-6f13f5d02ab8\") " pod="openshift-dns/node-resolver-2z5f7" Jun 03 00:48:51.777288 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.777205 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f2bb47d-1fea-4ff1-9415-06672ecce926-etc-tuned\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.777288 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.777249 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4aced56a-7b13-4d13-a18f-b189410b8b07-cni-binary-copy\") pod \"multus-additional-cni-plugins-wqkw8\" (UID: \"4aced56a-7b13-4d13-a18f-b189410b8b07\") " pod="openshift-multus/multus-additional-cni-plugins-wqkw8" Jun 03 00:48:51.777288 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.777290 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9hwdl\" (UniqueName: \"kubernetes.io/projected/3e7de0a9-bca9-4686-b4a4-f4ebeff98128-kube-api-access-9hwdl\") pod \"aws-ebs-csi-driver-node-bc7sf\" (UID: \"3e7de0a9-bca9-4686-b4a4-f4ebeff98128\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc7sf" Jun 03 00:48:51.777467 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.777317 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-run\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.777467 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.777350 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4aced56a-7b13-4d13-a18f-b189410b8b07-os-release\") pod \"multus-additional-cni-plugins-wqkw8\" (UID: \"4aced56a-7b13-4d13-a18f-b189410b8b07\") " pod="openshift-multus/multus-additional-cni-plugins-wqkw8" Jun 03 00:48:51.777467 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.777383 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-cnibin\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.777467 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.777420 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-host\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.777467 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.777455 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.777726 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.777484 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ngm7t\" (UniqueName: \"kubernetes.io/projected/905babfb-1634-4e78-a4b5-177ab08e7a3d-kube-api-access-ngm7t\") pod \"network-metrics-daemon-x67bk\" (UID: \"905babfb-1634-4e78-a4b5-177ab08e7a3d\") " pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:48:51.777726 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.777539 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-etc-sysctl-d\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.777726 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.777574 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-sys\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.777726 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.777605 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zql7\" (UniqueName: \"kubernetes.io/projected/0f2bb47d-1fea-4ff1-9415-06672ecce926-kube-api-access-2zql7\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.777726 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.777640 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b90ee857-e6a3-4a9d-b66c-9dea49751494-agent-certs\") pod \"konnectivity-agent-ncjrr\" (UID: \"b90ee857-e6a3-4a9d-b66c-9dea49751494\") " pod="kube-system/konnectivity-agent-ncjrr" Jun 03 00:48:51.777726 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.777666 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3e7de0a9-bca9-4686-b4a4-f4ebeff98128-etc-selinux\") pod \"aws-ebs-csi-driver-node-bc7sf\" (UID: \"3e7de0a9-bca9-4686-b4a4-f4ebeff98128\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc7sf" Jun 03 00:48:51.777726 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.777704 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f2bb47d-1fea-4ff1-9415-06672ecce926-tmp\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.778047 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.777742 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c210edda-8849-4277-b258-5b40647200a9-ovnkube-script-lib\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.778047 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.777777 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trtht\" (UniqueName: \"kubernetes.io/projected/4aced56a-7b13-4d13-a18f-b189410b8b07-kube-api-access-trtht\") pod \"multus-additional-cni-plugins-wqkw8\" (UID: \"4aced56a-7b13-4d13-a18f-b189410b8b07\") " pod="openshift-multus/multus-additional-cni-plugins-wqkw8" Jun 03 00:48:51.778047 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.777825 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-host-run-netns\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.778047 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.777854 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-run-systemd\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.778047 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.777880 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3e7de0a9-bca9-4686-b4a4-f4ebeff98128-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bc7sf\" (UID: \"3e7de0a9-bca9-4686-b4a4-f4ebeff98128\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc7sf" Jun 03 00:48:51.778047 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.777889 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-log-socket\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.778047 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.777923 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-host-cni-netd\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.778047 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.777941 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-systemd-units\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.778047 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.777962 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3e7de0a9-bca9-4686-b4a4-f4ebeff98128-registration-dir\") pod \"aws-ebs-csi-driver-node-bc7sf\" (UID: \"3e7de0a9-bca9-4686-b4a4-f4ebeff98128\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc7sf" Jun 03 00:48:51.778047 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.777997 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-host-run-ovn-kubernetes\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.778047 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.777998 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/905babfb-1634-4e78-a4b5-177ab08e7a3d-metrics-certs\") pod \"network-metrics-daemon-x67bk\" (UID: \"905babfb-1634-4e78-a4b5-177ab08e7a3d\") " pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:48:51.778555 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.778085 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6790c8f2-3d7a-4e0e-99b1-16b25e762a43-host-slash\") pod \"iptables-alerter-gwfns\" (UID: \"6790c8f2-3d7a-4e0e-99b1-16b25e762a43\") " pod="openshift-network-operator/iptables-alerter-gwfns" Jun 03 00:48:51.778555 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.778118 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j72n\" (UniqueName: \"kubernetes.io/projected/a5e76234-ae70-4046-8dbe-95f3f0441488-kube-api-access-9j72n\") pod \"network-check-target-cg5ft\" (UID: \"a5e76234-ae70-4046-8dbe-95f3f0441488\") " pod="openshift-network-diagnostics/network-check-target-cg5ft" Jun 03 00:48:51.778555 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.778186 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3e7de0a9-bca9-4686-b4a4-f4ebeff98128-socket-dir\") pod \"aws-ebs-csi-driver-node-bc7sf\" (UID: \"3e7de0a9-bca9-4686-b4a4-f4ebeff98128\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc7sf" Jun 03 00:48:51.778555 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.778224 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-host-kubelet\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.778555 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.778259 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-var-lib-openvswitch\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.778555 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.778294 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-node-log\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.778555 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.778343 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-host-cni-bin\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.778555 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:51.778499 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:48:51.778913 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.778778 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-run-systemd\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.778913 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.778807 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3e7de0a9-bca9-4686-b4a4-f4ebeff98128-registration-dir\") pod \"aws-ebs-csi-driver-node-bc7sf\" (UID: \"3e7de0a9-bca9-4686-b4a4-f4ebeff98128\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc7sf" Jun 03 00:48:51.778913 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.778830 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-etc-openvswitch\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.778913 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.778853 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-host-slash\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.779646 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.779195 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-host-cni-netd\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.779646 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.779274 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c210edda-8849-4277-b258-5b40647200a9-ovnkube-script-lib\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.779646 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.779289 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/68e85fe7-9edc-4ae9-9869-ac61b5746afd-serviceca\") pod \"node-ca-b6chf\" (UID: \"68e85fe7-9edc-4ae9-9869-ac61b5746afd\") " pod="openshift-image-registry/node-ca-b6chf" Jun 03 00:48:51.779646 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.779339 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-node-log\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.779646 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.779366 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-etc-modprobe-d\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.779646 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.779425 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-multus-conf-dir\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.779646 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:51.779460 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/905babfb-1634-4e78-a4b5-177ab08e7a3d-metrics-certs podName:905babfb-1634-4e78-a4b5-177ab08e7a3d nodeName:}" failed. No retries permitted until 2026-06-03 00:48:52.279426979 +0000 UTC m=+2.977797452 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/905babfb-1634-4e78-a4b5-177ab08e7a3d-metrics-certs") pod "network-metrics-daemon-x67bk" (UID: "905babfb-1634-4e78-a4b5-177ab08e7a3d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:48:51.779646 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.779496 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-host-cni-bin\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.780078 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.779858 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c210edda-8849-4277-b258-5b40647200a9-env-overrides\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.780676 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.780290 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3e7de0a9-bca9-4686-b4a4-f4ebeff98128-socket-dir\") pod \"aws-ebs-csi-driver-node-bc7sf\" (UID: \"3e7de0a9-bca9-4686-b4a4-f4ebeff98128\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc7sf" Jun 03 00:48:51.780676 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.780348 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4aced56a-7b13-4d13-a18f-b189410b8b07-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wqkw8\" (UID: \"4aced56a-7b13-4d13-a18f-b189410b8b07\") " pod="openshift-multus/multus-additional-cni-plugins-wqkw8" Jun 03 00:48:51.780676 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.780399 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-log-socket\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.780676 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.780539 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 00:48:51.781032 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.780800 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6790c8f2-3d7a-4e0e-99b1-16b25e762a43-host-slash\") pod \"iptables-alerter-gwfns\" (UID: \"6790c8f2-3d7a-4e0e-99b1-16b25e762a43\") " pod="openshift-network-operator/iptables-alerter-gwfns" Jun 03 00:48:51.781032 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.780875 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-host-run-netns\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.781032 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.780895 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-host-kubelet\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.781032 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.780934 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-var-lib-openvswitch\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.781564 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.781213 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3e7de0a9-bca9-4686-b4a4-f4ebeff98128-etc-selinux\") pod \"aws-ebs-csi-driver-node-bc7sf\" (UID: \"3e7de0a9-bca9-4686-b4a4-f4ebeff98128\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc7sf" Jun 03 00:48:51.781564 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.781285 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-run-openvswitch\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.781564 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.781291 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3e7de0a9-bca9-4686-b4a4-f4ebeff98128-sys-fs\") pod \"aws-ebs-csi-driver-node-bc7sf\" (UID: \"3e7de0a9-bca9-4686-b4a4-f4ebeff98128\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc7sf" Jun 03 00:48:51.781564 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.781346 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d96991ed-c416-44f8-a04e-6f13f5d02ab8-tmp-dir\") pod \"node-resolver-2z5f7\" (UID: \"d96991ed-c416-44f8-a04e-6f13f5d02ab8\") " pod="openshift-dns/node-resolver-2z5f7" Jun 03 00:48:51.781564 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.781504 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-etc-systemd\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.781564 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.781540 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c210edda-8849-4277-b258-5b40647200a9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.781872 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.781601 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b247bdf-26a2-4af4-bee6-ddd65313843e-cni-binary-copy\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.781872 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.781656 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-multus-socket-dir-parent\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.781872 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.781698 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d96991ed-c416-44f8-a04e-6f13f5d02ab8-tmp-dir\") pod \"node-resolver-2z5f7\" (UID: \"d96991ed-c416-44f8-a04e-6f13f5d02ab8\") " pod="openshift-dns/node-resolver-2z5f7" Jun 03 00:48:51.781872 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.781704 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-host-var-lib-kubelet\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.781872 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.781780 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68e85fe7-9edc-4ae9-9869-ac61b5746afd-host\") pod \"node-ca-b6chf\" (UID: \"68e85fe7-9edc-4ae9-9869-ac61b5746afd\") " pod="openshift-image-registry/node-ca-b6chf" Jun 03 00:48:51.781872 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.781853 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4aced56a-7b13-4d13-a18f-b189410b8b07-system-cni-dir\") pod \"multus-additional-cni-plugins-wqkw8\" (UID: \"4aced56a-7b13-4d13-a18f-b189410b8b07\") " pod="openshift-multus/multus-additional-cni-plugins-wqkw8" Jun 03 00:48:51.782144 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.781973 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4aced56a-7b13-4d13-a18f-b189410b8b07-cnibin\") pod \"multus-additional-cni-plugins-wqkw8\" (UID: \"4aced56a-7b13-4d13-a18f-b189410b8b07\") " pod="openshift-multus/multus-additional-cni-plugins-wqkw8" Jun 03 00:48:51.782144 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.782025 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68e85fe7-9edc-4ae9-9869-ac61b5746afd-host\") pod \"node-ca-b6chf\" (UID: \"68e85fe7-9edc-4ae9-9869-ac61b5746afd\") " pod="openshift-image-registry/node-ca-b6chf" Jun 03 00:48:51.782144 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.782077 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-host-run-k8s-cni-cncf-io\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.784988 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.784933 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c210edda-8849-4277-b258-5b40647200a9-ovn-node-metrics-cert\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.785179 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.785109 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwx25\" (UniqueName: \"kubernetes.io/projected/6790c8f2-3d7a-4e0e-99b1-16b25e762a43-kube-api-access-jwx25\") pod \"iptables-alerter-gwfns\" (UID: \"6790c8f2-3d7a-4e0e-99b1-16b25e762a43\") " pod="openshift-network-operator/iptables-alerter-gwfns" Jun 03 00:48:51.785818 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.785794 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b90ee857-e6a3-4a9d-b66c-9dea49751494-agent-certs\") pod \"konnectivity-agent-ncjrr\" (UID: \"b90ee857-e6a3-4a9d-b66c-9dea49751494\") " pod="kube-system/konnectivity-agent-ncjrr" Jun 03 00:48:51.786549 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.786511 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngm7t\" (UniqueName: \"kubernetes.io/projected/905babfb-1634-4e78-a4b5-177ab08e7a3d-kube-api-access-ngm7t\") pod \"network-metrics-daemon-x67bk\" (UID: \"905babfb-1634-4e78-a4b5-177ab08e7a3d\") " pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:48:51.787755 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.787714 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcq82\" (UniqueName: \"kubernetes.io/projected/d96991ed-c416-44f8-a04e-6f13f5d02ab8-kube-api-access-fcq82\") pod \"node-resolver-2z5f7\" (UID: \"d96991ed-c416-44f8-a04e-6f13f5d02ab8\") " pod="openshift-dns/node-resolver-2z5f7" Jun 03 00:48:51.788658 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.788618 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf528\" (UniqueName: \"kubernetes.io/projected/68e85fe7-9edc-4ae9-9869-ac61b5746afd-kube-api-access-xf528\") pod \"node-ca-b6chf\" (UID: \"68e85fe7-9edc-4ae9-9869-ac61b5746afd\") " pod="openshift-image-registry/node-ca-b6chf" Jun 03 00:48:51.789176 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.789154 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hwdl\" (UniqueName: \"kubernetes.io/projected/3e7de0a9-bca9-4686-b4a4-f4ebeff98128-kube-api-access-9hwdl\") pod \"aws-ebs-csi-driver-node-bc7sf\" (UID: \"3e7de0a9-bca9-4686-b4a4-f4ebeff98128\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc7sf" Jun 03 00:48:51.790573 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.790548 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xp4p\" (UniqueName: \"kubernetes.io/projected/c210edda-8849-4277-b258-5b40647200a9-kube-api-access-7xp4p\") pod \"ovnkube-node-k8zww\" (UID: \"c210edda-8849-4277-b258-5b40647200a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.883160 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883126 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-os-release\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.883160 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883162 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-hostroot\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.883382 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883178 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-host-var-lib-cni-multus\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.883382 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883219 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-host-var-lib-cni-multus\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.883382 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883264 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-hostroot\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.883382 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883273 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-os-release\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.883382 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883320 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b247bdf-26a2-4af4-bee6-ddd65313843e-multus-daemon-config\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.883382 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883349 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-etc-kubernetes\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.883382 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883369 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z4h95\" (UniqueName: \"kubernetes.io/projected/8b247bdf-26a2-4af4-bee6-ddd65313843e-kube-api-access-z4h95\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.883756 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883389 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-etc-kubernetes\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.883756 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883411 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-var-lib-kubelet\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.883756 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883445 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-etc-kubernetes\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.883756 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883477 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-var-lib-kubelet\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.883756 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883482 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-etc-kubernetes\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.883756 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883577 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-host-var-lib-cni-bin\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.883756 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883615 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-etc-sysctl-conf\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.883756 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883647 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-lib-modules\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.883756 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883659 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-host-var-lib-cni-bin\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.883756 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883674 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4aced56a-7b13-4d13-a18f-b189410b8b07-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wqkw8\" (UID: \"4aced56a-7b13-4d13-a18f-b189410b8b07\") " pod="openshift-multus/multus-additional-cni-plugins-wqkw8" Jun 03 00:48:51.883756 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883703 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-system-cni-dir\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.883756 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883727 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-multus-cni-dir\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.883756 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883760 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-lib-modules\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.884340 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883770 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-etc-sysconfig\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.884340 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883770 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-etc-sysctl-conf\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.884340 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883806 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-system-cni-dir\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.884340 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883816 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-multus-cni-dir\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.884340 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883818 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-etc-sysconfig\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.884340 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883841 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4aced56a-7b13-4d13-a18f-b189410b8b07-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wqkw8\" (UID: \"4aced56a-7b13-4d13-a18f-b189410b8b07\") " pod="openshift-multus/multus-additional-cni-plugins-wqkw8" Jun 03 00:48:51.884340 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883872 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-host-run-netns\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.884340 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883897 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-host-run-multus-certs\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.884340 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883922 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f2bb47d-1fea-4ff1-9415-06672ecce926-etc-tuned\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.884340 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883931 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-host-run-netns\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.884340 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883940 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4aced56a-7b13-4d13-a18f-b189410b8b07-cni-binary-copy\") pod \"multus-additional-cni-plugins-wqkw8\" (UID: \"4aced56a-7b13-4d13-a18f-b189410b8b07\") " pod="openshift-multus/multus-additional-cni-plugins-wqkw8" Jun 03 00:48:51.884340 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883951 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-host-run-multus-certs\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.884340 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.883973 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-run\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.884340 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884000 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4aced56a-7b13-4d13-a18f-b189410b8b07-os-release\") pod \"multus-additional-cni-plugins-wqkw8\" (UID: \"4aced56a-7b13-4d13-a18f-b189410b8b07\") " pod="openshift-multus/multus-additional-cni-plugins-wqkw8" Jun 03 00:48:51.884340 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884004 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b247bdf-26a2-4af4-bee6-ddd65313843e-multus-daemon-config\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.884340 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884026 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-cnibin\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.884340 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884052 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-host\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.884340 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884069 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-run\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.885164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884079 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-etc-sysctl-d\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.885164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884103 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-sys\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.885164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884126 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2zql7\" (UniqueName: \"kubernetes.io/projected/0f2bb47d-1fea-4ff1-9415-06672ecce926-kube-api-access-2zql7\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.885164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884117 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-cnibin\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.885164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884155 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f2bb47d-1fea-4ff1-9415-06672ecce926-tmp\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.885164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884182 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-trtht\" (UniqueName: \"kubernetes.io/projected/4aced56a-7b13-4d13-a18f-b189410b8b07-kube-api-access-trtht\") pod \"multus-additional-cni-plugins-wqkw8\" (UID: \"4aced56a-7b13-4d13-a18f-b189410b8b07\") " pod="openshift-multus/multus-additional-cni-plugins-wqkw8" Jun 03 00:48:51.885164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884190 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4aced56a-7b13-4d13-a18f-b189410b8b07-os-release\") pod \"multus-additional-cni-plugins-wqkw8\" (UID: \"4aced56a-7b13-4d13-a18f-b189410b8b07\") " pod="openshift-multus/multus-additional-cni-plugins-wqkw8" Jun 03 00:48:51.885164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884233 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9j72n\" (UniqueName: \"kubernetes.io/projected/a5e76234-ae70-4046-8dbe-95f3f0441488-kube-api-access-9j72n\") pod \"network-check-target-cg5ft\" (UID: \"a5e76234-ae70-4046-8dbe-95f3f0441488\") " pod="openshift-network-diagnostics/network-check-target-cg5ft" Jun 03 00:48:51.885164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884258 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-host\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.885164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884264 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-etc-modprobe-d\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.885164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884310 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4aced56a-7b13-4d13-a18f-b189410b8b07-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wqkw8\" (UID: \"4aced56a-7b13-4d13-a18f-b189410b8b07\") " pod="openshift-multus/multus-additional-cni-plugins-wqkw8" Jun 03 00:48:51.885164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884315 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-multus-conf-dir\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.885164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884364 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4aced56a-7b13-4d13-a18f-b189410b8b07-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wqkw8\" (UID: \"4aced56a-7b13-4d13-a18f-b189410b8b07\") " pod="openshift-multus/multus-additional-cni-plugins-wqkw8" Jun 03 00:48:51.885164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884392 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-etc-sysctl-d\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.885164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884392 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-etc-systemd\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.885164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884434 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-etc-systemd\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.885164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884478 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-etc-modprobe-d\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.885953 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884489 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f2bb47d-1fea-4ff1-9415-06672ecce926-sys\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.885953 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884552 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4aced56a-7b13-4d13-a18f-b189410b8b07-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wqkw8\" (UID: \"4aced56a-7b13-4d13-a18f-b189410b8b07\") " pod="openshift-multus/multus-additional-cni-plugins-wqkw8" Jun 03 00:48:51.885953 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884593 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b247bdf-26a2-4af4-bee6-ddd65313843e-cni-binary-copy\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.885953 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884621 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-multus-socket-dir-parent\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.885953 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884645 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-host-var-lib-kubelet\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.885953 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884659 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-multus-conf-dir\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.885953 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884671 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4aced56a-7b13-4d13-a18f-b189410b8b07-system-cni-dir\") pod \"multus-additional-cni-plugins-wqkw8\" (UID: \"4aced56a-7b13-4d13-a18f-b189410b8b07\") " pod="openshift-multus/multus-additional-cni-plugins-wqkw8" Jun 03 00:48:51.885953 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884696 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4aced56a-7b13-4d13-a18f-b189410b8b07-cnibin\") pod \"multus-additional-cni-plugins-wqkw8\" (UID: \"4aced56a-7b13-4d13-a18f-b189410b8b07\") " pod="openshift-multus/multus-additional-cni-plugins-wqkw8" Jun 03 00:48:51.885953 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884715 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-multus-socket-dir-parent\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.885953 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884723 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-host-run-k8s-cni-cncf-io\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.885953 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884773 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-host-var-lib-kubelet\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.885953 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884788 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b247bdf-26a2-4af4-bee6-ddd65313843e-host-run-k8s-cni-cncf-io\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.885953 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884812 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4aced56a-7b13-4d13-a18f-b189410b8b07-cnibin\") pod \"multus-additional-cni-plugins-wqkw8\" (UID: \"4aced56a-7b13-4d13-a18f-b189410b8b07\") " pod="openshift-multus/multus-additional-cni-plugins-wqkw8" Jun 03 00:48:51.885953 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.884827 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4aced56a-7b13-4d13-a18f-b189410b8b07-system-cni-dir\") pod \"multus-additional-cni-plugins-wqkw8\" (UID: \"4aced56a-7b13-4d13-a18f-b189410b8b07\") " pod="openshift-multus/multus-additional-cni-plugins-wqkw8" Jun 03 00:48:51.885953 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.885008 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4aced56a-7b13-4d13-a18f-b189410b8b07-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wqkw8\" (UID: \"4aced56a-7b13-4d13-a18f-b189410b8b07\") " pod="openshift-multus/multus-additional-cni-plugins-wqkw8" Jun 03 00:48:51.885953 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.885152 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b247bdf-26a2-4af4-bee6-ddd65313843e-cni-binary-copy\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.885953 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.885392 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4aced56a-7b13-4d13-a18f-b189410b8b07-cni-binary-copy\") pod \"multus-additional-cni-plugins-wqkw8\" (UID: \"4aced56a-7b13-4d13-a18f-b189410b8b07\") " pod="openshift-multus/multus-additional-cni-plugins-wqkw8" Jun 03 00:48:51.886909 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.886878 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f2bb47d-1fea-4ff1-9415-06672ecce926-etc-tuned\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.886994 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.886928 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f2bb47d-1fea-4ff1-9415-06672ecce926-tmp\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.889490 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:51.889468 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 00:48:51.889604 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:51.889494 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 00:48:51.889604 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:51.889507 2558 projected.go:194] Error preparing data for projected volume kube-api-access-9j72n for pod openshift-network-diagnostics/network-check-target-cg5ft: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:48:51.889604 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:51.889596 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5e76234-ae70-4046-8dbe-95f3f0441488-kube-api-access-9j72n podName:a5e76234-ae70-4046-8dbe-95f3f0441488 nodeName:}" failed. No retries permitted until 2026-06-03 00:48:52.389577551 +0000 UTC m=+3.087948035 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9j72n" (UniqueName: "kubernetes.io/projected/a5e76234-ae70-4046-8dbe-95f3f0441488-kube-api-access-9j72n") pod "network-check-target-cg5ft" (UID: "a5e76234-ae70-4046-8dbe-95f3f0441488") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:48:51.891687 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.891668 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trtht\" (UniqueName: \"kubernetes.io/projected/4aced56a-7b13-4d13-a18f-b189410b8b07-kube-api-access-trtht\") pod \"multus-additional-cni-plugins-wqkw8\" (UID: \"4aced56a-7b13-4d13-a18f-b189410b8b07\") " pod="openshift-multus/multus-additional-cni-plugins-wqkw8" Jun 03 00:48:51.892019 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.892000 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4h95\" (UniqueName: \"kubernetes.io/projected/8b247bdf-26a2-4af4-bee6-ddd65313843e-kube-api-access-z4h95\") pod \"multus-hr85v\" (UID: \"8b247bdf-26a2-4af4-bee6-ddd65313843e\") " pod="openshift-multus/multus-hr85v" Jun 03 00:48:51.892233 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.892212 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zql7\" (UniqueName: \"kubernetes.io/projected/0f2bb47d-1fea-4ff1-9415-06672ecce926-kube-api-access-2zql7\") pod \"tuned-vwdf6\" (UID: \"0f2bb47d-1fea-4ff1-9415-06672ecce926\") " pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:51.972068 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.971976 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gwfns" Jun 03 00:48:51.979646 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.979625 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc7sf" Jun 03 00:48:51.987292 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.987264 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2z5f7" Jun 03 00:48:51.993978 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.993953 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:48:51.999560 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:51.999540 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ncjrr" Jun 03 00:48:52.007081 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:52.007061 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b6chf" Jun 03 00:48:52.013642 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:52.013621 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hr85v" Jun 03 00:48:52.020208 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:52.020189 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" Jun 03 00:48:52.025700 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:52.025681 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wqkw8" Jun 03 00:48:52.151961 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:52.151933 2558 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 00:48:52.286743 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:52.286653 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/905babfb-1634-4e78-a4b5-177ab08e7a3d-metrics-certs\") pod \"network-metrics-daemon-x67bk\" (UID: \"905babfb-1634-4e78-a4b5-177ab08e7a3d\") " pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:48:52.286905 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:52.286810 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:48:52.286905 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:52.286882 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/905babfb-1634-4e78-a4b5-177ab08e7a3d-metrics-certs podName:905babfb-1634-4e78-a4b5-177ab08e7a3d nodeName:}" failed. No retries permitted until 2026-06-03 00:48:53.286863003 +0000 UTC m=+3.985233473 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/905babfb-1634-4e78-a4b5-177ab08e7a3d-metrics-certs") pod "network-metrics-daemon-x67bk" (UID: "905babfb-1634-4e78-a4b5-177ab08e7a3d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:48:52.365504 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:52.365473 2558 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 00:48:52.488253 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:52.488224 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9j72n\" (UniqueName: \"kubernetes.io/projected/a5e76234-ae70-4046-8dbe-95f3f0441488-kube-api-access-9j72n\") pod \"network-check-target-cg5ft\" (UID: \"a5e76234-ae70-4046-8dbe-95f3f0441488\") " pod="openshift-network-diagnostics/network-check-target-cg5ft" Jun 03 00:48:52.488389 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:52.488341 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 00:48:52.488389 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:52.488358 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 00:48:52.488389 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:52.488368 2558 projected.go:194] Error preparing data for projected volume kube-api-access-9j72n for pod openshift-network-diagnostics/network-check-target-cg5ft: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:48:52.488498 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:52.488425 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5e76234-ae70-4046-8dbe-95f3f0441488-kube-api-access-9j72n podName:a5e76234-ae70-4046-8dbe-95f3f0441488 nodeName:}" failed. No retries permitted until 2026-06-03 00:48:53.488400637 +0000 UTC m=+4.186771106 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9j72n" (UniqueName: "kubernetes.io/projected/a5e76234-ae70-4046-8dbe-95f3f0441488-kube-api-access-9j72n") pod "network-check-target-cg5ft" (UID: "a5e76234-ae70-4046-8dbe-95f3f0441488") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:48:52.593896 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:52.593669 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f2bb47d_1fea_4ff1_9415_06672ecce926.slice/crio-bc22848f00118b12569d53766e724f4efa648a2e01833ba96dc123f0c5147df0 WatchSource:0}: Error finding container bc22848f00118b12569d53766e724f4efa648a2e01833ba96dc123f0c5147df0: Status 404 returned error can't find the container with id bc22848f00118b12569d53766e724f4efa648a2e01833ba96dc123f0c5147df0 Jun 03 00:48:52.594651 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:52.594626 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb90ee857_e6a3_4a9d_b66c_9dea49751494.slice/crio-c17593df76209e7093a5bbe947c27ded653bab876cab1ab68a5d7f2e8b47bba6 WatchSource:0}: Error finding container c17593df76209e7093a5bbe947c27ded653bab876cab1ab68a5d7f2e8b47bba6: Status 404 returned error can't find the container with id c17593df76209e7093a5bbe947c27ded653bab876cab1ab68a5d7f2e8b47bba6 Jun 03 00:48:52.600897 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:52.600877 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd96991ed_c416_44f8_a04e_6f13f5d02ab8.slice/crio-2f37d5cb917149a57d9b340b17c39020978211daf44ca2aae2d3959a3a776e9a WatchSource:0}: Error finding container 2f37d5cb917149a57d9b340b17c39020978211daf44ca2aae2d3959a3a776e9a: Status 404 returned error can't find the container with id 2f37d5cb917149a57d9b340b17c39020978211daf44ca2aae2d3959a3a776e9a Jun 03 00:48:52.601661 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:52.601632 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc210edda_8849_4277_b258_5b40647200a9.slice/crio-a5a5876804511d0fa4c3ba81c51dd20a93812dc41494a382ef91f175f3b672fa WatchSource:0}: Error finding container a5a5876804511d0fa4c3ba81c51dd20a93812dc41494a382ef91f175f3b672fa: Status 404 returned error can't find the container with id a5a5876804511d0fa4c3ba81c51dd20a93812dc41494a382ef91f175f3b672fa Jun 03 00:48:52.602152 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:52.602128 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aced56a_7b13_4d13_a18f_b189410b8b07.slice/crio-4de995acdbb7723d89ffe388e49fc1e1278f9829eca58ac94672737e92221ee0 WatchSource:0}: Error finding container 4de995acdbb7723d89ffe388e49fc1e1278f9829eca58ac94672737e92221ee0: Status 404 returned error can't find the container with id 4de995acdbb7723d89ffe388e49fc1e1278f9829eca58ac94672737e92221ee0 Jun 03 00:48:52.603070 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:52.603044 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68e85fe7_9edc_4ae9_9869_ac61b5746afd.slice/crio-4d9572fba531cf8e2eb77e7e39b328c591ee45a3a5fc92988d5618729abcf218 WatchSource:0}: Error finding container 4d9572fba531cf8e2eb77e7e39b328c591ee45a3a5fc92988d5618729abcf218: Status 404 returned error can't find the container with id 4d9572fba531cf8e2eb77e7e39b328c591ee45a3a5fc92988d5618729abcf218 Jun 03 00:48:52.604333 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:52.604302 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e7de0a9_bca9_4686_b4a4_f4ebeff98128.slice/crio-453bfe309866cc172a967c4fcf00a71639bd9064d9c24660ba79f71654e36a73 WatchSource:0}: Error finding container 453bfe309866cc172a967c4fcf00a71639bd9064d9c24660ba79f71654e36a73: Status 404 returned error can't find the container with id 453bfe309866cc172a967c4fcf00a71639bd9064d9c24660ba79f71654e36a73 Jun 03 00:48:52.605384 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:52.605349 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6790c8f2_3d7a_4e0e_99b1_16b25e762a43.slice/crio-85566ecde52f5f939ad8abee2adb69ce247b54429bfb55c0dd827636445a05c9 WatchSource:0}: Error finding container 85566ecde52f5f939ad8abee2adb69ce247b54429bfb55c0dd827636445a05c9: Status 404 returned error can't find the container with id 85566ecde52f5f939ad8abee2adb69ce247b54429bfb55c0dd827636445a05c9 Jun 03 00:48:52.606652 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:48:52.606633 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b247bdf_26a2_4af4_bee6_ddd65313843e.slice/crio-343dec35a56bf34b9c6ac472bbaa29cd1d0c42616a278a146bba6a48d7568098 WatchSource:0}: Error finding container 343dec35a56bf34b9c6ac472bbaa29cd1d0c42616a278a146bba6a48d7568098: Status 404 returned error can't find the container with id 343dec35a56bf34b9c6ac472bbaa29cd1d0c42616a278a146bba6a48d7568098 Jun 03 00:48:52.706210 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:52.706174 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 00:43:50 +0000 UTC" deadline="2028-01-20 09:53:31.872233978 +0000 UTC" Jun 03 00:48:52.706210 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:52.706209 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14313h4m39.166029613s" Jun 03 00:48:52.769061 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:52.769007 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ncjrr" event={"ID":"b90ee857-e6a3-4a9d-b66c-9dea49751494","Type":"ContainerStarted","Data":"c17593df76209e7093a5bbe947c27ded653bab876cab1ab68a5d7f2e8b47bba6"} Jun 03 00:48:52.770051 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:52.770020 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hr85v" event={"ID":"8b247bdf-26a2-4af4-bee6-ddd65313843e","Type":"ContainerStarted","Data":"343dec35a56bf34b9c6ac472bbaa29cd1d0c42616a278a146bba6a48d7568098"} Jun 03 00:48:52.771140 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:52.771118 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" event={"ID":"c210edda-8849-4277-b258-5b40647200a9","Type":"ContainerStarted","Data":"a5a5876804511d0fa4c3ba81c51dd20a93812dc41494a382ef91f175f3b672fa"} Jun 03 00:48:52.772088 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:52.772058 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" event={"ID":"0f2bb47d-1fea-4ff1-9415-06672ecce926","Type":"ContainerStarted","Data":"bc22848f00118b12569d53766e724f4efa648a2e01833ba96dc123f0c5147df0"} Jun 03 00:48:52.773668 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:52.773627 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-48.ec2.internal" event={"ID":"17fe47cc7cb9b1d18b8c5bc4ddf5b79c","Type":"ContainerStarted","Data":"5f60235fdd1fd4595ace8d82d2fbf8cac7d134b8d363f9eb7c9a457e249d60b9"} Jun 03 00:48:52.774774 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:52.774746 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gwfns" event={"ID":"6790c8f2-3d7a-4e0e-99b1-16b25e762a43","Type":"ContainerStarted","Data":"85566ecde52f5f939ad8abee2adb69ce247b54429bfb55c0dd827636445a05c9"} Jun 03 00:48:52.775771 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:52.775751 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc7sf" event={"ID":"3e7de0a9-bca9-4686-b4a4-f4ebeff98128","Type":"ContainerStarted","Data":"453bfe309866cc172a967c4fcf00a71639bd9064d9c24660ba79f71654e36a73"} Jun 03 00:48:52.776810 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:52.776787 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqkw8" event={"ID":"4aced56a-7b13-4d13-a18f-b189410b8b07","Type":"ContainerStarted","Data":"4de995acdbb7723d89ffe388e49fc1e1278f9829eca58ac94672737e92221ee0"} Jun 03 00:48:52.777756 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:52.777738 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b6chf" event={"ID":"68e85fe7-9edc-4ae9-9869-ac61b5746afd","Type":"ContainerStarted","Data":"4d9572fba531cf8e2eb77e7e39b328c591ee45a3a5fc92988d5618729abcf218"} Jun 03 00:48:52.778770 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:52.778742 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2z5f7" event={"ID":"d96991ed-c416-44f8-a04e-6f13f5d02ab8","Type":"ContainerStarted","Data":"2f37d5cb917149a57d9b340b17c39020978211daf44ca2aae2d3959a3a776e9a"} Jun 03 00:48:53.058900 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:53.058713 2558 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 00:48:53.293278 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:53.293193 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/905babfb-1634-4e78-a4b5-177ab08e7a3d-metrics-certs\") pod \"network-metrics-daemon-x67bk\" (UID: \"905babfb-1634-4e78-a4b5-177ab08e7a3d\") " pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:48:53.293436 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:53.293356 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:48:53.293436 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:53.293421 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/905babfb-1634-4e78-a4b5-177ab08e7a3d-metrics-certs podName:905babfb-1634-4e78-a4b5-177ab08e7a3d nodeName:}" failed. No retries permitted until 2026-06-03 00:48:55.293401408 +0000 UTC m=+5.991771884 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/905babfb-1634-4e78-a4b5-177ab08e7a3d-metrics-certs") pod "network-metrics-daemon-x67bk" (UID: "905babfb-1634-4e78-a4b5-177ab08e7a3d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:48:53.494911 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:53.494816 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9j72n\" (UniqueName: \"kubernetes.io/projected/a5e76234-ae70-4046-8dbe-95f3f0441488-kube-api-access-9j72n\") pod \"network-check-target-cg5ft\" (UID: \"a5e76234-ae70-4046-8dbe-95f3f0441488\") " pod="openshift-network-diagnostics/network-check-target-cg5ft" Jun 03 00:48:53.495078 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:53.494995 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 00:48:53.495078 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:53.495014 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 00:48:53.495078 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:53.495026 2558 projected.go:194] Error preparing data for projected volume kube-api-access-9j72n for pod openshift-network-diagnostics/network-check-target-cg5ft: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:48:53.495251 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:53.495085 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5e76234-ae70-4046-8dbe-95f3f0441488-kube-api-access-9j72n podName:a5e76234-ae70-4046-8dbe-95f3f0441488 nodeName:}" failed. No retries permitted until 2026-06-03 00:48:55.495065817 +0000 UTC m=+6.193436292 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9j72n" (UniqueName: "kubernetes.io/projected/a5e76234-ae70-4046-8dbe-95f3f0441488-kube-api-access-9j72n") pod "network-check-target-cg5ft" (UID: "a5e76234-ae70-4046-8dbe-95f3f0441488") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:48:53.763240 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:53.762616 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg5ft" Jun 03 00:48:53.763240 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:53.762675 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:48:53.763240 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:53.762785 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x67bk" podUID="905babfb-1634-4e78-a4b5-177ab08e7a3d" Jun 03 00:48:53.763240 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:53.763188 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg5ft" podUID="a5e76234-ae70-4046-8dbe-95f3f0441488" Jun 03 00:48:53.793770 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:53.793732 2558 generic.go:358] "Generic (PLEG): container finished" podID="5d5c49d9c12538ee9e97947ca31da9a9" containerID="e8452b5ca0ddded77cb7221320323bcb6b1135b0a724b0a50b810e712426a65e" exitCode=0 Jun 03 00:48:53.794821 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:53.794793 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-48.ec2.internal" event={"ID":"5d5c49d9c12538ee9e97947ca31da9a9","Type":"ContainerDied","Data":"e8452b5ca0ddded77cb7221320323bcb6b1135b0a724b0a50b810e712426a65e"} Jun 03 00:48:53.810237 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:53.810183 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-48.ec2.internal" podStartSLOduration=2.8101639 podStartE2EDuration="2.8101639s" podCreationTimestamp="2026-06-03 00:48:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:48:52.787934923 +0000 UTC m=+3.486305409" watchObservedRunningTime="2026-06-03 00:48:53.8101639 +0000 UTC m=+4.508534394" Jun 03 00:48:54.814871 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:54.814833 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-48.ec2.internal" event={"ID":"5d5c49d9c12538ee9e97947ca31da9a9","Type":"ContainerStarted","Data":"a734d013bb84e32516aba4255704b0994d142ff14fb1399c33e990c60024a41c"} Jun 03 00:48:55.310619 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:55.309926 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/905babfb-1634-4e78-a4b5-177ab08e7a3d-metrics-certs\") pod \"network-metrics-daemon-x67bk\" (UID: \"905babfb-1634-4e78-a4b5-177ab08e7a3d\") " pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:48:55.310619 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:55.310172 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:48:55.310619 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:55.310235 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/905babfb-1634-4e78-a4b5-177ab08e7a3d-metrics-certs podName:905babfb-1634-4e78-a4b5-177ab08e7a3d nodeName:}" failed. No retries permitted until 2026-06-03 00:48:59.310217142 +0000 UTC m=+10.008587624 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/905babfb-1634-4e78-a4b5-177ab08e7a3d-metrics-certs") pod "network-metrics-daemon-x67bk" (UID: "905babfb-1634-4e78-a4b5-177ab08e7a3d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:48:55.512541 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:55.512147 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9j72n\" (UniqueName: \"kubernetes.io/projected/a5e76234-ae70-4046-8dbe-95f3f0441488-kube-api-access-9j72n\") pod \"network-check-target-cg5ft\" (UID: \"a5e76234-ae70-4046-8dbe-95f3f0441488\") " pod="openshift-network-diagnostics/network-check-target-cg5ft" Jun 03 00:48:55.512541 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:55.512325 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 00:48:55.512541 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:55.512347 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 00:48:55.512541 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:55.512360 2558 projected.go:194] Error preparing data for projected volume kube-api-access-9j72n for pod openshift-network-diagnostics/network-check-target-cg5ft: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:48:55.512541 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:55.512420 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5e76234-ae70-4046-8dbe-95f3f0441488-kube-api-access-9j72n podName:a5e76234-ae70-4046-8dbe-95f3f0441488 nodeName:}" failed. No retries permitted until 2026-06-03 00:48:59.512402747 +0000 UTC m=+10.210773219 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9j72n" (UniqueName: "kubernetes.io/projected/a5e76234-ae70-4046-8dbe-95f3f0441488-kube-api-access-9j72n") pod "network-check-target-cg5ft" (UID: "a5e76234-ae70-4046-8dbe-95f3f0441488") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:48:55.762168 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:55.762071 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg5ft" Jun 03 00:48:55.762320 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:55.762208 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg5ft" podUID="a5e76234-ae70-4046-8dbe-95f3f0441488" Jun 03 00:48:55.762320 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:55.762261 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:48:55.762440 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:55.762381 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x67bk" podUID="905babfb-1634-4e78-a4b5-177ab08e7a3d" Jun 03 00:48:57.763310 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:57.762784 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:48:57.763310 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:57.762789 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg5ft" Jun 03 00:48:57.763310 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:57.762925 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x67bk" podUID="905babfb-1634-4e78-a4b5-177ab08e7a3d" Jun 03 00:48:57.763310 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:57.762981 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg5ft" podUID="a5e76234-ae70-4046-8dbe-95f3f0441488" Jun 03 00:48:59.345438 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:59.345345 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/905babfb-1634-4e78-a4b5-177ab08e7a3d-metrics-certs\") pod \"network-metrics-daemon-x67bk\" (UID: \"905babfb-1634-4e78-a4b5-177ab08e7a3d\") " pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:48:59.345933 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:59.345512 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:48:59.345933 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:59.345609 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/905babfb-1634-4e78-a4b5-177ab08e7a3d-metrics-certs podName:905babfb-1634-4e78-a4b5-177ab08e7a3d nodeName:}" failed. No retries permitted until 2026-06-03 00:49:07.34558801 +0000 UTC m=+18.043958496 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/905babfb-1634-4e78-a4b5-177ab08e7a3d-metrics-certs") pod "network-metrics-daemon-x67bk" (UID: "905babfb-1634-4e78-a4b5-177ab08e7a3d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:48:59.457837 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:59.457773 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-48.ec2.internal" podStartSLOduration=8.457752251 podStartE2EDuration="8.457752251s" podCreationTimestamp="2026-06-03 00:48:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:48:54.830494388 +0000 UTC m=+5.528864896" watchObservedRunningTime="2026-06-03 00:48:59.457752251 +0000 UTC m=+10.156122745" Jun 03 00:48:59.457989 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:59.457948 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-f2dq6"] Jun 03 00:48:59.461029 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:59.461005 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2dq6" Jun 03 00:48:59.461163 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:59.461081 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2dq6" podUID="da35388a-fef5-4cb2-865b-40d260126f3b" Jun 03 00:48:59.547025 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:59.546986 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da35388a-fef5-4cb2-865b-40d260126f3b-original-pull-secret\") pod \"global-pull-secret-syncer-f2dq6\" (UID: \"da35388a-fef5-4cb2-865b-40d260126f3b\") " pod="kube-system/global-pull-secret-syncer-f2dq6" Jun 03 00:48:59.547203 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:59.547066 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9j72n\" (UniqueName: \"kubernetes.io/projected/a5e76234-ae70-4046-8dbe-95f3f0441488-kube-api-access-9j72n\") pod \"network-check-target-cg5ft\" (UID: \"a5e76234-ae70-4046-8dbe-95f3f0441488\") " pod="openshift-network-diagnostics/network-check-target-cg5ft" Jun 03 00:48:59.547203 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:59.547119 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/da35388a-fef5-4cb2-865b-40d260126f3b-kubelet-config\") pod \"global-pull-secret-syncer-f2dq6\" (UID: \"da35388a-fef5-4cb2-865b-40d260126f3b\") " pod="kube-system/global-pull-secret-syncer-f2dq6" Jun 03 00:48:59.547203 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:59.547151 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/da35388a-fef5-4cb2-865b-40d260126f3b-dbus\") pod \"global-pull-secret-syncer-f2dq6\" (UID: \"da35388a-fef5-4cb2-865b-40d260126f3b\") " pod="kube-system/global-pull-secret-syncer-f2dq6" Jun 03 00:48:59.547381 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:59.547253 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 00:48:59.547381 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:59.547281 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 00:48:59.547381 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:59.547296 2558 projected.go:194] Error preparing data for projected volume kube-api-access-9j72n for pod openshift-network-diagnostics/network-check-target-cg5ft: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:48:59.547381 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:59.547360 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5e76234-ae70-4046-8dbe-95f3f0441488-kube-api-access-9j72n podName:a5e76234-ae70-4046-8dbe-95f3f0441488 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:07.547341317 +0000 UTC m=+18.245711804 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9j72n" (UniqueName: "kubernetes.io/projected/a5e76234-ae70-4046-8dbe-95f3f0441488-kube-api-access-9j72n") pod "network-check-target-cg5ft" (UID: "a5e76234-ae70-4046-8dbe-95f3f0441488") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:48:59.647893 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:59.647788 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/da35388a-fef5-4cb2-865b-40d260126f3b-kubelet-config\") pod \"global-pull-secret-syncer-f2dq6\" (UID: \"da35388a-fef5-4cb2-865b-40d260126f3b\") " pod="kube-system/global-pull-secret-syncer-f2dq6" Jun 03 00:48:59.647893 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:59.647833 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/da35388a-fef5-4cb2-865b-40d260126f3b-dbus\") pod \"global-pull-secret-syncer-f2dq6\" (UID: \"da35388a-fef5-4cb2-865b-40d260126f3b\") " pod="kube-system/global-pull-secret-syncer-f2dq6" Jun 03 00:48:59.648097 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:59.647923 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da35388a-fef5-4cb2-865b-40d260126f3b-original-pull-secret\") pod \"global-pull-secret-syncer-f2dq6\" (UID: \"da35388a-fef5-4cb2-865b-40d260126f3b\") " pod="kube-system/global-pull-secret-syncer-f2dq6" Jun 03 00:48:59.648097 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:59.647938 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/da35388a-fef5-4cb2-865b-40d260126f3b-kubelet-config\") pod \"global-pull-secret-syncer-f2dq6\" (UID: \"da35388a-fef5-4cb2-865b-40d260126f3b\") " pod="kube-system/global-pull-secret-syncer-f2dq6" Jun 03 00:48:59.648097 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:59.648087 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 00:48:59.648223 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:59.648118 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/da35388a-fef5-4cb2-865b-40d260126f3b-dbus\") pod \"global-pull-secret-syncer-f2dq6\" (UID: \"da35388a-fef5-4cb2-865b-40d260126f3b\") " pod="kube-system/global-pull-secret-syncer-f2dq6" Jun 03 00:48:59.648223 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:59.648161 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da35388a-fef5-4cb2-865b-40d260126f3b-original-pull-secret podName:da35388a-fef5-4cb2-865b-40d260126f3b nodeName:}" failed. No retries permitted until 2026-06-03 00:49:00.148141548 +0000 UTC m=+10.846512032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da35388a-fef5-4cb2-865b-40d260126f3b-original-pull-secret") pod "global-pull-secret-syncer-f2dq6" (UID: "da35388a-fef5-4cb2-865b-40d260126f3b") : object "kube-system"/"original-pull-secret" not registered Jun 03 00:48:59.762916 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:59.762884 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg5ft" Jun 03 00:48:59.763077 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:59.763006 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg5ft" podUID="a5e76234-ae70-4046-8dbe-95f3f0441488" Jun 03 00:48:59.763866 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:48:59.763838 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:48:59.764054 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:48:59.764012 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x67bk" podUID="905babfb-1634-4e78-a4b5-177ab08e7a3d" Jun 03 00:49:00.152024 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:00.151960 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da35388a-fef5-4cb2-865b-40d260126f3b-original-pull-secret\") pod \"global-pull-secret-syncer-f2dq6\" (UID: \"da35388a-fef5-4cb2-865b-40d260126f3b\") " pod="kube-system/global-pull-secret-syncer-f2dq6" Jun 03 00:49:00.152231 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:00.152165 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 00:49:00.152292 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:00.152237 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da35388a-fef5-4cb2-865b-40d260126f3b-original-pull-secret podName:da35388a-fef5-4cb2-865b-40d260126f3b nodeName:}" failed. No retries permitted until 2026-06-03 00:49:01.152215485 +0000 UTC m=+11.850585960 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da35388a-fef5-4cb2-865b-40d260126f3b-original-pull-secret") pod "global-pull-secret-syncer-f2dq6" (UID: "da35388a-fef5-4cb2-865b-40d260126f3b") : object "kube-system"/"original-pull-secret" not registered Jun 03 00:49:00.762829 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:00.762791 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2dq6" Jun 03 00:49:00.763242 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:00.762914 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2dq6" podUID="da35388a-fef5-4cb2-865b-40d260126f3b" Jun 03 00:49:01.159627 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:01.159584 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da35388a-fef5-4cb2-865b-40d260126f3b-original-pull-secret\") pod \"global-pull-secret-syncer-f2dq6\" (UID: \"da35388a-fef5-4cb2-865b-40d260126f3b\") " pod="kube-system/global-pull-secret-syncer-f2dq6" Jun 03 00:49:01.159794 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:01.159736 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 00:49:01.159886 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:01.159813 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da35388a-fef5-4cb2-865b-40d260126f3b-original-pull-secret podName:da35388a-fef5-4cb2-865b-40d260126f3b nodeName:}" failed. No retries permitted until 2026-06-03 00:49:03.15979331 +0000 UTC m=+13.858163795 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da35388a-fef5-4cb2-865b-40d260126f3b-original-pull-secret") pod "global-pull-secret-syncer-f2dq6" (UID: "da35388a-fef5-4cb2-865b-40d260126f3b") : object "kube-system"/"original-pull-secret" not registered Jun 03 00:49:01.762593 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:01.762550 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg5ft" Jun 03 00:49:01.762779 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:01.762690 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg5ft" podUID="a5e76234-ae70-4046-8dbe-95f3f0441488" Jun 03 00:49:01.762779 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:01.762550 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:49:01.762889 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:01.762846 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x67bk" podUID="905babfb-1634-4e78-a4b5-177ab08e7a3d" Jun 03 00:49:02.762107 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:02.762024 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2dq6" Jun 03 00:49:02.762351 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:02.762168 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2dq6" podUID="da35388a-fef5-4cb2-865b-40d260126f3b" Jun 03 00:49:03.177958 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:03.177915 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da35388a-fef5-4cb2-865b-40d260126f3b-original-pull-secret\") pod \"global-pull-secret-syncer-f2dq6\" (UID: \"da35388a-fef5-4cb2-865b-40d260126f3b\") " pod="kube-system/global-pull-secret-syncer-f2dq6" Jun 03 00:49:03.178381 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:03.178071 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 00:49:03.178381 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:03.178151 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da35388a-fef5-4cb2-865b-40d260126f3b-original-pull-secret podName:da35388a-fef5-4cb2-865b-40d260126f3b nodeName:}" failed. No retries permitted until 2026-06-03 00:49:07.178131548 +0000 UTC m=+17.876502021 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da35388a-fef5-4cb2-865b-40d260126f3b-original-pull-secret") pod "global-pull-secret-syncer-f2dq6" (UID: "da35388a-fef5-4cb2-865b-40d260126f3b") : object "kube-system"/"original-pull-secret" not registered Jun 03 00:49:03.762664 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:03.762626 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:49:03.762850 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:03.762761 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x67bk" podUID="905babfb-1634-4e78-a4b5-177ab08e7a3d" Jun 03 00:49:03.762850 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:03.762809 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg5ft" Jun 03 00:49:03.762965 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:03.762906 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg5ft" podUID="a5e76234-ae70-4046-8dbe-95f3f0441488" Jun 03 00:49:04.762773 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:04.762735 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2dq6" Jun 03 00:49:04.763241 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:04.762852 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2dq6" podUID="da35388a-fef5-4cb2-865b-40d260126f3b" Jun 03 00:49:05.762826 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:05.762786 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg5ft" Jun 03 00:49:05.763297 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:05.762784 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:49:05.763297 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:05.762922 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg5ft" podUID="a5e76234-ae70-4046-8dbe-95f3f0441488" Jun 03 00:49:05.763297 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:05.763034 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x67bk" podUID="905babfb-1634-4e78-a4b5-177ab08e7a3d" Jun 03 00:49:06.761881 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:06.761843 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2dq6" Jun 03 00:49:06.762049 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:06.761966 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2dq6" podUID="da35388a-fef5-4cb2-865b-40d260126f3b" Jun 03 00:49:07.204800 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:07.204761 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da35388a-fef5-4cb2-865b-40d260126f3b-original-pull-secret\") pod \"global-pull-secret-syncer-f2dq6\" (UID: \"da35388a-fef5-4cb2-865b-40d260126f3b\") " pod="kube-system/global-pull-secret-syncer-f2dq6" Jun 03 00:49:07.205254 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:07.204953 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 00:49:07.205254 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:07.205023 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da35388a-fef5-4cb2-865b-40d260126f3b-original-pull-secret podName:da35388a-fef5-4cb2-865b-40d260126f3b nodeName:}" failed. No retries permitted until 2026-06-03 00:49:15.20500301 +0000 UTC m=+25.903373482 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da35388a-fef5-4cb2-865b-40d260126f3b-original-pull-secret") pod "global-pull-secret-syncer-f2dq6" (UID: "da35388a-fef5-4cb2-865b-40d260126f3b") : object "kube-system"/"original-pull-secret" not registered Jun 03 00:49:07.406883 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:07.406844 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/905babfb-1634-4e78-a4b5-177ab08e7a3d-metrics-certs\") pod \"network-metrics-daemon-x67bk\" (UID: \"905babfb-1634-4e78-a4b5-177ab08e7a3d\") " pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:49:07.407053 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:07.406978 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:49:07.407053 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:07.407038 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/905babfb-1634-4e78-a4b5-177ab08e7a3d-metrics-certs podName:905babfb-1634-4e78-a4b5-177ab08e7a3d nodeName:}" failed. No retries permitted until 2026-06-03 00:49:23.407024494 +0000 UTC m=+34.105394969 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/905babfb-1634-4e78-a4b5-177ab08e7a3d-metrics-certs") pod "network-metrics-daemon-x67bk" (UID: "905babfb-1634-4e78-a4b5-177ab08e7a3d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:49:07.608959 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:07.608912 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9j72n\" (UniqueName: \"kubernetes.io/projected/a5e76234-ae70-4046-8dbe-95f3f0441488-kube-api-access-9j72n\") pod \"network-check-target-cg5ft\" (UID: \"a5e76234-ae70-4046-8dbe-95f3f0441488\") " pod="openshift-network-diagnostics/network-check-target-cg5ft" Jun 03 00:49:07.609157 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:07.609061 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 00:49:07.609157 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:07.609090 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 00:49:07.609157 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:07.609104 2558 projected.go:194] Error preparing data for projected volume kube-api-access-9j72n for pod openshift-network-diagnostics/network-check-target-cg5ft: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:49:07.609312 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:07.609170 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5e76234-ae70-4046-8dbe-95f3f0441488-kube-api-access-9j72n podName:a5e76234-ae70-4046-8dbe-95f3f0441488 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:23.609148194 +0000 UTC m=+34.307518663 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9j72n" (UniqueName: "kubernetes.io/projected/a5e76234-ae70-4046-8dbe-95f3f0441488-kube-api-access-9j72n") pod "network-check-target-cg5ft" (UID: "a5e76234-ae70-4046-8dbe-95f3f0441488") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:49:07.762764 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:07.762730 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:49:07.762943 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:07.762866 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x67bk" podUID="905babfb-1634-4e78-a4b5-177ab08e7a3d" Jun 03 00:49:07.762943 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:07.762901 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg5ft" Jun 03 00:49:07.763049 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:07.763012 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg5ft" podUID="a5e76234-ae70-4046-8dbe-95f3f0441488" Jun 03 00:49:08.762026 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:08.761980 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2dq6" Jun 03 00:49:08.762442 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:08.762115 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2dq6" podUID="da35388a-fef5-4cb2-865b-40d260126f3b" Jun 03 00:49:09.763086 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:09.763050 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg5ft" Jun 03 00:49:09.763570 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:09.763140 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg5ft" podUID="a5e76234-ae70-4046-8dbe-95f3f0441488" Jun 03 00:49:09.763570 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:09.763246 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:49:09.763570 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:09.763365 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x67bk" podUID="905babfb-1634-4e78-a4b5-177ab08e7a3d" Jun 03 00:49:10.762610 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:10.762585 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2dq6" Jun 03 00:49:10.762735 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:10.762711 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2dq6" podUID="da35388a-fef5-4cb2-865b-40d260126f3b" Jun 03 00:49:11.762406 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:11.762070 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:49:11.763325 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:11.762083 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg5ft" Jun 03 00:49:11.763325 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:11.762536 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x67bk" podUID="905babfb-1634-4e78-a4b5-177ab08e7a3d" Jun 03 00:49:11.763325 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:11.762630 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg5ft" podUID="a5e76234-ae70-4046-8dbe-95f3f0441488" Jun 03 00:49:11.850539 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:11.850484 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2z5f7" event={"ID":"d96991ed-c416-44f8-a04e-6f13f5d02ab8","Type":"ContainerStarted","Data":"9a1ae52e529ac63ddac49ec533ae111bf1b154d2171b74c598b1a154d98dcc69"} Jun 03 00:49:11.851979 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:11.851950 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ncjrr" event={"ID":"b90ee857-e6a3-4a9d-b66c-9dea49751494","Type":"ContainerStarted","Data":"5f028b44390e53b175f05e6b20b8b785a0a051dfd5ed3ba628fac7a18243b9ac"} Jun 03 00:49:11.853487 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:11.853456 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hr85v" event={"ID":"8b247bdf-26a2-4af4-bee6-ddd65313843e","Type":"ContainerStarted","Data":"8ec2f9840fcd8a6f52a6527c467ad61ad73c8c6f2c8e6279c75f95367d86e47f"} Jun 03 00:49:11.856362 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:11.856328 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8zww_c210edda-8849-4277-b258-5b40647200a9/ovn-acl-logging/0.log" Jun 03 00:49:11.856703 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:11.856682 2558 generic.go:358] "Generic (PLEG): container finished" podID="c210edda-8849-4277-b258-5b40647200a9" containerID="f366c8c5652d7471b324b77cfcfd05bfa14e6be3cab4c395a99c8d70b2ad336a" exitCode=1 Jun 03 00:49:11.856804 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:11.856746 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" event={"ID":"c210edda-8849-4277-b258-5b40647200a9","Type":"ContainerStarted","Data":"ed11f5777e66c2ef8ca17e0478cafa6b4ea159eb991708552300bedf8ae4e62d"} Jun 03 00:49:11.856804 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:11.856779 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" event={"ID":"c210edda-8849-4277-b258-5b40647200a9","Type":"ContainerStarted","Data":"20e9a9a79ce7d54608169b2ca6c91d6665d8535020d0e14d975d51b8b30c76a1"} Jun 03 00:49:11.856804 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:11.856794 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" event={"ID":"c210edda-8849-4277-b258-5b40647200a9","Type":"ContainerStarted","Data":"b932d89c351ed5de8038938ad2c8b136bda76e636046409e2a150027296230fd"} Jun 03 00:49:11.856913 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:11.856813 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" event={"ID":"c210edda-8849-4277-b258-5b40647200a9","Type":"ContainerStarted","Data":"6f8ed1259ab9bbb0fe45de4ae71a843d02a3285bf5ac394e6d9d84469cda0612"} Jun 03 00:49:11.856913 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:11.856827 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" event={"ID":"c210edda-8849-4277-b258-5b40647200a9","Type":"ContainerDied","Data":"f366c8c5652d7471b324b77cfcfd05bfa14e6be3cab4c395a99c8d70b2ad336a"} Jun 03 00:49:11.856913 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:11.856842 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" event={"ID":"c210edda-8849-4277-b258-5b40647200a9","Type":"ContainerStarted","Data":"40ab84a3da323825177b2a69a96f1d6fa6504b33352f189ea0876bd8fb430e64"} Jun 03 00:49:11.858023 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:11.858001 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" event={"ID":"0f2bb47d-1fea-4ff1-9415-06672ecce926","Type":"ContainerStarted","Data":"f943da03550d93fbcb2dc3901f19c626ad4903747477f7d1a174d5503c2e1766"} Jun 03 00:49:11.859160 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:11.859140 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc7sf" event={"ID":"3e7de0a9-bca9-4686-b4a4-f4ebeff98128","Type":"ContainerStarted","Data":"8f5c85a470b6035d31b1554c91d70301cef83b1ecdf703de4d0dce2f7ff4bf8b"} Jun 03 00:49:11.860376 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:11.860358 2558 generic.go:358] "Generic (PLEG): container finished" podID="4aced56a-7b13-4d13-a18f-b189410b8b07" containerID="512509f81d8ead50caa9006373d5b8acfb4c562c6260841fd831dbeea05069c4" exitCode=0 Jun 03 00:49:11.860456 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:11.860411 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqkw8" event={"ID":"4aced56a-7b13-4d13-a18f-b189410b8b07","Type":"ContainerDied","Data":"512509f81d8ead50caa9006373d5b8acfb4c562c6260841fd831dbeea05069c4"} Jun 03 00:49:11.861702 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:11.861682 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b6chf" event={"ID":"68e85fe7-9edc-4ae9-9869-ac61b5746afd","Type":"ContainerStarted","Data":"41d641bf7f6eb1d6b5808070251e9efd0ac21fb47e4ffffb952f15ee8cf5228e"} Jun 03 00:49:11.877140 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:11.877097 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ncjrr" podStartSLOduration=4.18107977 podStartE2EDuration="21.877084452s" podCreationTimestamp="2026-06-03 00:48:50 +0000 UTC" firstStartedPulling="2026-06-03 00:48:52.598805966 +0000 UTC m=+3.297176436" lastFinishedPulling="2026-06-03 00:49:10.294810647 +0000 UTC m=+20.993181118" observedRunningTime="2026-06-03 00:49:11.876763292 +0000 UTC m=+22.575133784" watchObservedRunningTime="2026-06-03 00:49:11.877084452 +0000 UTC m=+22.575454945" Jun 03 00:49:11.877240 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:11.877219 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-2z5f7" podStartSLOduration=4.781045323 podStartE2EDuration="22.877215558s" podCreationTimestamp="2026-06-03 00:48:49 +0000 UTC" firstStartedPulling="2026-06-03 00:48:52.603017431 +0000 UTC m=+3.301387915" lastFinishedPulling="2026-06-03 00:49:10.699187675 +0000 UTC m=+21.397558150" observedRunningTime="2026-06-03 00:49:11.864246269 +0000 UTC m=+22.562616760" watchObservedRunningTime="2026-06-03 00:49:11.877215558 +0000 UTC m=+22.575586049" Jun 03 00:49:11.889132 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:11.889096 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b6chf" podStartSLOduration=12.010069546 podStartE2EDuration="21.889085743s" podCreationTimestamp="2026-06-03 00:48:50 +0000 UTC" firstStartedPulling="2026-06-03 00:48:52.605344904 +0000 UTC m=+3.303715380" lastFinishedPulling="2026-06-03 00:49:02.484361096 +0000 UTC m=+13.182731577" observedRunningTime="2026-06-03 00:49:11.889001153 +0000 UTC m=+22.587371644" watchObservedRunningTime="2026-06-03 00:49:11.889085743 +0000 UTC m=+22.587456235" Jun 03 00:49:11.904837 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:11.904787 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vwdf6" podStartSLOduration=3.772966441 podStartE2EDuration="21.904776945s" podCreationTimestamp="2026-06-03 00:48:50 +0000 UTC" firstStartedPulling="2026-06-03 00:48:52.596097732 +0000 UTC m=+3.294468213" lastFinishedPulling="2026-06-03 00:49:10.727908232 +0000 UTC m=+21.426278717" observedRunningTime="2026-06-03 00:49:11.904601841 +0000 UTC m=+22.602972332" watchObservedRunningTime="2026-06-03 00:49:11.904776945 +0000 UTC m=+22.603147436" Jun 03 00:49:11.923103 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:11.923061 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-hr85v" podStartSLOduration=3.795786325 podStartE2EDuration="21.923047832s" podCreationTimestamp="2026-06-03 00:48:50 +0000 UTC" firstStartedPulling="2026-06-03 00:48:52.608672172 +0000 UTC m=+3.307042647" lastFinishedPulling="2026-06-03 00:49:10.735933679 +0000 UTC m=+21.434304154" observedRunningTime="2026-06-03 00:49:11.922364987 +0000 UTC m=+22.620735479" watchObservedRunningTime="2026-06-03 00:49:11.923047832 +0000 UTC m=+22.621418325" Jun 03 00:49:11.978292 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:11.978268 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 00:49:12.735244 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:12.734950 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T00:49:11.978287121Z","UUID":"f2c509e3-fb07-455e-b623-b3c7ab07cf01","Handler":null,"Name":"","Endpoint":""} Jun 03 00:49:12.737498 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:12.737467 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 00:49:12.737638 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:12.737535 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 00:49:12.761893 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:12.761863 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2dq6" Jun 03 00:49:12.762050 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:12.761974 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2dq6" podUID="da35388a-fef5-4cb2-865b-40d260126f3b" Jun 03 00:49:12.867271 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:12.867235 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gwfns" event={"ID":"6790c8f2-3d7a-4e0e-99b1-16b25e762a43","Type":"ContainerStarted","Data":"316e1f7ac0c604fb782159ada29b8fc62e1318b9d123d36c57d2b155fc73e2d2"} Jun 03 00:49:12.869869 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:12.869828 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc7sf" event={"ID":"3e7de0a9-bca9-4686-b4a4-f4ebeff98128","Type":"ContainerStarted","Data":"6b0a7341eba2f4685dcc5f40c4c03c64bb40289d13ae2cda98db4d5fec698b09"} Jun 03 00:49:12.881341 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:12.881300 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gwfns" podStartSLOduration=6.193761133 podStartE2EDuration="23.881287063s" podCreationTimestamp="2026-06-03 00:48:49 +0000 UTC" firstStartedPulling="2026-06-03 00:48:52.607297496 +0000 UTC m=+3.305667980" lastFinishedPulling="2026-06-03 00:49:10.294823426 +0000 UTC m=+20.993193910" observedRunningTime="2026-06-03 00:49:12.88098959 +0000 UTC m=+23.579360082" watchObservedRunningTime="2026-06-03 00:49:12.881287063 +0000 UTC m=+23.579657554" Jun 03 00:49:13.235597 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:13.235563 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ncjrr" Jun 03 00:49:13.236224 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:13.236207 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ncjrr" Jun 03 00:49:13.762963 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:13.762867 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg5ft" Jun 03 00:49:13.763131 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:13.762867 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:49:13.763131 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:13.762983 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg5ft" podUID="a5e76234-ae70-4046-8dbe-95f3f0441488" Jun 03 00:49:13.763131 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:13.763085 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x67bk" podUID="905babfb-1634-4e78-a4b5-177ab08e7a3d" Jun 03 00:49:13.872727 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:13.872693 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc7sf" event={"ID":"3e7de0a9-bca9-4686-b4a4-f4ebeff98128","Type":"ContainerStarted","Data":"f74f2fc539b293ab3e6c41ee5e3a367a958cc58a15d79c4e67ecabe3e52b441c"} Jun 03 00:49:13.874957 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:13.874940 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8zww_c210edda-8849-4277-b258-5b40647200a9/ovn-acl-logging/0.log" Jun 03 00:49:13.875207 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:13.875184 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" event={"ID":"c210edda-8849-4277-b258-5b40647200a9","Type":"ContainerStarted","Data":"cf414b1bddd87f11cb93537773fb8b70c2f792c2d511c01ef3b035112fa42ee2"} Jun 03 00:49:14.761847 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:14.761819 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2dq6" Jun 03 00:49:14.762024 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:14.761917 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2dq6" podUID="da35388a-fef5-4cb2-865b-40d260126f3b" Jun 03 00:49:14.876685 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:14.876653 2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 00:49:15.270283 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:15.270244 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da35388a-fef5-4cb2-865b-40d260126f3b-original-pull-secret\") pod \"global-pull-secret-syncer-f2dq6\" (UID: \"da35388a-fef5-4cb2-865b-40d260126f3b\") " pod="kube-system/global-pull-secret-syncer-f2dq6" Jun 03 00:49:15.270454 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:15.270377 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 00:49:15.270454 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:15.270437 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da35388a-fef5-4cb2-865b-40d260126f3b-original-pull-secret podName:da35388a-fef5-4cb2-865b-40d260126f3b nodeName:}" failed. No retries permitted until 2026-06-03 00:49:31.270420427 +0000 UTC m=+41.968790900 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da35388a-fef5-4cb2-865b-40d260126f3b-original-pull-secret") pod "global-pull-secret-syncer-f2dq6" (UID: "da35388a-fef5-4cb2-865b-40d260126f3b") : object "kube-system"/"original-pull-secret" not registered Jun 03 00:49:15.762371 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:15.762182 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg5ft" Jun 03 00:49:15.762596 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:15.762194 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:49:15.762596 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:15.762458 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg5ft" podUID="a5e76234-ae70-4046-8dbe-95f3f0441488" Jun 03 00:49:15.762596 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:15.762543 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x67bk" podUID="905babfb-1634-4e78-a4b5-177ab08e7a3d" Jun 03 00:49:15.881901 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:15.881871 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8zww_c210edda-8849-4277-b258-5b40647200a9/ovn-acl-logging/0.log" Jun 03 00:49:15.882464 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:15.882165 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" event={"ID":"c210edda-8849-4277-b258-5b40647200a9","Type":"ContainerStarted","Data":"e2ac0cd79df6ee173107254472c23234d8debf24d4e362c3b6e72c837578919e"} Jun 03 00:49:15.882542 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:15.882491 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:49:15.882542 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:15.882542 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:49:15.882743 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:15.882723 2558 scope.go:117] "RemoveContainer" containerID="f366c8c5652d7471b324b77cfcfd05bfa14e6be3cab4c395a99c8d70b2ad336a" Jun 03 00:49:15.898384 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:15.898348 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:49:15.907658 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:15.907615 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc7sf" podStartSLOduration=6.599144982 podStartE2EDuration="26.907599709s" podCreationTimestamp="2026-06-03 00:48:49 +0000 UTC" firstStartedPulling="2026-06-03 00:48:52.606504916 +0000 UTC m=+3.304875393" lastFinishedPulling="2026-06-03 00:49:12.91495965 +0000 UTC m=+23.613330120" observedRunningTime="2026-06-03 00:49:13.888753517 +0000 UTC m=+24.587124006" watchObservedRunningTime="2026-06-03 00:49:15.907599709 +0000 UTC m=+26.605970200" Jun 03 00:49:16.762653 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:16.762626 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2dq6" Jun 03 00:49:16.762816 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:16.762742 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2dq6" podUID="da35388a-fef5-4cb2-865b-40d260126f3b" Jun 03 00:49:17.380602 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:17.380565 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cg5ft"] Jun 03 00:49:17.381118 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:17.380694 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg5ft" Jun 03 00:49:17.381118 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:17.380816 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg5ft" podUID="a5e76234-ae70-4046-8dbe-95f3f0441488" Jun 03 00:49:17.382816 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:17.382794 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x67bk"] Jun 03 00:49:17.382975 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:17.382901 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:49:17.383030 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:17.383000 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x67bk" podUID="905babfb-1634-4e78-a4b5-177ab08e7a3d" Jun 03 00:49:17.390938 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:17.390908 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f2dq6"] Jun 03 00:49:17.391079 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:17.391005 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2dq6" Jun 03 00:49:17.391155 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:17.391107 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2dq6" podUID="da35388a-fef5-4cb2-865b-40d260126f3b" Jun 03 00:49:17.889541 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:17.889508 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8zww_c210edda-8849-4277-b258-5b40647200a9/ovn-acl-logging/0.log" Jun 03 00:49:17.889864 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:17.889837 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" event={"ID":"c210edda-8849-4277-b258-5b40647200a9","Type":"ContainerStarted","Data":"58dff04f8feaaa8ca287ee6732a95e20cd20b67f44ea35373a5b76be197be2ae"} Jun 03 00:49:17.890052 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:17.890032 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:49:17.907866 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:17.907838 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:49:17.916395 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:17.916337 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" podStartSLOduration=9.736575589 podStartE2EDuration="27.916319674s" podCreationTimestamp="2026-06-03 00:48:50 +0000 UTC" firstStartedPulling="2026-06-03 00:48:52.603795474 +0000 UTC m=+3.302165944" lastFinishedPulling="2026-06-03 00:49:10.783539542 +0000 UTC m=+21.481910029" observedRunningTime="2026-06-03 00:49:17.914769124 +0000 UTC m=+28.613139615" watchObservedRunningTime="2026-06-03 00:49:17.916319674 +0000 UTC m=+28.614690167" Jun 03 00:49:18.762611 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:18.762575 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:49:18.762994 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:18.762575 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg5ft" Jun 03 00:49:18.762994 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:18.762714 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x67bk" podUID="905babfb-1634-4e78-a4b5-177ab08e7a3d" Jun 03 00:49:18.762994 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:18.762740 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg5ft" podUID="a5e76234-ae70-4046-8dbe-95f3f0441488" Jun 03 00:49:18.892693 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:18.892661 2558 generic.go:358] "Generic (PLEG): container finished" podID="4aced56a-7b13-4d13-a18f-b189410b8b07" containerID="b0227c0fcba1260cf889ea8f38d308fa0d74e72b09b45fea8e1e8c0cb33500ba" exitCode=0 Jun 03 00:49:18.892852 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:18.892744 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqkw8" event={"ID":"4aced56a-7b13-4d13-a18f-b189410b8b07","Type":"ContainerDied","Data":"b0227c0fcba1260cf889ea8f38d308fa0d74e72b09b45fea8e1e8c0cb33500ba"} Jun 03 00:49:19.762962 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:19.762699 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2dq6" Jun 03 00:49:19.763417 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:19.763066 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2dq6" podUID="da35388a-fef5-4cb2-865b-40d260126f3b" Jun 03 00:49:20.762851 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:20.762811 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg5ft" Jun 03 00:49:20.763046 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:20.762823 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:49:20.763046 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:20.762937 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg5ft" podUID="a5e76234-ae70-4046-8dbe-95f3f0441488" Jun 03 00:49:20.763046 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:20.762990 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x67bk" podUID="905babfb-1634-4e78-a4b5-177ab08e7a3d" Jun 03 00:49:20.897399 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:20.897367 2558 generic.go:358] "Generic (PLEG): container finished" podID="4aced56a-7b13-4d13-a18f-b189410b8b07" containerID="81bbb939d622ca83f2177373d95f3dd11ec1c4d7e8f6d433937447ba3da050e5" exitCode=0 Jun 03 00:49:20.897573 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:20.897422 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqkw8" event={"ID":"4aced56a-7b13-4d13-a18f-b189410b8b07","Type":"ContainerDied","Data":"81bbb939d622ca83f2177373d95f3dd11ec1c4d7e8f6d433937447ba3da050e5"} Jun 03 00:49:21.396416 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:21.396381 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ncjrr" Jun 03 00:49:21.396621 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:21.396511 2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 00:49:21.397056 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:21.397035 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ncjrr" Jun 03 00:49:21.762057 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:21.761986 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2dq6" Jun 03 00:49:21.762218 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:21.762084 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2dq6" podUID="da35388a-fef5-4cb2-865b-40d260126f3b" Jun 03 00:49:22.762648 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:22.762618 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg5ft" Jun 03 00:49:22.763230 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:22.762618 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:49:22.763230 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:22.762709 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cg5ft" podUID="a5e76234-ae70-4046-8dbe-95f3f0441488" Jun 03 00:49:22.763230 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:22.762781 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x67bk" podUID="905babfb-1634-4e78-a4b5-177ab08e7a3d" Jun 03 00:49:22.902230 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:22.902198 2558 generic.go:358] "Generic (PLEG): container finished" podID="4aced56a-7b13-4d13-a18f-b189410b8b07" containerID="d0c0514deecdbed41e5c8162bb38efe42e84b5d1fdae2b97f472ba4fbbb9fe16" exitCode=0 Jun 03 00:49:22.902428 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:22.902255 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqkw8" event={"ID":"4aced56a-7b13-4d13-a18f-b189410b8b07","Type":"ContainerDied","Data":"d0c0514deecdbed41e5c8162bb38efe42e84b5d1fdae2b97f472ba4fbbb9fe16"} Jun 03 00:49:23.434821 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.434792 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/905babfb-1634-4e78-a4b5-177ab08e7a3d-metrics-certs\") pod \"network-metrics-daemon-x67bk\" (UID: \"905babfb-1634-4e78-a4b5-177ab08e7a3d\") " pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:49:23.434974 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:23.434945 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:49:23.435013 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:23.435003 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/905babfb-1634-4e78-a4b5-177ab08e7a3d-metrics-certs podName:905babfb-1634-4e78-a4b5-177ab08e7a3d nodeName:}" failed. No retries permitted until 2026-06-03 00:49:55.434988022 +0000 UTC m=+66.133358492 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/905babfb-1634-4e78-a4b5-177ab08e7a3d-metrics-certs") pod "network-metrics-daemon-x67bk" (UID: "905babfb-1634-4e78-a4b5-177ab08e7a3d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:49:23.636326 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.636280 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9j72n\" (UniqueName: \"kubernetes.io/projected/a5e76234-ae70-4046-8dbe-95f3f0441488-kube-api-access-9j72n\") pod \"network-check-target-cg5ft\" (UID: \"a5e76234-ae70-4046-8dbe-95f3f0441488\") " pod="openshift-network-diagnostics/network-check-target-cg5ft" Jun 03 00:49:23.636540 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:23.636467 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 00:49:23.636540 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:23.636491 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 00:49:23.636540 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:23.636503 2558 projected.go:194] Error preparing data for projected volume kube-api-access-9j72n for pod openshift-network-diagnostics/network-check-target-cg5ft: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:49:23.636709 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:23.636586 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5e76234-ae70-4046-8dbe-95f3f0441488-kube-api-access-9j72n podName:a5e76234-ae70-4046-8dbe-95f3f0441488 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:55.636567619 +0000 UTC m=+66.334938095 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9j72n" (UniqueName: "kubernetes.io/projected/a5e76234-ae70-4046-8dbe-95f3f0441488-kube-api-access-9j72n") pod "network-check-target-cg5ft" (UID: "a5e76234-ae70-4046-8dbe-95f3f0441488") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:49:23.655584 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.655560 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-48.ec2.internal" event="NodeReady" Jun 03 00:49:23.655728 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.655716 2558 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 00:49:23.687095 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.687060 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-79485bd5f7-vzv9g"] Jun 03 00:49:23.711731 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.711693 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-bqt4t"] Jun 03 00:49:23.712479 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.712040 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:23.716175 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.715960 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 00:49:23.716175 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.716149 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-svvm2\"" Jun 03 00:49:23.716583 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.716530 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 00:49:23.717691 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.717670 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 00:49:23.724054 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.724033 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 00:49:23.729686 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.729662 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rb2zn"] Jun 03 00:49:23.730175 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.730122 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-bqt4t" Jun 03 00:49:23.733722 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.733324 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 03 00:49:23.733722 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.733600 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 03 00:49:23.733882 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.733799 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-4mwn2\"" Jun 03 00:49:23.733882 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.733840 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 03 00:49:23.734186 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.734166 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 03 00:49:23.746605 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.746571 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 03 00:49:23.751100 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.751079 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-6vjwc"] Jun 03 00:49:23.751292 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.751258 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rb2zn" Jun 03 00:49:23.753802 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.753778 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lfx49\"" Jun 03 00:49:23.753917 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.753895 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 03 00:49:23.754010 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.753992 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 03 00:49:23.754177 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.754159 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 03 00:49:23.771301 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.771274 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79485bd5f7-vzv9g"] Jun 03 00:49:23.771301 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.771302 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-6vjwc"] Jun 03 00:49:23.771742 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.771317 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rb2zn"] Jun 03 00:49:23.771742 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.771417 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-6vjwc" Jun 03 00:49:23.771742 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.771635 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2dq6" Jun 03 00:49:23.774488 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.774468 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 03 00:49:23.774605 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.774507 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 03 00:49:23.774751 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.774729 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-bqt4t"] Jun 03 00:49:23.774856 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.774761 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8srzc"] Jun 03 00:49:23.775001 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.774972 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-q92p2\"" Jun 03 00:49:23.775086 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.775017 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 00:49:23.792442 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.792419 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kmx8n"] Jun 03 00:49:23.792594 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.792570 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8srzc" Jun 03 00:49:23.795443 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.795422 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 03 00:49:23.795790 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.795630 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 03 00:49:23.795790 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.795667 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 03 00:49:23.795790 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.795683 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 03 00:49:23.795790 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.795691 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-f85c8\"" Jun 03 00:49:23.819576 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.819555 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-9thxf"] Jun 03 00:49:23.819741 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.819720 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kmx8n" Jun 03 00:49:23.821899 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.821879 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 03 00:49:23.822598 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.822578 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 00:49:23.822598 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.822591 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-68scc\"" Jun 03 00:49:23.823865 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.823705 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 03 00:49:23.823865 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.823712 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 00:49:23.837580 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.837557 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cb3e4bb4-793d-4303-9ee7-d168801986a5-image-registry-private-configuration\") pod \"image-registry-79485bd5f7-vzv9g\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:23.837687 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.837598 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cb3e4bb4-793d-4303-9ee7-d168801986a5-registry-certificates\") pod \"image-registry-79485bd5f7-vzv9g\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:23.837687 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.837628 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/73408f89-f08e-4719-b940-5acc39134ab3-serving-cert\") pod \"console-operator-86d7c6cc77-bqt4t\" (UID: \"73408f89-f08e-4719-b940-5acc39134ab3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-bqt4t" Jun 03 00:49:23.837687 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.837559 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-gvqx8"] Jun 03 00:49:23.837687 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.837652 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbnjc\" (UniqueName: \"kubernetes.io/projected/d252e0f3-7f51-4be9-a89e-eb9712947b24-kube-api-access-qbnjc\") pod \"cluster-samples-operator-755bbf9bfb-rb2zn\" (UID: \"d252e0f3-7f51-4be9-a89e-eb9712947b24\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rb2zn" Jun 03 00:49:23.837687 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.837669 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-9thxf" Jun 03 00:49:23.837687 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.837688 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/73408f89-f08e-4719-b940-5acc39134ab3-trusted-ca\") pod \"console-operator-86d7c6cc77-bqt4t\" (UID: \"73408f89-f08e-4719-b940-5acc39134ab3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-bqt4t" Jun 03 00:49:23.837973 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.837748 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-registry-tls\") pod \"image-registry-79485bd5f7-vzv9g\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:23.837973 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.837823 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cb3e4bb4-793d-4303-9ee7-d168801986a5-ca-trust-extracted\") pod \"image-registry-79485bd5f7-vzv9g\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:23.837973 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.837862 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9vf9\" (UniqueName: \"kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-kube-api-access-k9vf9\") pod \"image-registry-79485bd5f7-vzv9g\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:23.837973 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.837903 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cb3e4bb4-793d-4303-9ee7-d168801986a5-installation-pull-secrets\") pod \"image-registry-79485bd5f7-vzv9g\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:23.837973 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.837933 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/73408f89-f08e-4719-b940-5acc39134ab3-config\") pod \"console-operator-86d7c6cc77-bqt4t\" (UID: \"73408f89-f08e-4719-b940-5acc39134ab3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-bqt4t" Jun 03 00:49:23.838212 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.837978 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-bound-sa-token\") pod \"image-registry-79485bd5f7-vzv9g\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:23.838212 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.838013 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d252e0f3-7f51-4be9-a89e-eb9712947b24-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rb2zn\" (UID: \"d252e0f3-7f51-4be9-a89e-eb9712947b24\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rb2zn" Jun 03 00:49:23.838212 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.838071 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb3e4bb4-793d-4303-9ee7-d168801986a5-trusted-ca\") pod \"image-registry-79485bd5f7-vzv9g\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:23.838212 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.838113 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4v24\" (UniqueName: \"kubernetes.io/projected/73408f89-f08e-4719-b940-5acc39134ab3-kube-api-access-w4v24\") pod \"console-operator-86d7c6cc77-bqt4t\" (UID: \"73408f89-f08e-4719-b940-5acc39134ab3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-bqt4t" Jun 03 00:49:23.839926 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.839905 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 00:49:23.840057 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.839948 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 03 00:49:23.840195 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.840178 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 03 00:49:23.840272 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.840204 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 00:49:23.840380 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.840364 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-854zx\"" Jun 03 00:49:23.845435 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.845411 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 03 00:49:23.865874 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.865837 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-vpcqx"] Jun 03 00:49:23.866027 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.865899 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-gvqx8" Jun 03 00:49:23.868738 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.868533 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 03 00:49:23.868738 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.868579 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 03 00:49:23.868738 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.868599 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 03 00:49:23.868738 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.868585 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 03 00:49:23.869009 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.868745 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-66w5f\"" Jun 03 00:49:23.882455 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.882433 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mvb7z"] Jun 03 00:49:23.882616 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.882596 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vpcqx" Jun 03 00:49:23.885020 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.884991 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 03 00:49:23.885236 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.885220 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 03 00:49:23.885316 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.885285 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-5chd8\"" Jun 03 00:49:23.912893 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.912866 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7df748b4d9-d5wxd"] Jun 03 00:49:23.913044 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.913031 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mvb7z" Jun 03 00:49:23.915641 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.915623 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-skfr9\"" Jun 03 00:49:23.916041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.915892 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 00:49:23.916041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.915892 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 00:49:23.916041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.915937 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 00:49:23.938245 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.938216 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-5h5b7"] Jun 03 00:49:23.938374 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.938274 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:23.938463 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.938443 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-bound-sa-token\") pod \"image-registry-79485bd5f7-vzv9g\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:23.938540 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.938479 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb3e4bb4-793d-4303-9ee7-d168801986a5-trusted-ca\") pod \"image-registry-79485bd5f7-vzv9g\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:23.938540 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.938529 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1724670-2476-4c56-977b-f55a85a996ca-config\") pod \"service-ca-operator-69877444c-gvqx8\" (UID: \"b1724670-2476-4c56-977b-f55a85a996ca\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-gvqx8" Jun 03 00:49:23.938652 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.938561 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cb3e4bb4-793d-4303-9ee7-d168801986a5-image-registry-private-configuration\") pod \"image-registry-79485bd5f7-vzv9g\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:23.938652 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.938591 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0ebe13d2-fdee-4751-9034-879309f00a91-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-8srzc\" (UID: \"0ebe13d2-fdee-4751-9034-879309f00a91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8srzc" Jun 03 00:49:23.938652 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.938616 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pflq\" (UniqueName: \"kubernetes.io/projected/0ebe13d2-fdee-4751-9034-879309f00a91-kube-api-access-5pflq\") pod \"kube-storage-version-migrator-operator-96ddc787c-8srzc\" (UID: \"0ebe13d2-fdee-4751-9034-879309f00a91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8srzc" Jun 03 00:49:23.938652 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.938645 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cb3e4bb4-793d-4303-9ee7-d168801986a5-registry-certificates\") pod \"image-registry-79485bd5f7-vzv9g\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:23.938850 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.938671 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/73408f89-f08e-4719-b940-5acc39134ab3-serving-cert\") pod \"console-operator-86d7c6cc77-bqt4t\" (UID: \"73408f89-f08e-4719-b940-5acc39134ab3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-bqt4t" Jun 03 00:49:23.938850 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.938699 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qbnjc\" (UniqueName: \"kubernetes.io/projected/d252e0f3-7f51-4be9-a89e-eb9712947b24-kube-api-access-qbnjc\") pod \"cluster-samples-operator-755bbf9bfb-rb2zn\" (UID: \"d252e0f3-7f51-4be9-a89e-eb9712947b24\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rb2zn" Jun 03 00:49:23.938850 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.938725 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/70d6f7a4-8438-4163-8f07-b108e3a30736-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-kmx8n\" (UID: \"70d6f7a4-8438-4163-8f07-b108e3a30736\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kmx8n" Jun 03 00:49:23.939003 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.938856 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/73408f89-f08e-4719-b940-5acc39134ab3-trusted-ca\") pod \"console-operator-86d7c6cc77-bqt4t\" (UID: \"73408f89-f08e-4719-b940-5acc39134ab3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-bqt4t" Jun 03 00:49:23.939003 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.938911 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cb3e4bb4-793d-4303-9ee7-d168801986a5-ca-trust-extracted\") pod \"image-registry-79485bd5f7-vzv9g\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:23.939003 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.938935 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k9vf9\" (UniqueName: \"kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-kube-api-access-k9vf9\") pod \"image-registry-79485bd5f7-vzv9g\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:23.939003 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.938963 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cb3e4bb4-793d-4303-9ee7-d168801986a5-installation-pull-secrets\") pod \"image-registry-79485bd5f7-vzv9g\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:23.939208 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.939010 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ebe13d2-fdee-4751-9034-879309f00a91-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-8srzc\" (UID: \"0ebe13d2-fdee-4751-9034-879309f00a91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8srzc" Jun 03 00:49:23.939208 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.939051 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641-snapshots\") pod \"insights-operator-788bf58df5-9thxf\" (UID: \"4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641\") " pod="openshift-insights/insights-operator-788bf58df5-9thxf" Jun 03 00:49:23.939208 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.939076 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n85dx\" (UniqueName: \"kubernetes.io/projected/b1724670-2476-4c56-977b-f55a85a996ca-kube-api-access-n85dx\") pod \"service-ca-operator-69877444c-gvqx8\" (UID: \"b1724670-2476-4c56-977b-f55a85a996ca\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-gvqx8" Jun 03 00:49:23.939208 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.939102 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-9thxf\" (UID: \"4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641\") " pod="openshift-insights/insights-operator-788bf58df5-9thxf" Jun 03 00:49:23.939208 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.939134 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w4v24\" (UniqueName: \"kubernetes.io/projected/73408f89-f08e-4719-b940-5acc39134ab3-kube-api-access-w4v24\") pod \"console-operator-86d7c6cc77-bqt4t\" (UID: \"73408f89-f08e-4719-b940-5acc39134ab3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-bqt4t" Jun 03 00:49:23.939208 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.939176 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f7rf\" (UniqueName: \"kubernetes.io/projected/4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641-kube-api-access-4f7rf\") pod \"insights-operator-788bf58df5-9thxf\" (UID: \"4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641\") " pod="openshift-insights/insights-operator-788bf58df5-9thxf" Jun 03 00:49:23.939496 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.939212 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b1724670-2476-4c56-977b-f55a85a996ca-serving-cert\") pod \"service-ca-operator-69877444c-gvqx8\" (UID: \"b1724670-2476-4c56-977b-f55a85a996ca\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-gvqx8" Jun 03 00:49:23.939496 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.939241 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/70d6f7a4-8438-4163-8f07-b108e3a30736-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-kmx8n\" (UID: \"70d6f7a4-8438-4163-8f07-b108e3a30736\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kmx8n" Jun 03 00:49:23.939496 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.939272 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-registry-tls\") pod \"image-registry-79485bd5f7-vzv9g\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:23.939496 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.939299 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw2vw\" (UniqueName: \"kubernetes.io/projected/6f02bc4d-0a22-4e33-938d-be35bdf34fd0-kube-api-access-tw2vw\") pod \"volume-data-source-validator-7598fd5bd-6vjwc\" (UID: \"6f02bc4d-0a22-4e33-938d-be35bdf34fd0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-6vjwc" Jun 03 00:49:23.939496 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.939325 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xdv8\" (UniqueName: \"kubernetes.io/projected/70d6f7a4-8438-4163-8f07-b108e3a30736-kube-api-access-6xdv8\") pod \"cluster-monitoring-operator-69b6cbdb88-kmx8n\" (UID: \"70d6f7a4-8438-4163-8f07-b108e3a30736\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kmx8n" Jun 03 00:49:23.939496 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.939355 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641-service-ca-bundle\") pod \"insights-operator-788bf58df5-9thxf\" (UID: \"4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641\") " pod="openshift-insights/insights-operator-788bf58df5-9thxf" Jun 03 00:49:23.939496 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.939383 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641-serving-cert\") pod \"insights-operator-788bf58df5-9thxf\" (UID: \"4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641\") " pod="openshift-insights/insights-operator-788bf58df5-9thxf" Jun 03 00:49:23.939496 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.939416 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/73408f89-f08e-4719-b940-5acc39134ab3-config\") pod \"console-operator-86d7c6cc77-bqt4t\" (UID: \"73408f89-f08e-4719-b940-5acc39134ab3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-bqt4t" Jun 03 00:49:23.939496 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.939440 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641-tmp\") pod \"insights-operator-788bf58df5-9thxf\" (UID: \"4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641\") " pod="openshift-insights/insights-operator-788bf58df5-9thxf" Jun 03 00:49:23.939868 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.939502 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d252e0f3-7f51-4be9-a89e-eb9712947b24-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rb2zn\" (UID: \"d252e0f3-7f51-4be9-a89e-eb9712947b24\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rb2zn" Jun 03 00:49:23.939868 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:23.939617 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 00:49:23.939868 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:23.939692 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d252e0f3-7f51-4be9-a89e-eb9712947b24-samples-operator-tls podName:d252e0f3-7f51-4be9-a89e-eb9712947b24 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:24.439674309 +0000 UTC m=+35.138044793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d252e0f3-7f51-4be9-a89e-eb9712947b24-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-rb2zn" (UID: "d252e0f3-7f51-4be9-a89e-eb9712947b24") : secret "samples-operator-tls" not found Jun 03 00:49:23.940032 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:23.939975 2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 00:49:23.940032 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:23.939990 2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79485bd5f7-vzv9g: secret "image-registry-tls" not found Jun 03 00:49:23.940032 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:23.940033 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-registry-tls podName:cb3e4bb4-793d-4303-9ee7-d168801986a5 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:24.440017866 +0000 UTC m=+35.138388340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-registry-tls") pod "image-registry-79485bd5f7-vzv9g" (UID: "cb3e4bb4-793d-4303-9ee7-d168801986a5") : secret "image-registry-tls" not found Jun 03 00:49:23.940297 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.940276 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb3e4bb4-793d-4303-9ee7-d168801986a5-trusted-ca\") pod \"image-registry-79485bd5f7-vzv9g\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:23.940383 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.940370 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/73408f89-f08e-4719-b940-5acc39134ab3-trusted-ca\") pod \"console-operator-86d7c6cc77-bqt4t\" (UID: \"73408f89-f08e-4719-b940-5acc39134ab3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-bqt4t" Jun 03 00:49:23.940859 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.940649 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cb3e4bb4-793d-4303-9ee7-d168801986a5-ca-trust-extracted\") pod \"image-registry-79485bd5f7-vzv9g\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:23.940859 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.940839 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 03 00:49:23.941068 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.940962 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cb3e4bb4-793d-4303-9ee7-d168801986a5-registry-certificates\") pod \"image-registry-79485bd5f7-vzv9g\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:23.941188 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.941164 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/73408f89-f08e-4719-b940-5acc39134ab3-config\") pod \"console-operator-86d7c6cc77-bqt4t\" (UID: \"73408f89-f08e-4719-b940-5acc39134ab3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-bqt4t" Jun 03 00:49:23.941721 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.941348 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 00:49:23.941721 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.941368 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 03 00:49:23.941721 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.941472 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 03 00:49:23.941721 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.941552 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 03 00:49:23.941721 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.941619 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-222jx\"" Jun 03 00:49:23.942112 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.942044 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 00:49:23.944232 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.944063 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/73408f89-f08e-4719-b940-5acc39134ab3-serving-cert\") pod \"console-operator-86d7c6cc77-bqt4t\" (UID: \"73408f89-f08e-4719-b940-5acc39134ab3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-bqt4t" Jun 03 00:49:23.944316 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.944189 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cb3e4bb4-793d-4303-9ee7-d168801986a5-installation-pull-secrets\") pod \"image-registry-79485bd5f7-vzv9g\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:23.944316 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.944212 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cb3e4bb4-793d-4303-9ee7-d168801986a5-image-registry-private-configuration\") pod \"image-registry-79485bd5f7-vzv9g\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:23.947340 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.947317 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-bound-sa-token\") pod \"image-registry-79485bd5f7-vzv9g\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:23.947424 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.947397 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbnjc\" (UniqueName: \"kubernetes.io/projected/d252e0f3-7f51-4be9-a89e-eb9712947b24-kube-api-access-qbnjc\") pod \"cluster-samples-operator-755bbf9bfb-rb2zn\" (UID: \"d252e0f3-7f51-4be9-a89e-eb9712947b24\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rb2zn" Jun 03 00:49:23.947476 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.947441 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4v24\" (UniqueName: \"kubernetes.io/projected/73408f89-f08e-4719-b940-5acc39134ab3-kube-api-access-w4v24\") pod \"console-operator-86d7c6cc77-bqt4t\" (UID: \"73408f89-f08e-4719-b940-5acc39134ab3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-bqt4t" Jun 03 00:49:23.950025 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.950004 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9vf9\" (UniqueName: \"kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-kube-api-access-k9vf9\") pod \"image-registry-79485bd5f7-vzv9g\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:23.981242 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.981212 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8srzc"] Jun 03 00:49:23.981242 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.981242 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-vpcqx"] Jun 03 00:49:23.981439 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.981254 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kmx8n"] Jun 03 00:49:23.981439 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.981268 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-gvqx8"] Jun 03 00:49:23.981439 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.981281 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mvb7z"] Jun 03 00:49:23.981439 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.981293 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-9thxf"] Jun 03 00:49:23.981439 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.981301 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-5h5b7"] Jun 03 00:49:23.981439 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.981313 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7df748b4d9-d5wxd"] Jun 03 00:49:23.981439 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.981329 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xhlnm"] Jun 03 00:49:23.981439 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.981380 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-5h5b7" Jun 03 00:49:23.984375 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.984282 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-hh2z7\"" Jun 03 00:49:23.984473 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.984389 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 00:49:23.984473 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:23.984413 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 00:49:24.007260 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.007231 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xhlnm"] Jun 03 00:49:24.007408 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.007389 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xhlnm" Jun 03 00:49:24.010146 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.010038 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 00:49:24.010255 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.010165 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9sxhx\"" Jun 03 00:49:24.010255 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.010198 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 00:49:24.040921 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.040887 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4f7rf\" (UniqueName: \"kubernetes.io/projected/4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641-kube-api-access-4f7rf\") pod \"insights-operator-788bf58df5-9thxf\" (UID: \"4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641\") " pod="openshift-insights/insights-operator-788bf58df5-9thxf" Jun 03 00:49:24.041076 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.040933 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b1724670-2476-4c56-977b-f55a85a996ca-serving-cert\") pod \"service-ca-operator-69877444c-gvqx8\" (UID: \"b1724670-2476-4c56-977b-f55a85a996ca\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-gvqx8" Jun 03 00:49:24.041076 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.040966 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/70d6f7a4-8438-4163-8f07-b108e3a30736-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-kmx8n\" (UID: \"70d6f7a4-8438-4163-8f07-b108e3a30736\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kmx8n" Jun 03 00:49:24.041076 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.041000 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/efc528c1-9886-493b-baae-3a407e726a91-cert\") pod \"ingress-canary-mvb7z\" (UID: \"efc528c1-9886-493b-baae-3a407e726a91\") " pod="openshift-ingress-canary/ingress-canary-mvb7z" Jun 03 00:49:24.041076 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.041043 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tw2vw\" (UniqueName: \"kubernetes.io/projected/6f02bc4d-0a22-4e33-938d-be35bdf34fd0-kube-api-access-tw2vw\") pod \"volume-data-source-validator-7598fd5bd-6vjwc\" (UID: \"6f02bc4d-0a22-4e33-938d-be35bdf34fd0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-6vjwc" Jun 03 00:49:24.041076 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.041071 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6xdv8\" (UniqueName: \"kubernetes.io/projected/70d6f7a4-8438-4163-8f07-b108e3a30736-kube-api-access-6xdv8\") pod \"cluster-monitoring-operator-69b6cbdb88-kmx8n\" (UID: \"70d6f7a4-8438-4163-8f07-b108e3a30736\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kmx8n" Jun 03 00:49:24.041338 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.041097 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641-service-ca-bundle\") pod \"insights-operator-788bf58df5-9thxf\" (UID: \"4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641\") " pod="openshift-insights/insights-operator-788bf58df5-9thxf" Jun 03 00:49:24.041338 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.041114 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641-serving-cert\") pod \"insights-operator-788bf58df5-9thxf\" (UID: \"4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641\") " pod="openshift-insights/insights-operator-788bf58df5-9thxf" Jun 03 00:49:24.041338 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.041174 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ec8846c3-927f-4591-ab53-8ade3a5ae809-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-vpcqx\" (UID: \"ec8846c3-927f-4591-ab53-8ade3a5ae809\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vpcqx" Jun 03 00:49:24.041338 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:24.041231 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 00:49:24.041338 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.041215 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641-tmp\") pod \"insights-operator-788bf58df5-9thxf\" (UID: \"4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641\") " pod="openshift-insights/insights-operator-788bf58df5-9thxf" Jun 03 00:49:24.041338 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.041292 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98e106c8-50c9-405e-b182-93fa1fe82bb0-service-ca-bundle\") pod \"router-default-7df748b4d9-d5wxd\" (UID: \"98e106c8-50c9-405e-b182-93fa1fe82bb0\") " pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:24.041338 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:24.041302 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70d6f7a4-8438-4163-8f07-b108e3a30736-cluster-monitoring-operator-tls podName:70d6f7a4-8438-4163-8f07-b108e3a30736 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:24.541281762 +0000 UTC m=+35.239652235 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/70d6f7a4-8438-4163-8f07-b108e3a30736-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-kmx8n" (UID: "70d6f7a4-8438-4163-8f07-b108e3a30736") : secret "cluster-monitoring-operator-tls" not found Jun 03 00:49:24.041710 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.041352 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzfbn\" (UniqueName: \"kubernetes.io/projected/efc528c1-9886-493b-baae-3a407e726a91-kube-api-access-mzfbn\") pod \"ingress-canary-mvb7z\" (UID: \"efc528c1-9886-493b-baae-3a407e726a91\") " pod="openshift-ingress-canary/ingress-canary-mvb7z" Jun 03 00:49:24.041710 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.041403 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1724670-2476-4c56-977b-f55a85a996ca-config\") pod \"service-ca-operator-69877444c-gvqx8\" (UID: \"b1724670-2476-4c56-977b-f55a85a996ca\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-gvqx8" Jun 03 00:49:24.041710 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.041437 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0ebe13d2-fdee-4751-9034-879309f00a91-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-8srzc\" (UID: \"0ebe13d2-fdee-4751-9034-879309f00a91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8srzc" Jun 03 00:49:24.041710 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.041464 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5pflq\" (UniqueName: \"kubernetes.io/projected/0ebe13d2-fdee-4751-9034-879309f00a91-kube-api-access-5pflq\") pod \"kube-storage-version-migrator-operator-96ddc787c-8srzc\" (UID: \"0ebe13d2-fdee-4751-9034-879309f00a91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8srzc" Jun 03 00:49:24.041710 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.041498 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/70d6f7a4-8438-4163-8f07-b108e3a30736-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-kmx8n\" (UID: \"70d6f7a4-8438-4163-8f07-b108e3a30736\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kmx8n" Jun 03 00:49:24.041710 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.041547 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ec8846c3-927f-4591-ab53-8ade3a5ae809-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-vpcqx\" (UID: \"ec8846c3-927f-4591-ab53-8ade3a5ae809\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vpcqx" Jun 03 00:49:24.041710 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.041691 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641-tmp\") pod \"insights-operator-788bf58df5-9thxf\" (UID: \"4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641\") " pod="openshift-insights/insights-operator-788bf58df5-9thxf" Jun 03 00:49:24.042042 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.041751 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/98e106c8-50c9-405e-b182-93fa1fe82bb0-default-certificate\") pod \"router-default-7df748b4d9-d5wxd\" (UID: \"98e106c8-50c9-405e-b182-93fa1fe82bb0\") " pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:24.042042 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.041805 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641-service-ca-bundle\") pod \"insights-operator-788bf58df5-9thxf\" (UID: \"4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641\") " pod="openshift-insights/insights-operator-788bf58df5-9thxf" Jun 03 00:49:24.042042 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.041822 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk9mq\" (UniqueName: \"kubernetes.io/projected/98e106c8-50c9-405e-b182-93fa1fe82bb0-kube-api-access-gk9mq\") pod \"router-default-7df748b4d9-d5wxd\" (UID: \"98e106c8-50c9-405e-b182-93fa1fe82bb0\") " pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:24.042042 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.041873 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98e106c8-50c9-405e-b182-93fa1fe82bb0-metrics-certs\") pod \"router-default-7df748b4d9-d5wxd\" (UID: \"98e106c8-50c9-405e-b182-93fa1fe82bb0\") " pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:24.042042 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.041906 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ebe13d2-fdee-4751-9034-879309f00a91-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-8srzc\" (UID: \"0ebe13d2-fdee-4751-9034-879309f00a91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8srzc" Jun 03 00:49:24.042042 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.041961 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641-snapshots\") pod \"insights-operator-788bf58df5-9thxf\" (UID: \"4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641\") " pod="openshift-insights/insights-operator-788bf58df5-9thxf" Jun 03 00:49:24.042042 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.041992 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n85dx\" (UniqueName: \"kubernetes.io/projected/b1724670-2476-4c56-977b-f55a85a996ca-kube-api-access-n85dx\") pod \"service-ca-operator-69877444c-gvqx8\" (UID: \"b1724670-2476-4c56-977b-f55a85a996ca\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-gvqx8" Jun 03 00:49:24.042042 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.042008 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1724670-2476-4c56-977b-f55a85a996ca-config\") pod \"service-ca-operator-69877444c-gvqx8\" (UID: \"b1724670-2476-4c56-977b-f55a85a996ca\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-gvqx8" Jun 03 00:49:24.042042 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.042019 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-9thxf\" (UID: \"4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641\") " pod="openshift-insights/insights-operator-788bf58df5-9thxf" Jun 03 00:49:24.042478 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.042241 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/98e106c8-50c9-405e-b182-93fa1fe82bb0-stats-auth\") pod \"router-default-7df748b4d9-d5wxd\" (UID: \"98e106c8-50c9-405e-b182-93fa1fe82bb0\") " pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:24.042478 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.042261 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/70d6f7a4-8438-4163-8f07-b108e3a30736-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-kmx8n\" (UID: \"70d6f7a4-8438-4163-8f07-b108e3a30736\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kmx8n" Jun 03 00:49:24.042478 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.042287 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0ebe13d2-fdee-4751-9034-879309f00a91-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-8srzc\" (UID: \"0ebe13d2-fdee-4751-9034-879309f00a91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8srzc" Jun 03 00:49:24.042644 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.042476 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641-snapshots\") pod \"insights-operator-788bf58df5-9thxf\" (UID: \"4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641\") " pod="openshift-insights/insights-operator-788bf58df5-9thxf" Jun 03 00:49:24.043101 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.043077 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-9thxf\" (UID: \"4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641\") " pod="openshift-insights/insights-operator-788bf58df5-9thxf" Jun 03 00:49:24.043773 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.043750 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-bqt4t" Jun 03 00:49:24.044085 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.044071 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b1724670-2476-4c56-977b-f55a85a996ca-serving-cert\") pod \"service-ca-operator-69877444c-gvqx8\" (UID: \"b1724670-2476-4c56-977b-f55a85a996ca\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-gvqx8" Jun 03 00:49:24.044639 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.044618 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ebe13d2-fdee-4751-9034-879309f00a91-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-8srzc\" (UID: \"0ebe13d2-fdee-4751-9034-879309f00a91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8srzc" Jun 03 00:49:24.044731 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.044662 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641-serving-cert\") pod \"insights-operator-788bf58df5-9thxf\" (UID: \"4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641\") " pod="openshift-insights/insights-operator-788bf58df5-9thxf" Jun 03 00:49:24.052758 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.052736 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f7rf\" (UniqueName: \"kubernetes.io/projected/4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641-kube-api-access-4f7rf\") pod \"insights-operator-788bf58df5-9thxf\" (UID: \"4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641\") " pod="openshift-insights/insights-operator-788bf58df5-9thxf" Jun 03 00:49:24.053417 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.053369 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n85dx\" (UniqueName: \"kubernetes.io/projected/b1724670-2476-4c56-977b-f55a85a996ca-kube-api-access-n85dx\") pod \"service-ca-operator-69877444c-gvqx8\" (UID: \"b1724670-2476-4c56-977b-f55a85a996ca\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-gvqx8" Jun 03 00:49:24.053686 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.053648 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pflq\" (UniqueName: \"kubernetes.io/projected/0ebe13d2-fdee-4751-9034-879309f00a91-kube-api-access-5pflq\") pod \"kube-storage-version-migrator-operator-96ddc787c-8srzc\" (UID: \"0ebe13d2-fdee-4751-9034-879309f00a91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8srzc" Jun 03 00:49:24.054053 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.053991 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw2vw\" (UniqueName: \"kubernetes.io/projected/6f02bc4d-0a22-4e33-938d-be35bdf34fd0-kube-api-access-tw2vw\") pod \"volume-data-source-validator-7598fd5bd-6vjwc\" (UID: \"6f02bc4d-0a22-4e33-938d-be35bdf34fd0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-6vjwc" Jun 03 00:49:24.054861 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.054826 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xdv8\" (UniqueName: \"kubernetes.io/projected/70d6f7a4-8438-4163-8f07-b108e3a30736-kube-api-access-6xdv8\") pod \"cluster-monitoring-operator-69b6cbdb88-kmx8n\" (UID: \"70d6f7a4-8438-4163-8f07-b108e3a30736\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kmx8n" Jun 03 00:49:24.083266 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.083235 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-6vjwc" Jun 03 00:49:24.103249 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.103196 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8srzc" Jun 03 00:49:24.152159 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.144116 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/98e106c8-50c9-405e-b182-93fa1fe82bb0-stats-auth\") pod \"router-default-7df748b4d9-d5wxd\" (UID: \"98e106c8-50c9-405e-b182-93fa1fe82bb0\") " pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:24.152159 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.144205 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/efc528c1-9886-493b-baae-3a407e726a91-cert\") pod \"ingress-canary-mvb7z\" (UID: \"efc528c1-9886-493b-baae-3a407e726a91\") " pod="openshift-ingress-canary/ingress-canary-mvb7z" Jun 03 00:49:24.152159 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.144255 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g4b9\" (UniqueName: \"kubernetes.io/projected/c1b3f280-8191-43b7-8885-0e3c3943141f-kube-api-access-8g4b9\") pod \"dns-default-xhlnm\" (UID: \"c1b3f280-8191-43b7-8885-0e3c3943141f\") " pod="openshift-dns/dns-default-xhlnm" Jun 03 00:49:24.152159 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.144310 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ec8846c3-927f-4591-ab53-8ade3a5ae809-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-vpcqx\" (UID: \"ec8846c3-927f-4591-ab53-8ade3a5ae809\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vpcqx" Jun 03 00:49:24.152159 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:24.144580 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 00:49:24.152159 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:24.144664 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efc528c1-9886-493b-baae-3a407e726a91-cert podName:efc528c1-9886-493b-baae-3a407e726a91 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:24.644643298 +0000 UTC m=+35.343013785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/efc528c1-9886-493b-baae-3a407e726a91-cert") pod "ingress-canary-mvb7z" (UID: "efc528c1-9886-493b-baae-3a407e726a91") : secret "canary-serving-cert" not found Jun 03 00:49:24.152159 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.145457 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98e106c8-50c9-405e-b182-93fa1fe82bb0-service-ca-bundle\") pod \"router-default-7df748b4d9-d5wxd\" (UID: \"98e106c8-50c9-405e-b182-93fa1fe82bb0\") " pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:24.152159 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.145508 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mzfbn\" (UniqueName: \"kubernetes.io/projected/efc528c1-9886-493b-baae-3a407e726a91-kube-api-access-mzfbn\") pod \"ingress-canary-mvb7z\" (UID: \"efc528c1-9886-493b-baae-3a407e726a91\") " pod="openshift-ingress-canary/ingress-canary-mvb7z" Jun 03 00:49:24.152159 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.145551 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1b3f280-8191-43b7-8885-0e3c3943141f-metrics-tls\") pod \"dns-default-xhlnm\" (UID: \"c1b3f280-8191-43b7-8885-0e3c3943141f\") " pod="openshift-dns/dns-default-xhlnm" Jun 03 00:49:24.152159 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.145591 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ec8846c3-927f-4591-ab53-8ade3a5ae809-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-vpcqx\" (UID: \"ec8846c3-927f-4591-ab53-8ade3a5ae809\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vpcqx" Jun 03 00:49:24.152159 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.145616 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/98e106c8-50c9-405e-b182-93fa1fe82bb0-default-certificate\") pod \"router-default-7df748b4d9-d5wxd\" (UID: \"98e106c8-50c9-405e-b182-93fa1fe82bb0\") " pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:24.152159 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.145674 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gk9mq\" (UniqueName: \"kubernetes.io/projected/98e106c8-50c9-405e-b182-93fa1fe82bb0-kube-api-access-gk9mq\") pod \"router-default-7df748b4d9-d5wxd\" (UID: \"98e106c8-50c9-405e-b182-93fa1fe82bb0\") " pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:24.152159 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.145705 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98e106c8-50c9-405e-b182-93fa1fe82bb0-metrics-certs\") pod \"router-default-7df748b4d9-d5wxd\" (UID: \"98e106c8-50c9-405e-b182-93fa1fe82bb0\") " pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:24.152159 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.145733 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrf6b\" (UniqueName: \"kubernetes.io/projected/51720b0b-2d27-4e3a-8ce1-86aa8f26d99c-kube-api-access-vrf6b\") pod \"network-check-source-56d84b9f44-5h5b7\" (UID: \"51720b0b-2d27-4e3a-8ce1-86aa8f26d99c\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-5h5b7" Jun 03 00:49:24.152159 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.145759 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c1b3f280-8191-43b7-8885-0e3c3943141f-config-volume\") pod \"dns-default-xhlnm\" (UID: \"c1b3f280-8191-43b7-8885-0e3c3943141f\") " pod="openshift-dns/dns-default-xhlnm" Jun 03 00:49:24.152159 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.145801 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1b3f280-8191-43b7-8885-0e3c3943141f-tmp-dir\") pod \"dns-default-xhlnm\" (UID: \"c1b3f280-8191-43b7-8885-0e3c3943141f\") " pod="openshift-dns/dns-default-xhlnm" Jun 03 00:49:24.152159 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:24.146485 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 00:49:24.153210 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:24.146900 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98e106c8-50c9-405e-b182-93fa1fe82bb0-metrics-certs podName:98e106c8-50c9-405e-b182-93fa1fe82bb0 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:24.646876309 +0000 UTC m=+35.345246782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/98e106c8-50c9-405e-b182-93fa1fe82bb0-metrics-certs") pod "router-default-7df748b4d9-d5wxd" (UID: "98e106c8-50c9-405e-b182-93fa1fe82bb0") : secret "router-metrics-certs-default" not found Jun 03 00:49:24.153210 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.146488 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ec8846c3-927f-4591-ab53-8ade3a5ae809-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-vpcqx\" (UID: \"ec8846c3-927f-4591-ab53-8ade3a5ae809\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vpcqx" Jun 03 00:49:24.153210 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:24.147462 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98e106c8-50c9-405e-b182-93fa1fe82bb0-service-ca-bundle podName:98e106c8-50c9-405e-b182-93fa1fe82bb0 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:24.647444409 +0000 UTC m=+35.345814898 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/98e106c8-50c9-405e-b182-93fa1fe82bb0-service-ca-bundle") pod "router-default-7df748b4d9-d5wxd" (UID: "98e106c8-50c9-405e-b182-93fa1fe82bb0") : configmap references non-existent config key: service-ca.crt Jun 03 00:49:24.153210 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:24.147580 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 00:49:24.153210 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:24.147625 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec8846c3-927f-4591-ab53-8ade3a5ae809-networking-console-plugin-cert podName:ec8846c3-927f-4591-ab53-8ade3a5ae809 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:24.647612864 +0000 UTC m=+35.345983339 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ec8846c3-927f-4591-ab53-8ade3a5ae809-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-vpcqx" (UID: "ec8846c3-927f-4591-ab53-8ade3a5ae809") : secret "networking-console-plugin-cert" not found Jun 03 00:49:24.153210 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.151954 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-9thxf" Jun 03 00:49:24.160170 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.160138 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/98e106c8-50c9-405e-b182-93fa1fe82bb0-default-certificate\") pod \"router-default-7df748b4d9-d5wxd\" (UID: \"98e106c8-50c9-405e-b182-93fa1fe82bb0\") " pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:24.160913 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.160887 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk9mq\" (UniqueName: \"kubernetes.io/projected/98e106c8-50c9-405e-b182-93fa1fe82bb0-kube-api-access-gk9mq\") pod \"router-default-7df748b4d9-d5wxd\" (UID: \"98e106c8-50c9-405e-b182-93fa1fe82bb0\") " pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:24.162190 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.162164 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/98e106c8-50c9-405e-b182-93fa1fe82bb0-stats-auth\") pod \"router-default-7df748b4d9-d5wxd\" (UID: \"98e106c8-50c9-405e-b182-93fa1fe82bb0\") " pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:24.164399 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.164349 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzfbn\" (UniqueName: \"kubernetes.io/projected/efc528c1-9886-493b-baae-3a407e726a91-kube-api-access-mzfbn\") pod \"ingress-canary-mvb7z\" (UID: \"efc528c1-9886-493b-baae-3a407e726a91\") " pod="openshift-ingress-canary/ingress-canary-mvb7z" Jun 03 00:49:24.178712 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.178286 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-gvqx8" Jun 03 00:49:24.248490 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.246834 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1b3f280-8191-43b7-8885-0e3c3943141f-tmp-dir\") pod \"dns-default-xhlnm\" (UID: \"c1b3f280-8191-43b7-8885-0e3c3943141f\") " pod="openshift-dns/dns-default-xhlnm" Jun 03 00:49:24.248490 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.246934 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8g4b9\" (UniqueName: \"kubernetes.io/projected/c1b3f280-8191-43b7-8885-0e3c3943141f-kube-api-access-8g4b9\") pod \"dns-default-xhlnm\" (UID: \"c1b3f280-8191-43b7-8885-0e3c3943141f\") " pod="openshift-dns/dns-default-xhlnm" Jun 03 00:49:24.248490 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.247004 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1b3f280-8191-43b7-8885-0e3c3943141f-metrics-tls\") pod \"dns-default-xhlnm\" (UID: \"c1b3f280-8191-43b7-8885-0e3c3943141f\") " pod="openshift-dns/dns-default-xhlnm" Jun 03 00:49:24.248490 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.247096 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vrf6b\" (UniqueName: \"kubernetes.io/projected/51720b0b-2d27-4e3a-8ce1-86aa8f26d99c-kube-api-access-vrf6b\") pod \"network-check-source-56d84b9f44-5h5b7\" (UID: \"51720b0b-2d27-4e3a-8ce1-86aa8f26d99c\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-5h5b7" Jun 03 00:49:24.248490 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.247120 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c1b3f280-8191-43b7-8885-0e3c3943141f-config-volume\") pod \"dns-default-xhlnm\" (UID: \"c1b3f280-8191-43b7-8885-0e3c3943141f\") " pod="openshift-dns/dns-default-xhlnm" Jun 03 00:49:24.248490 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.247679 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c1b3f280-8191-43b7-8885-0e3c3943141f-config-volume\") pod \"dns-default-xhlnm\" (UID: \"c1b3f280-8191-43b7-8885-0e3c3943141f\") " pod="openshift-dns/dns-default-xhlnm" Jun 03 00:49:24.248490 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.247895 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1b3f280-8191-43b7-8885-0e3c3943141f-tmp-dir\") pod \"dns-default-xhlnm\" (UID: \"c1b3f280-8191-43b7-8885-0e3c3943141f\") " pod="openshift-dns/dns-default-xhlnm" Jun 03 00:49:24.248490 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:24.248241 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 00:49:24.248490 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:24.248296 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1b3f280-8191-43b7-8885-0e3c3943141f-metrics-tls podName:c1b3f280-8191-43b7-8885-0e3c3943141f nodeName:}" failed. No retries permitted until 2026-06-03 00:49:24.748279543 +0000 UTC m=+35.446650027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1b3f280-8191-43b7-8885-0e3c3943141f-metrics-tls") pod "dns-default-xhlnm" (UID: "c1b3f280-8191-43b7-8885-0e3c3943141f") : secret "dns-default-metrics-tls" not found Jun 03 00:49:24.260043 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.259979 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g4b9\" (UniqueName: \"kubernetes.io/projected/c1b3f280-8191-43b7-8885-0e3c3943141f-kube-api-access-8g4b9\") pod \"dns-default-xhlnm\" (UID: \"c1b3f280-8191-43b7-8885-0e3c3943141f\") " pod="openshift-dns/dns-default-xhlnm" Jun 03 00:49:24.263677 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.263618 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrf6b\" (UniqueName: \"kubernetes.io/projected/51720b0b-2d27-4e3a-8ce1-86aa8f26d99c-kube-api-access-vrf6b\") pod \"network-check-source-56d84b9f44-5h5b7\" (UID: \"51720b0b-2d27-4e3a-8ce1-86aa8f26d99c\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-5h5b7" Jun 03 00:49:24.263677 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.263661 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-6vjwc"] Jun 03 00:49:24.265904 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.265744 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-bqt4t"] Jun 03 00:49:24.280997 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:49:24.280919 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73408f89_f08e_4719_b940_5acc39134ab3.slice/crio-da60a23babb17f4b2015892ba33295fdc5343f10608e679e511bff8b34e019c0 WatchSource:0}: Error finding container da60a23babb17f4b2015892ba33295fdc5343f10608e679e511bff8b34e019c0: Status 404 returned error can't find the container with id da60a23babb17f4b2015892ba33295fdc5343f10608e679e511bff8b34e019c0 Jun 03 00:49:24.282087 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:49:24.282054 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f02bc4d_0a22_4e33_938d_be35bdf34fd0.slice/crio-c6b1ccced0ef66b0bb5578199d16ec9108c1137c1b7abcef21212474489db7dd WatchSource:0}: Error finding container c6b1ccced0ef66b0bb5578199d16ec9108c1137c1b7abcef21212474489db7dd: Status 404 returned error can't find the container with id c6b1ccced0ef66b0bb5578199d16ec9108c1137c1b7abcef21212474489db7dd Jun 03 00:49:24.291392 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.291241 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-5h5b7" Jun 03 00:49:24.311707 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.311652 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8srzc"] Jun 03 00:49:24.314831 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:49:24.314792 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ebe13d2_fdee_4751_9034_879309f00a91.slice/crio-4c37ae4434742d8d9ac48b877db5ccfab7122ff49516805f33d80e38df5cc3c5 WatchSource:0}: Error finding container 4c37ae4434742d8d9ac48b877db5ccfab7122ff49516805f33d80e38df5cc3c5: Status 404 returned error can't find the container with id 4c37ae4434742d8d9ac48b877db5ccfab7122ff49516805f33d80e38df5cc3c5 Jun 03 00:49:24.372903 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.372468 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-gvqx8"] Jun 03 00:49:24.375077 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:49:24.375041 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1724670_2476_4c56_977b_f55a85a996ca.slice/crio-8937b7035ba2138e16ed619bbf1e58ab25bf3f4d858f40c98eac71e2450a2560 WatchSource:0}: Error finding container 8937b7035ba2138e16ed619bbf1e58ab25bf3f4d858f40c98eac71e2450a2560: Status 404 returned error can't find the container with id 8937b7035ba2138e16ed619bbf1e58ab25bf3f4d858f40c98eac71e2450a2560 Jun 03 00:49:24.385183 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.384549 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-9thxf"] Jun 03 00:49:24.387486 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:49:24.387289 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ef8dff0_c2f4_43e6_8ae2_ebe0c7357641.slice/crio-b66769cbaf3377d138c3cf7a309186bf8579abc16480963e3db3a76dbd180b95 WatchSource:0}: Error finding container b66769cbaf3377d138c3cf7a309186bf8579abc16480963e3db3a76dbd180b95: Status 404 returned error can't find the container with id b66769cbaf3377d138c3cf7a309186bf8579abc16480963e3db3a76dbd180b95 Jun 03 00:49:24.441152 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.441020 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-5h5b7"] Jun 03 00:49:24.443508 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:49:24.443468 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51720b0b_2d27_4e3a_8ce1_86aa8f26d99c.slice/crio-54924b5700ffc76b1beee77ae5d7e1928769d3d6e9eacc9781cb1a08f0f37f62 WatchSource:0}: Error finding container 54924b5700ffc76b1beee77ae5d7e1928769d3d6e9eacc9781cb1a08f0f37f62: Status 404 returned error can't find the container with id 54924b5700ffc76b1beee77ae5d7e1928769d3d6e9eacc9781cb1a08f0f37f62 Jun 03 00:49:24.448724 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.448702 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-registry-tls\") pod \"image-registry-79485bd5f7-vzv9g\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:24.448828 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.448743 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d252e0f3-7f51-4be9-a89e-eb9712947b24-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rb2zn\" (UID: \"d252e0f3-7f51-4be9-a89e-eb9712947b24\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rb2zn" Jun 03 00:49:24.448894 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:24.448865 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 00:49:24.448894 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:24.448867 2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 00:49:24.448894 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:24.448889 2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79485bd5f7-vzv9g: secret "image-registry-tls" not found Jun 03 00:49:24.449023 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:24.448936 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d252e0f3-7f51-4be9-a89e-eb9712947b24-samples-operator-tls podName:d252e0f3-7f51-4be9-a89e-eb9712947b24 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:25.448916933 +0000 UTC m=+36.147287406 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d252e0f3-7f51-4be9-a89e-eb9712947b24-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-rb2zn" (UID: "d252e0f3-7f51-4be9-a89e-eb9712947b24") : secret "samples-operator-tls" not found Jun 03 00:49:24.449023 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:24.448954 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-registry-tls podName:cb3e4bb4-793d-4303-9ee7-d168801986a5 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:25.448945867 +0000 UTC m=+36.147316343 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-registry-tls") pod "image-registry-79485bd5f7-vzv9g" (UID: "cb3e4bb4-793d-4303-9ee7-d168801986a5") : secret "image-registry-tls" not found Jun 03 00:49:24.549730 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.549678 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/70d6f7a4-8438-4163-8f07-b108e3a30736-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-kmx8n\" (UID: \"70d6f7a4-8438-4163-8f07-b108e3a30736\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kmx8n" Jun 03 00:49:24.549909 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:24.549823 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 00:49:24.549909 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:24.549895 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70d6f7a4-8438-4163-8f07-b108e3a30736-cluster-monitoring-operator-tls podName:70d6f7a4-8438-4163-8f07-b108e3a30736 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:25.54987411 +0000 UTC m=+36.248244593 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/70d6f7a4-8438-4163-8f07-b108e3a30736-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-kmx8n" (UID: "70d6f7a4-8438-4163-8f07-b108e3a30736") : secret "cluster-monitoring-operator-tls" not found Jun 03 00:49:24.650987 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.650950 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98e106c8-50c9-405e-b182-93fa1fe82bb0-service-ca-bundle\") pod \"router-default-7df748b4d9-d5wxd\" (UID: \"98e106c8-50c9-405e-b182-93fa1fe82bb0\") " pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:24.651149 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.651035 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ec8846c3-927f-4591-ab53-8ade3a5ae809-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-vpcqx\" (UID: \"ec8846c3-927f-4591-ab53-8ade3a5ae809\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vpcqx" Jun 03 00:49:24.651229 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:24.651149 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98e106c8-50c9-405e-b182-93fa1fe82bb0-service-ca-bundle podName:98e106c8-50c9-405e-b182-93fa1fe82bb0 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:25.651115712 +0000 UTC m=+36.349486192 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/98e106c8-50c9-405e-b182-93fa1fe82bb0-service-ca-bundle") pod "router-default-7df748b4d9-d5wxd" (UID: "98e106c8-50c9-405e-b182-93fa1fe82bb0") : configmap references non-existent config key: service-ca.crt Jun 03 00:49:24.651300 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.651120 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98e106c8-50c9-405e-b182-93fa1fe82bb0-metrics-certs\") pod \"router-default-7df748b4d9-d5wxd\" (UID: \"98e106c8-50c9-405e-b182-93fa1fe82bb0\") " pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:24.651300 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:24.651263 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 00:49:24.651391 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:24.651322 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98e106c8-50c9-405e-b182-93fa1fe82bb0-metrics-certs podName:98e106c8-50c9-405e-b182-93fa1fe82bb0 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:25.651305633 +0000 UTC m=+36.349676117 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/98e106c8-50c9-405e-b182-93fa1fe82bb0-metrics-certs") pod "router-default-7df748b4d9-d5wxd" (UID: "98e106c8-50c9-405e-b182-93fa1fe82bb0") : secret "router-metrics-certs-default" not found Jun 03 00:49:24.651391 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:24.651348 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 00:49:24.651391 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.651352 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/efc528c1-9886-493b-baae-3a407e726a91-cert\") pod \"ingress-canary-mvb7z\" (UID: \"efc528c1-9886-493b-baae-3a407e726a91\") " pod="openshift-ingress-canary/ingress-canary-mvb7z" Jun 03 00:49:24.651546 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:24.651395 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec8846c3-927f-4591-ab53-8ade3a5ae809-networking-console-plugin-cert podName:ec8846c3-927f-4591-ab53-8ade3a5ae809 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:25.651382417 +0000 UTC m=+36.349752887 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ec8846c3-927f-4591-ab53-8ade3a5ae809-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-vpcqx" (UID: "ec8846c3-927f-4591-ab53-8ade3a5ae809") : secret "networking-console-plugin-cert" not found Jun 03 00:49:24.651546 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:24.651402 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 00:49:24.651546 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:24.651435 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efc528c1-9886-493b-baae-3a407e726a91-cert podName:efc528c1-9886-493b-baae-3a407e726a91 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:25.65142383 +0000 UTC m=+36.349794301 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/efc528c1-9886-493b-baae-3a407e726a91-cert") pod "ingress-canary-mvb7z" (UID: "efc528c1-9886-493b-baae-3a407e726a91") : secret "canary-serving-cert" not found Jun 03 00:49:24.752263 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.752180 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1b3f280-8191-43b7-8885-0e3c3943141f-metrics-tls\") pod \"dns-default-xhlnm\" (UID: \"c1b3f280-8191-43b7-8885-0e3c3943141f\") " pod="openshift-dns/dns-default-xhlnm" Jun 03 00:49:24.752407 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:24.752336 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 00:49:24.752461 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:24.752410 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1b3f280-8191-43b7-8885-0e3c3943141f-metrics-tls podName:c1b3f280-8191-43b7-8885-0e3c3943141f nodeName:}" failed. No retries permitted until 2026-06-03 00:49:25.752390985 +0000 UTC m=+36.450761471 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1b3f280-8191-43b7-8885-0e3c3943141f-metrics-tls") pod "dns-default-xhlnm" (UID: "c1b3f280-8191-43b7-8885-0e3c3943141f") : secret "dns-default-metrics-tls" not found Jun 03 00:49:24.761994 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.761967 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg5ft" Jun 03 00:49:24.762138 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.761967 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:49:24.764592 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.764560 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 00:49:24.764720 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.764595 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9wvk5\"" Jun 03 00:49:24.764720 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.764603 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6vkdv\"" Jun 03 00:49:24.907271 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.907229 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-5h5b7" event={"ID":"51720b0b-2d27-4e3a-8ce1-86aa8f26d99c","Type":"ContainerStarted","Data":"54924b5700ffc76b1beee77ae5d7e1928769d3d6e9eacc9781cb1a08f0f37f62"} Jun 03 00:49:24.908301 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.908267 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-9thxf" event={"ID":"4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641","Type":"ContainerStarted","Data":"b66769cbaf3377d138c3cf7a309186bf8579abc16480963e3db3a76dbd180b95"} Jun 03 00:49:24.909661 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.909617 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-bqt4t" event={"ID":"73408f89-f08e-4719-b940-5acc39134ab3","Type":"ContainerStarted","Data":"da60a23babb17f4b2015892ba33295fdc5343f10608e679e511bff8b34e019c0"} Jun 03 00:49:24.910822 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.910794 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8srzc" event={"ID":"0ebe13d2-fdee-4751-9034-879309f00a91","Type":"ContainerStarted","Data":"4c37ae4434742d8d9ac48b877db5ccfab7122ff49516805f33d80e38df5cc3c5"} Jun 03 00:49:24.911923 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.911898 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-gvqx8" event={"ID":"b1724670-2476-4c56-977b-f55a85a996ca","Type":"ContainerStarted","Data":"8937b7035ba2138e16ed619bbf1e58ab25bf3f4d858f40c98eac71e2450a2560"} Jun 03 00:49:24.913188 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:24.913157 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-6vjwc" event={"ID":"6f02bc4d-0a22-4e33-938d-be35bdf34fd0","Type":"ContainerStarted","Data":"c6b1ccced0ef66b0bb5578199d16ec9108c1137c1b7abcef21212474489db7dd"} Jun 03 00:49:25.459784 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:25.459741 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-registry-tls\") pod \"image-registry-79485bd5f7-vzv9g\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:25.459953 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:25.459820 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d252e0f3-7f51-4be9-a89e-eb9712947b24-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rb2zn\" (UID: \"d252e0f3-7f51-4be9-a89e-eb9712947b24\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rb2zn" Jun 03 00:49:25.460402 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:25.460367 2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 00:49:25.460402 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:25.460400 2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79485bd5f7-vzv9g: secret "image-registry-tls" not found Jun 03 00:49:25.460573 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:25.460428 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 00:49:25.460573 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:25.460463 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-registry-tls podName:cb3e4bb4-793d-4303-9ee7-d168801986a5 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:27.460444027 +0000 UTC m=+38.158814498 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-registry-tls") pod "image-registry-79485bd5f7-vzv9g" (UID: "cb3e4bb4-793d-4303-9ee7-d168801986a5") : secret "image-registry-tls" not found Jun 03 00:49:25.460573 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:25.460496 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d252e0f3-7f51-4be9-a89e-eb9712947b24-samples-operator-tls podName:d252e0f3-7f51-4be9-a89e-eb9712947b24 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:27.460479411 +0000 UTC m=+38.158849895 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d252e0f3-7f51-4be9-a89e-eb9712947b24-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-rb2zn" (UID: "d252e0f3-7f51-4be9-a89e-eb9712947b24") : secret "samples-operator-tls" not found Jun 03 00:49:25.562973 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:25.562150 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/70d6f7a4-8438-4163-8f07-b108e3a30736-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-kmx8n\" (UID: \"70d6f7a4-8438-4163-8f07-b108e3a30736\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kmx8n" Jun 03 00:49:25.562973 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:25.562483 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 00:49:25.562973 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:25.562568 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70d6f7a4-8438-4163-8f07-b108e3a30736-cluster-monitoring-operator-tls podName:70d6f7a4-8438-4163-8f07-b108e3a30736 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:27.562548418 +0000 UTC m=+38.260918904 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/70d6f7a4-8438-4163-8f07-b108e3a30736-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-kmx8n" (UID: "70d6f7a4-8438-4163-8f07-b108e3a30736") : secret "cluster-monitoring-operator-tls" not found Jun 03 00:49:25.664736 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:25.663397 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ec8846c3-927f-4591-ab53-8ade3a5ae809-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-vpcqx\" (UID: \"ec8846c3-927f-4591-ab53-8ade3a5ae809\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vpcqx" Jun 03 00:49:25.664736 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:25.663492 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98e106c8-50c9-405e-b182-93fa1fe82bb0-metrics-certs\") pod \"router-default-7df748b4d9-d5wxd\" (UID: \"98e106c8-50c9-405e-b182-93fa1fe82bb0\") " pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:25.664736 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:25.663646 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/efc528c1-9886-493b-baae-3a407e726a91-cert\") pod \"ingress-canary-mvb7z\" (UID: \"efc528c1-9886-493b-baae-3a407e726a91\") " pod="openshift-ingress-canary/ingress-canary-mvb7z" Jun 03 00:49:25.664736 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:25.663724 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98e106c8-50c9-405e-b182-93fa1fe82bb0-service-ca-bundle\") pod \"router-default-7df748b4d9-d5wxd\" (UID: \"98e106c8-50c9-405e-b182-93fa1fe82bb0\") " pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:25.664736 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:25.663903 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98e106c8-50c9-405e-b182-93fa1fe82bb0-service-ca-bundle podName:98e106c8-50c9-405e-b182-93fa1fe82bb0 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:27.663884792 +0000 UTC m=+38.362255265 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/98e106c8-50c9-405e-b182-93fa1fe82bb0-service-ca-bundle") pod "router-default-7df748b4d9-d5wxd" (UID: "98e106c8-50c9-405e-b182-93fa1fe82bb0") : configmap references non-existent config key: service-ca.crt Jun 03 00:49:25.664736 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:25.664376 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 00:49:25.664736 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:25.664431 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec8846c3-927f-4591-ab53-8ade3a5ae809-networking-console-plugin-cert podName:ec8846c3-927f-4591-ab53-8ade3a5ae809 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:27.664414842 +0000 UTC m=+38.362785335 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ec8846c3-927f-4591-ab53-8ade3a5ae809-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-vpcqx" (UID: "ec8846c3-927f-4591-ab53-8ade3a5ae809") : secret "networking-console-plugin-cert" not found Jun 03 00:49:25.664736 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:25.664486 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 00:49:25.664736 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:25.664559 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98e106c8-50c9-405e-b182-93fa1fe82bb0-metrics-certs podName:98e106c8-50c9-405e-b182-93fa1fe82bb0 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:27.664505497 +0000 UTC m=+38.362876016 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/98e106c8-50c9-405e-b182-93fa1fe82bb0-metrics-certs") pod "router-default-7df748b4d9-d5wxd" (UID: "98e106c8-50c9-405e-b182-93fa1fe82bb0") : secret "router-metrics-certs-default" not found Jun 03 00:49:25.664736 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:25.664661 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 00:49:25.664736 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:25.664695 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efc528c1-9886-493b-baae-3a407e726a91-cert podName:efc528c1-9886-493b-baae-3a407e726a91 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:27.664684499 +0000 UTC m=+38.363054978 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/efc528c1-9886-493b-baae-3a407e726a91-cert") pod "ingress-canary-mvb7z" (UID: "efc528c1-9886-493b-baae-3a407e726a91") : secret "canary-serving-cert" not found Jun 03 00:49:25.767291 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:25.766585 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1b3f280-8191-43b7-8885-0e3c3943141f-metrics-tls\") pod \"dns-default-xhlnm\" (UID: \"c1b3f280-8191-43b7-8885-0e3c3943141f\") " pod="openshift-dns/dns-default-xhlnm" Jun 03 00:49:25.767291 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:25.766830 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 00:49:25.767291 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:25.766892 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1b3f280-8191-43b7-8885-0e3c3943141f-metrics-tls podName:c1b3f280-8191-43b7-8885-0e3c3943141f nodeName:}" failed. No retries permitted until 2026-06-03 00:49:27.766874766 +0000 UTC m=+38.465245239 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1b3f280-8191-43b7-8885-0e3c3943141f-metrics-tls") pod "dns-default-xhlnm" (UID: "c1b3f280-8191-43b7-8885-0e3c3943141f") : secret "dns-default-metrics-tls" not found Jun 03 00:49:27.486712 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:27.486438 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-registry-tls\") pod \"image-registry-79485bd5f7-vzv9g\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:27.487177 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:27.486761 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d252e0f3-7f51-4be9-a89e-eb9712947b24-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rb2zn\" (UID: \"d252e0f3-7f51-4be9-a89e-eb9712947b24\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rb2zn" Jun 03 00:49:27.487177 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:27.486577 2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 00:49:27.487177 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:27.487032 2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79485bd5f7-vzv9g: secret "image-registry-tls" not found Jun 03 00:49:27.487177 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:27.487092 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-registry-tls podName:cb3e4bb4-793d-4303-9ee7-d168801986a5 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:31.487074478 +0000 UTC m=+42.185444951 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-registry-tls") pod "image-registry-79485bd5f7-vzv9g" (UID: "cb3e4bb4-793d-4303-9ee7-d168801986a5") : secret "image-registry-tls" not found Jun 03 00:49:27.487569 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:27.487013 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 00:49:27.487569 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:27.487509 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d252e0f3-7f51-4be9-a89e-eb9712947b24-samples-operator-tls podName:d252e0f3-7f51-4be9-a89e-eb9712947b24 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:31.487493678 +0000 UTC m=+42.185864151 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d252e0f3-7f51-4be9-a89e-eb9712947b24-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-rb2zn" (UID: "d252e0f3-7f51-4be9-a89e-eb9712947b24") : secret "samples-operator-tls" not found Jun 03 00:49:27.588533 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:27.588114 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/70d6f7a4-8438-4163-8f07-b108e3a30736-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-kmx8n\" (UID: \"70d6f7a4-8438-4163-8f07-b108e3a30736\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kmx8n" Jun 03 00:49:27.588533 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:27.588302 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 00:49:27.588533 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:27.588372 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70d6f7a4-8438-4163-8f07-b108e3a30736-cluster-monitoring-operator-tls podName:70d6f7a4-8438-4163-8f07-b108e3a30736 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:31.588352342 +0000 UTC m=+42.286722814 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/70d6f7a4-8438-4163-8f07-b108e3a30736-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-kmx8n" (UID: "70d6f7a4-8438-4163-8f07-b108e3a30736") : secret "cluster-monitoring-operator-tls" not found Jun 03 00:49:27.688894 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:27.688857 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98e106c8-50c9-405e-b182-93fa1fe82bb0-service-ca-bundle\") pod \"router-default-7df748b4d9-d5wxd\" (UID: \"98e106c8-50c9-405e-b182-93fa1fe82bb0\") " pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:27.689085 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:27.688925 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ec8846c3-927f-4591-ab53-8ade3a5ae809-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-vpcqx\" (UID: \"ec8846c3-927f-4591-ab53-8ade3a5ae809\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vpcqx" Jun 03 00:49:27.689085 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:27.688992 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98e106c8-50c9-405e-b182-93fa1fe82bb0-metrics-certs\") pod \"router-default-7df748b4d9-d5wxd\" (UID: \"98e106c8-50c9-405e-b182-93fa1fe82bb0\") " pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:27.689085 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:27.689026 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98e106c8-50c9-405e-b182-93fa1fe82bb0-service-ca-bundle podName:98e106c8-50c9-405e-b182-93fa1fe82bb0 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:31.689007947 +0000 UTC m=+42.387378417 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/98e106c8-50c9-405e-b182-93fa1fe82bb0-service-ca-bundle") pod "router-default-7df748b4d9-d5wxd" (UID: "98e106c8-50c9-405e-b182-93fa1fe82bb0") : configmap references non-existent config key: service-ca.crt Jun 03 00:49:27.689269 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:27.689096 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/efc528c1-9886-493b-baae-3a407e726a91-cert\") pod \"ingress-canary-mvb7z\" (UID: \"efc528c1-9886-493b-baae-3a407e726a91\") " pod="openshift-ingress-canary/ingress-canary-mvb7z" Jun 03 00:49:27.689269 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:27.689123 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 00:49:27.689269 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:27.689188 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98e106c8-50c9-405e-b182-93fa1fe82bb0-metrics-certs podName:98e106c8-50c9-405e-b182-93fa1fe82bb0 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:31.689170893 +0000 UTC m=+42.387541378 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/98e106c8-50c9-405e-b182-93fa1fe82bb0-metrics-certs") pod "router-default-7df748b4d9-d5wxd" (UID: "98e106c8-50c9-405e-b182-93fa1fe82bb0") : secret "router-metrics-certs-default" not found Jun 03 00:49:27.689269 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:27.689127 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 00:49:27.689269 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:27.689257 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec8846c3-927f-4591-ab53-8ade3a5ae809-networking-console-plugin-cert podName:ec8846c3-927f-4591-ab53-8ade3a5ae809 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:31.689239945 +0000 UTC m=+42.387610431 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ec8846c3-927f-4591-ab53-8ade3a5ae809-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-vpcqx" (UID: "ec8846c3-927f-4591-ab53-8ade3a5ae809") : secret "networking-console-plugin-cert" not found Jun 03 00:49:27.689269 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:27.689199 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 00:49:27.689489 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:27.689303 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efc528c1-9886-493b-baae-3a407e726a91-cert podName:efc528c1-9886-493b-baae-3a407e726a91 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:31.689293415 +0000 UTC m=+42.387663891 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/efc528c1-9886-493b-baae-3a407e726a91-cert") pod "ingress-canary-mvb7z" (UID: "efc528c1-9886-493b-baae-3a407e726a91") : secret "canary-serving-cert" not found Jun 03 00:49:27.789976 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:27.789867 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1b3f280-8191-43b7-8885-0e3c3943141f-metrics-tls\") pod \"dns-default-xhlnm\" (UID: \"c1b3f280-8191-43b7-8885-0e3c3943141f\") " pod="openshift-dns/dns-default-xhlnm" Jun 03 00:49:27.790206 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:27.789978 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 00:49:27.790206 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:27.790061 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1b3f280-8191-43b7-8885-0e3c3943141f-metrics-tls podName:c1b3f280-8191-43b7-8885-0e3c3943141f nodeName:}" failed. No retries permitted until 2026-06-03 00:49:31.790039326 +0000 UTC m=+42.488409796 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1b3f280-8191-43b7-8885-0e3c3943141f-metrics-tls") pod "dns-default-xhlnm" (UID: "c1b3f280-8191-43b7-8885-0e3c3943141f") : secret "dns-default-metrics-tls" not found Jun 03 00:49:31.322614 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:31.322577 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da35388a-fef5-4cb2-865b-40d260126f3b-original-pull-secret\") pod \"global-pull-secret-syncer-f2dq6\" (UID: \"da35388a-fef5-4cb2-865b-40d260126f3b\") " pod="kube-system/global-pull-secret-syncer-f2dq6" Jun 03 00:49:31.326164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:31.326137 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da35388a-fef5-4cb2-865b-40d260126f3b-original-pull-secret\") pod \"global-pull-secret-syncer-f2dq6\" (UID: \"da35388a-fef5-4cb2-865b-40d260126f3b\") " pod="kube-system/global-pull-secret-syncer-f2dq6" Jun 03 00:49:31.525202 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:31.525153 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-registry-tls\") pod \"image-registry-79485bd5f7-vzv9g\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:31.525376 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:31.525232 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d252e0f3-7f51-4be9-a89e-eb9712947b24-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rb2zn\" (UID: \"d252e0f3-7f51-4be9-a89e-eb9712947b24\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rb2zn" Jun 03 00:49:31.525376 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:31.525335 2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 00:49:31.525376 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:31.525357 2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79485bd5f7-vzv9g: secret "image-registry-tls" not found Jun 03 00:49:31.525479 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:31.525391 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 00:49:31.525479 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:31.525421 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-registry-tls podName:cb3e4bb4-793d-4303-9ee7-d168801986a5 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:39.525404756 +0000 UTC m=+50.223775231 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-registry-tls") pod "image-registry-79485bd5f7-vzv9g" (UID: "cb3e4bb4-793d-4303-9ee7-d168801986a5") : secret "image-registry-tls" not found Jun 03 00:49:31.525479 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:31.525459 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d252e0f3-7f51-4be9-a89e-eb9712947b24-samples-operator-tls podName:d252e0f3-7f51-4be9-a89e-eb9712947b24 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:39.525446102 +0000 UTC m=+50.223816577 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d252e0f3-7f51-4be9-a89e-eb9712947b24-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-rb2zn" (UID: "d252e0f3-7f51-4be9-a89e-eb9712947b24") : secret "samples-operator-tls" not found Jun 03 00:49:31.590194 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:31.590106 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2dq6" Jun 03 00:49:31.625933 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:31.625895 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/70d6f7a4-8438-4163-8f07-b108e3a30736-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-kmx8n\" (UID: \"70d6f7a4-8438-4163-8f07-b108e3a30736\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kmx8n" Jun 03 00:49:31.626074 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:31.626055 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 00:49:31.626145 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:31.626132 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70d6f7a4-8438-4163-8f07-b108e3a30736-cluster-monitoring-operator-tls podName:70d6f7a4-8438-4163-8f07-b108e3a30736 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:39.626110021 +0000 UTC m=+50.324480513 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/70d6f7a4-8438-4163-8f07-b108e3a30736-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-kmx8n" (UID: "70d6f7a4-8438-4163-8f07-b108e3a30736") : secret "cluster-monitoring-operator-tls" not found Jun 03 00:49:31.726346 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:31.726308 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/efc528c1-9886-493b-baae-3a407e726a91-cert\") pod \"ingress-canary-mvb7z\" (UID: \"efc528c1-9886-493b-baae-3a407e726a91\") " pod="openshift-ingress-canary/ingress-canary-mvb7z" Jun 03 00:49:31.726567 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:31.726383 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98e106c8-50c9-405e-b182-93fa1fe82bb0-service-ca-bundle\") pod \"router-default-7df748b4d9-d5wxd\" (UID: \"98e106c8-50c9-405e-b182-93fa1fe82bb0\") " pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:31.726567 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:31.726437 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ec8846c3-927f-4591-ab53-8ade3a5ae809-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-vpcqx\" (UID: \"ec8846c3-927f-4591-ab53-8ade3a5ae809\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vpcqx" Jun 03 00:49:31.726567 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:31.726481 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 00:49:31.726567 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:31.726508 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98e106c8-50c9-405e-b182-93fa1fe82bb0-metrics-certs\") pod \"router-default-7df748b4d9-d5wxd\" (UID: \"98e106c8-50c9-405e-b182-93fa1fe82bb0\") " pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:31.726567 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:31.726536 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 00:49:31.726567 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:31.726565 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98e106c8-50c9-405e-b182-93fa1fe82bb0-service-ca-bundle podName:98e106c8-50c9-405e-b182-93fa1fe82bb0 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:39.726544391 +0000 UTC m=+50.424914882 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/98e106c8-50c9-405e-b182-93fa1fe82bb0-service-ca-bundle") pod "router-default-7df748b4d9-d5wxd" (UID: "98e106c8-50c9-405e-b182-93fa1fe82bb0") : configmap references non-existent config key: service-ca.crt Jun 03 00:49:31.726800 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:31.726590 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efc528c1-9886-493b-baae-3a407e726a91-cert podName:efc528c1-9886-493b-baae-3a407e726a91 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:39.726581235 +0000 UTC m=+50.424951711 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/efc528c1-9886-493b-baae-3a407e726a91-cert") pod "ingress-canary-mvb7z" (UID: "efc528c1-9886-493b-baae-3a407e726a91") : secret "canary-serving-cert" not found Jun 03 00:49:31.726800 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:31.726604 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec8846c3-927f-4591-ab53-8ade3a5ae809-networking-console-plugin-cert podName:ec8846c3-927f-4591-ab53-8ade3a5ae809 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:39.726597891 +0000 UTC m=+50.424968361 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ec8846c3-927f-4591-ab53-8ade3a5ae809-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-vpcqx" (UID: "ec8846c3-927f-4591-ab53-8ade3a5ae809") : secret "networking-console-plugin-cert" not found Jun 03 00:49:31.726800 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:31.726606 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 00:49:31.726800 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:31.726659 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98e106c8-50c9-405e-b182-93fa1fe82bb0-metrics-certs podName:98e106c8-50c9-405e-b182-93fa1fe82bb0 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:39.726644637 +0000 UTC m=+50.425015123 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/98e106c8-50c9-405e-b182-93fa1fe82bb0-metrics-certs") pod "router-default-7df748b4d9-d5wxd" (UID: "98e106c8-50c9-405e-b182-93fa1fe82bb0") : secret "router-metrics-certs-default" not found Jun 03 00:49:31.827008 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:31.826971 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1b3f280-8191-43b7-8885-0e3c3943141f-metrics-tls\") pod \"dns-default-xhlnm\" (UID: \"c1b3f280-8191-43b7-8885-0e3c3943141f\") " pod="openshift-dns/dns-default-xhlnm" Jun 03 00:49:31.827217 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:31.827150 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 00:49:31.827283 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:31.827237 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1b3f280-8191-43b7-8885-0e3c3943141f-metrics-tls podName:c1b3f280-8191-43b7-8885-0e3c3943141f nodeName:}" failed. No retries permitted until 2026-06-03 00:49:39.827216097 +0000 UTC m=+50.525586583 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1b3f280-8191-43b7-8885-0e3c3943141f-metrics-tls") pod "dns-default-xhlnm" (UID: "c1b3f280-8191-43b7-8885-0e3c3943141f") : secret "dns-default-metrics-tls" not found Jun 03 00:49:33.374954 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:33.374923 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f2dq6"] Jun 03 00:49:33.421125 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:49:33.421096 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda35388a_fef5_4cb2_865b_40d260126f3b.slice/crio-20618e396d3e8a84f3a57ccff8c94bc3bb90ad5470e2f85b5b4d3172646e7d0c WatchSource:0}: Error finding container 20618e396d3e8a84f3a57ccff8c94bc3bb90ad5470e2f85b5b4d3172646e7d0c: Status 404 returned error can't find the container with id 20618e396d3e8a84f3a57ccff8c94bc3bb90ad5470e2f85b5b4d3172646e7d0c Jun 03 00:49:33.938594 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:33.938563 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-bqt4t_73408f89-f08e-4719-b940-5acc39134ab3/console-operator/0.log" Jun 03 00:49:33.938802 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:33.938606 2558 generic.go:358] "Generic (PLEG): container finished" podID="73408f89-f08e-4719-b940-5acc39134ab3" containerID="424205c8f52f5b7561b4e3c612681872c89957a09baf93100019c0acdc344954" exitCode=255 Jun 03 00:49:33.938967 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:33.938916 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-bqt4t" event={"ID":"73408f89-f08e-4719-b940-5acc39134ab3","Type":"ContainerDied","Data":"424205c8f52f5b7561b4e3c612681872c89957a09baf93100019c0acdc344954"} Jun 03 00:49:33.939059 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:33.938984 2558 scope.go:117] "RemoveContainer" containerID="424205c8f52f5b7561b4e3c612681872c89957a09baf93100019c0acdc344954" Jun 03 00:49:33.940443 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:33.940378 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f2dq6" event={"ID":"da35388a-fef5-4cb2-865b-40d260126f3b","Type":"ContainerStarted","Data":"20618e396d3e8a84f3a57ccff8c94bc3bb90ad5470e2f85b5b4d3172646e7d0c"} Jun 03 00:49:33.947639 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:33.947512 2558 generic.go:358] "Generic (PLEG): container finished" podID="4aced56a-7b13-4d13-a18f-b189410b8b07" containerID="1e9cee6569b8afd8e05b1b2aedc826bc7dea9237d5351b7b7802342d9d5c0b5c" exitCode=0 Jun 03 00:49:33.947639 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:33.947605 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqkw8" event={"ID":"4aced56a-7b13-4d13-a18f-b189410b8b07","Type":"ContainerDied","Data":"1e9cee6569b8afd8e05b1b2aedc826bc7dea9237d5351b7b7802342d9d5c0b5c"} Jun 03 00:49:33.949554 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:33.949530 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8srzc" event={"ID":"0ebe13d2-fdee-4751-9034-879309f00a91","Type":"ContainerStarted","Data":"0201bdeeb70ffa14781f446c81dc335446e1cc3a27eb1273b523bff6585ce0f8"} Jun 03 00:49:33.955330 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:33.955305 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-gvqx8" event={"ID":"b1724670-2476-4c56-977b-f55a85a996ca","Type":"ContainerStarted","Data":"312573fb1dc8152a20e141faa73051fcdffbe33c1308b1f3cea8fe3e2f9b5826"} Jun 03 00:49:33.962442 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:33.962405 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-6vjwc" event={"ID":"6f02bc4d-0a22-4e33-938d-be35bdf34fd0","Type":"ContainerStarted","Data":"a7d1f1022136cffa51e3ba924c35f727339efdaf62bd1a0c37eb9080c0bc23a9"} Jun 03 00:49:33.965787 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:33.965395 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-5h5b7" event={"ID":"51720b0b-2d27-4e3a-8ce1-86aa8f26d99c","Type":"ContainerStarted","Data":"3646d32d95dda9d0af4e0dc8ce2e9b6b0cd0f54da86a0cb74b61955e21d2ed4b"} Jun 03 00:49:33.968019 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:33.967562 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-9thxf" event={"ID":"4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641","Type":"ContainerStarted","Data":"ad4bb0de239d6b186b02c2bc9d1194b6691a80c5abe3468734619ef9dd256c0c"} Jun 03 00:49:33.998268 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:33.997162 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-gvqx8" podStartSLOduration=6.12426138 podStartE2EDuration="14.997144162s" podCreationTimestamp="2026-06-03 00:49:19 +0000 UTC" firstStartedPulling="2026-06-03 00:49:24.377795038 +0000 UTC m=+35.076165508" lastFinishedPulling="2026-06-03 00:49:33.250677815 +0000 UTC m=+43.949048290" observedRunningTime="2026-06-03 00:49:33.974278745 +0000 UTC m=+44.672649238" watchObservedRunningTime="2026-06-03 00:49:33.997144162 +0000 UTC m=+44.695514657" Jun 03 00:49:34.014417 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:34.014362 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8srzc" podStartSLOduration=6.080403443 podStartE2EDuration="15.014341377s" podCreationTimestamp="2026-06-03 00:49:19 +0000 UTC" firstStartedPulling="2026-06-03 00:49:24.317858617 +0000 UTC m=+35.016229100" lastFinishedPulling="2026-06-03 00:49:33.251796549 +0000 UTC m=+43.950167034" observedRunningTime="2026-06-03 00:49:34.012828877 +0000 UTC m=+44.711199381" watchObservedRunningTime="2026-06-03 00:49:34.014341377 +0000 UTC m=+44.712711873" Jun 03 00:49:34.047830 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:34.044291 2558 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-bqt4t" Jun 03 00:49:34.049068 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:34.048219 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-bqt4t" Jun 03 00:49:34.058533 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:34.058337 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-9thxf" podStartSLOduration=6.196800678 podStartE2EDuration="15.058320005s" podCreationTimestamp="2026-06-03 00:49:19 +0000 UTC" firstStartedPulling="2026-06-03 00:49:24.389116314 +0000 UTC m=+35.087486785" lastFinishedPulling="2026-06-03 00:49:33.250635634 +0000 UTC m=+43.949006112" observedRunningTime="2026-06-03 00:49:34.035038602 +0000 UTC m=+44.733409095" watchObservedRunningTime="2026-06-03 00:49:34.058320005 +0000 UTC m=+44.756690498" Jun 03 00:49:34.075443 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:34.074650 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-6vjwc" podStartSLOduration=6.113904428 podStartE2EDuration="15.074634408s" podCreationTimestamp="2026-06-03 00:49:19 +0000 UTC" firstStartedPulling="2026-06-03 00:49:24.288066602 +0000 UTC m=+34.986437077" lastFinishedPulling="2026-06-03 00:49:33.248796579 +0000 UTC m=+43.947167057" observedRunningTime="2026-06-03 00:49:34.057899694 +0000 UTC m=+44.756270187" watchObservedRunningTime="2026-06-03 00:49:34.074634408 +0000 UTC m=+44.773004904" Jun 03 00:49:34.973751 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:34.973720 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-bqt4t_73408f89-f08e-4719-b940-5acc39134ab3/console-operator/1.log" Jun 03 00:49:34.974205 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:34.974137 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-bqt4t_73408f89-f08e-4719-b940-5acc39134ab3/console-operator/0.log" Jun 03 00:49:34.974205 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:34.974172 2558 generic.go:358] "Generic (PLEG): container finished" podID="73408f89-f08e-4719-b940-5acc39134ab3" containerID="b80c4cdab0571f36641e714b55e9902bbf384461ef647c7514f5cfec0007d2e3" exitCode=255 Jun 03 00:49:34.974318 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:34.974255 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-bqt4t" event={"ID":"73408f89-f08e-4719-b940-5acc39134ab3","Type":"ContainerDied","Data":"b80c4cdab0571f36641e714b55e9902bbf384461ef647c7514f5cfec0007d2e3"} Jun 03 00:49:34.974369 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:34.974292 2558 scope.go:117] "RemoveContainer" containerID="424205c8f52f5b7561b4e3c612681872c89957a09baf93100019c0acdc344954" Jun 03 00:49:34.975120 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:34.974617 2558 scope.go:117] "RemoveContainer" containerID="b80c4cdab0571f36641e714b55e9902bbf384461ef647c7514f5cfec0007d2e3" Jun 03 00:49:34.975120 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:34.974854 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-bqt4t_openshift-console-operator(73408f89-f08e-4719-b940-5acc39134ab3)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-bqt4t" podUID="73408f89-f08e-4719-b940-5acc39134ab3" Jun 03 00:49:34.979473 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:34.979007 2558 generic.go:358] "Generic (PLEG): container finished" podID="4aced56a-7b13-4d13-a18f-b189410b8b07" containerID="f073eb5005c5ea395aec468a16c5fc02597a6148b27437094a603cd494bb3818" exitCode=0 Jun 03 00:49:34.979473 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:34.979225 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqkw8" event={"ID":"4aced56a-7b13-4d13-a18f-b189410b8b07","Type":"ContainerDied","Data":"f073eb5005c5ea395aec468a16c5fc02597a6148b27437094a603cd494bb3818"} Jun 03 00:49:34.992131 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:34.992084 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-5h5b7" podStartSLOduration=7.17913191 podStartE2EDuration="15.992069919s" podCreationTimestamp="2026-06-03 00:49:19 +0000 UTC" firstStartedPulling="2026-06-03 00:49:24.445938053 +0000 UTC m=+35.144308531" lastFinishedPulling="2026-06-03 00:49:33.258876068 +0000 UTC m=+43.957246540" observedRunningTime="2026-06-03 00:49:34.075355701 +0000 UTC m=+44.773726194" watchObservedRunningTime="2026-06-03 00:49:34.992069919 +0000 UTC m=+45.690440412" Jun 03 00:49:35.983710 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:35.983677 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-bqt4t_73408f89-f08e-4719-b940-5acc39134ab3/console-operator/1.log" Jun 03 00:49:35.984156 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:35.984123 2558 scope.go:117] "RemoveContainer" containerID="b80c4cdab0571f36641e714b55e9902bbf384461ef647c7514f5cfec0007d2e3" Jun 03 00:49:35.984375 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:35.984335 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-bqt4t_openshift-console-operator(73408f89-f08e-4719-b940-5acc39134ab3)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-bqt4t" podUID="73408f89-f08e-4719-b940-5acc39134ab3" Jun 03 00:49:35.987297 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:35.987272 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqkw8" event={"ID":"4aced56a-7b13-4d13-a18f-b189410b8b07","Type":"ContainerStarted","Data":"3e749ed31f2ca0a3b7e343ef003f6960c38d3facf5256003a705598dc0e625c1"} Jun 03 00:49:36.020592 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:36.020541 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wqkw8" podStartSLOduration=5.161094977 podStartE2EDuration="46.02052816s" podCreationTimestamp="2026-06-03 00:48:50 +0000 UTC" firstStartedPulling="2026-06-03 00:48:52.604181456 +0000 UTC m=+3.302551930" lastFinishedPulling="2026-06-03 00:49:33.46361463 +0000 UTC m=+44.161985113" observedRunningTime="2026-06-03 00:49:36.020136404 +0000 UTC m=+46.718506897" watchObservedRunningTime="2026-06-03 00:49:36.02052816 +0000 UTC m=+46.718898646" Jun 03 00:49:36.674875 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:36.674832 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2z5f7_d96991ed-c416-44f8-a04e-6f13f5d02ab8/dns-node-resolver/0.log" Jun 03 00:49:37.042622 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:37.042539 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-txrgw"] Jun 03 00:49:37.046969 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:37.046946 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-txrgw" Jun 03 00:49:37.049662 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:37.049633 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 00:49:37.050182 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:37.049703 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 00:49:37.050295 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:37.049980 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-crjds\"" Jun 03 00:49:37.055071 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:37.054803 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-txrgw"] Jun 03 00:49:37.079702 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:37.079661 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/18b7f7cc-985e-4434-b5fe-fe236d95cb37-crio-socket\") pod \"insights-runtime-extractor-txrgw\" (UID: \"18b7f7cc-985e-4434-b5fe-fe236d95cb37\") " pod="openshift-insights/insights-runtime-extractor-txrgw" Jun 03 00:49:37.079953 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:37.079884 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/18b7f7cc-985e-4434-b5fe-fe236d95cb37-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-txrgw\" (UID: \"18b7f7cc-985e-4434-b5fe-fe236d95cb37\") " pod="openshift-insights/insights-runtime-extractor-txrgw" Jun 03 00:49:37.080086 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:37.080039 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct99m\" (UniqueName: \"kubernetes.io/projected/18b7f7cc-985e-4434-b5fe-fe236d95cb37-kube-api-access-ct99m\") pod \"insights-runtime-extractor-txrgw\" (UID: \"18b7f7cc-985e-4434-b5fe-fe236d95cb37\") " pod="openshift-insights/insights-runtime-extractor-txrgw" Jun 03 00:49:37.080155 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:37.080118 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/18b7f7cc-985e-4434-b5fe-fe236d95cb37-data-volume\") pod \"insights-runtime-extractor-txrgw\" (UID: \"18b7f7cc-985e-4434-b5fe-fe236d95cb37\") " pod="openshift-insights/insights-runtime-extractor-txrgw" Jun 03 00:49:37.080207 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:37.080150 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/18b7f7cc-985e-4434-b5fe-fe236d95cb37-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txrgw\" (UID: \"18b7f7cc-985e-4434-b5fe-fe236d95cb37\") " pod="openshift-insights/insights-runtime-extractor-txrgw" Jun 03 00:49:37.180718 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:37.180680 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ct99m\" (UniqueName: \"kubernetes.io/projected/18b7f7cc-985e-4434-b5fe-fe236d95cb37-kube-api-access-ct99m\") pod \"insights-runtime-extractor-txrgw\" (UID: \"18b7f7cc-985e-4434-b5fe-fe236d95cb37\") " pod="openshift-insights/insights-runtime-extractor-txrgw" Jun 03 00:49:37.180890 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:37.180758 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/18b7f7cc-985e-4434-b5fe-fe236d95cb37-data-volume\") pod \"insights-runtime-extractor-txrgw\" (UID: \"18b7f7cc-985e-4434-b5fe-fe236d95cb37\") " pod="openshift-insights/insights-runtime-extractor-txrgw" Jun 03 00:49:37.180890 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:37.180781 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/18b7f7cc-985e-4434-b5fe-fe236d95cb37-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txrgw\" (UID: \"18b7f7cc-985e-4434-b5fe-fe236d95cb37\") " pod="openshift-insights/insights-runtime-extractor-txrgw" Jun 03 00:49:37.180890 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:37.180885 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/18b7f7cc-985e-4434-b5fe-fe236d95cb37-crio-socket\") pod \"insights-runtime-extractor-txrgw\" (UID: \"18b7f7cc-985e-4434-b5fe-fe236d95cb37\") " pod="openshift-insights/insights-runtime-extractor-txrgw" Jun 03 00:49:37.181073 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:37.180975 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 03 00:49:37.181073 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:37.181035 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18b7f7cc-985e-4434-b5fe-fe236d95cb37-insights-runtime-extractor-tls podName:18b7f7cc-985e-4434-b5fe-fe236d95cb37 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:37.681018092 +0000 UTC m=+48.379388575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/18b7f7cc-985e-4434-b5fe-fe236d95cb37-insights-runtime-extractor-tls") pod "insights-runtime-extractor-txrgw" (UID: "18b7f7cc-985e-4434-b5fe-fe236d95cb37") : secret "insights-runtime-extractor-tls" not found Jun 03 00:49:37.181182 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:37.181093 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/18b7f7cc-985e-4434-b5fe-fe236d95cb37-crio-socket\") pod \"insights-runtime-extractor-txrgw\" (UID: \"18b7f7cc-985e-4434-b5fe-fe236d95cb37\") " pod="openshift-insights/insights-runtime-extractor-txrgw" Jun 03 00:49:37.181182 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:37.181094 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/18b7f7cc-985e-4434-b5fe-fe236d95cb37-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-txrgw\" (UID: \"18b7f7cc-985e-4434-b5fe-fe236d95cb37\") " pod="openshift-insights/insights-runtime-extractor-txrgw" Jun 03 00:49:37.181182 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:37.181135 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/18b7f7cc-985e-4434-b5fe-fe236d95cb37-data-volume\") pod \"insights-runtime-extractor-txrgw\" (UID: \"18b7f7cc-985e-4434-b5fe-fe236d95cb37\") " pod="openshift-insights/insights-runtime-extractor-txrgw" Jun 03 00:49:37.181667 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:37.181640 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/18b7f7cc-985e-4434-b5fe-fe236d95cb37-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-txrgw\" (UID: \"18b7f7cc-985e-4434-b5fe-fe236d95cb37\") " pod="openshift-insights/insights-runtime-extractor-txrgw" Jun 03 00:49:37.192916 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:37.192897 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct99m\" (UniqueName: \"kubernetes.io/projected/18b7f7cc-985e-4434-b5fe-fe236d95cb37-kube-api-access-ct99m\") pod \"insights-runtime-extractor-txrgw\" (UID: \"18b7f7cc-985e-4434-b5fe-fe236d95cb37\") " pod="openshift-insights/insights-runtime-extractor-txrgw" Jun 03 00:49:37.677430 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:37.677402 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b6chf_68e85fe7-9edc-4ae9-9869-ac61b5746afd/node-ca/0.log" Jun 03 00:49:37.684918 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:37.684888 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/18b7f7cc-985e-4434-b5fe-fe236d95cb37-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txrgw\" (UID: \"18b7f7cc-985e-4434-b5fe-fe236d95cb37\") " pod="openshift-insights/insights-runtime-extractor-txrgw" Jun 03 00:49:37.685091 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:37.685058 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 03 00:49:37.685158 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:37.685131 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18b7f7cc-985e-4434-b5fe-fe236d95cb37-insights-runtime-extractor-tls podName:18b7f7cc-985e-4434-b5fe-fe236d95cb37 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:38.68511616 +0000 UTC m=+49.383486630 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/18b7f7cc-985e-4434-b5fe-fe236d95cb37-insights-runtime-extractor-tls") pod "insights-runtime-extractor-txrgw" (UID: "18b7f7cc-985e-4434-b5fe-fe236d95cb37") : secret "insights-runtime-extractor-tls" not found Jun 03 00:49:38.693819 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:38.693728 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/18b7f7cc-985e-4434-b5fe-fe236d95cb37-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txrgw\" (UID: \"18b7f7cc-985e-4434-b5fe-fe236d95cb37\") " pod="openshift-insights/insights-runtime-extractor-txrgw" Jun 03 00:49:38.694181 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:38.693878 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 03 00:49:38.694181 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:38.693960 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18b7f7cc-985e-4434-b5fe-fe236d95cb37-insights-runtime-extractor-tls podName:18b7f7cc-985e-4434-b5fe-fe236d95cb37 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:40.693943835 +0000 UTC m=+51.392314305 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/18b7f7cc-985e-4434-b5fe-fe236d95cb37-insights-runtime-extractor-tls") pod "insights-runtime-extractor-txrgw" (UID: "18b7f7cc-985e-4434-b5fe-fe236d95cb37") : secret "insights-runtime-extractor-tls" not found Jun 03 00:49:38.997666 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:38.997576 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f2dq6" event={"ID":"da35388a-fef5-4cb2-865b-40d260126f3b","Type":"ContainerStarted","Data":"9aecda890ed8fe04fb544650ed4174dce4f5b598203b224772ed674b81092e3c"} Jun 03 00:49:39.015347 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:39.015290 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-f2dq6" podStartSLOduration=35.054577766 podStartE2EDuration="40.015272093s" podCreationTimestamp="2026-06-03 00:48:59 +0000 UTC" firstStartedPulling="2026-06-03 00:49:33.431094962 +0000 UTC m=+44.129465431" lastFinishedPulling="2026-06-03 00:49:38.391789269 +0000 UTC m=+49.090159758" observedRunningTime="2026-06-03 00:49:39.014308278 +0000 UTC m=+49.712678769" watchObservedRunningTime="2026-06-03 00:49:39.015272093 +0000 UTC m=+49.713642585" Jun 03 00:49:39.601191 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:39.601156 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-registry-tls\") pod \"image-registry-79485bd5f7-vzv9g\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:39.601428 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:39.601205 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d252e0f3-7f51-4be9-a89e-eb9712947b24-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rb2zn\" (UID: \"d252e0f3-7f51-4be9-a89e-eb9712947b24\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rb2zn" Jun 03 00:49:39.601428 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:39.601327 2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 00:49:39.601428 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:39.601353 2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79485bd5f7-vzv9g: secret "image-registry-tls" not found Jun 03 00:49:39.601428 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:39.601382 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 00:49:39.601428 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:39.601434 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d252e0f3-7f51-4be9-a89e-eb9712947b24-samples-operator-tls podName:d252e0f3-7f51-4be9-a89e-eb9712947b24 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:55.601418344 +0000 UTC m=+66.299788819 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d252e0f3-7f51-4be9-a89e-eb9712947b24-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-rb2zn" (UID: "d252e0f3-7f51-4be9-a89e-eb9712947b24") : secret "samples-operator-tls" not found Jun 03 00:49:39.601713 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:39.601447 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-registry-tls podName:cb3e4bb4-793d-4303-9ee7-d168801986a5 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:55.601440019 +0000 UTC m=+66.299810490 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-registry-tls") pod "image-registry-79485bd5f7-vzv9g" (UID: "cb3e4bb4-793d-4303-9ee7-d168801986a5") : secret "image-registry-tls" not found Jun 03 00:49:39.702664 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:39.702629 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/70d6f7a4-8438-4163-8f07-b108e3a30736-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-kmx8n\" (UID: \"70d6f7a4-8438-4163-8f07-b108e3a30736\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kmx8n" Jun 03 00:49:39.703138 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:39.702760 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 00:49:39.703138 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:39.702839 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70d6f7a4-8438-4163-8f07-b108e3a30736-cluster-monitoring-operator-tls podName:70d6f7a4-8438-4163-8f07-b108e3a30736 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:55.702820611 +0000 UTC m=+66.401191082 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/70d6f7a4-8438-4163-8f07-b108e3a30736-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-kmx8n" (UID: "70d6f7a4-8438-4163-8f07-b108e3a30736") : secret "cluster-monitoring-operator-tls" not found Jun 03 00:49:39.802987 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:39.802950 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98e106c8-50c9-405e-b182-93fa1fe82bb0-service-ca-bundle\") pod \"router-default-7df748b4d9-d5wxd\" (UID: \"98e106c8-50c9-405e-b182-93fa1fe82bb0\") " pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:39.803176 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:39.803012 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ec8846c3-927f-4591-ab53-8ade3a5ae809-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-vpcqx\" (UID: \"ec8846c3-927f-4591-ab53-8ade3a5ae809\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vpcqx" Jun 03 00:49:39.803176 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:39.803055 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98e106c8-50c9-405e-b182-93fa1fe82bb0-metrics-certs\") pod \"router-default-7df748b4d9-d5wxd\" (UID: \"98e106c8-50c9-405e-b182-93fa1fe82bb0\") " pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:39.803176 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:39.803120 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98e106c8-50c9-405e-b182-93fa1fe82bb0-service-ca-bundle podName:98e106c8-50c9-405e-b182-93fa1fe82bb0 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:55.803102464 +0000 UTC m=+66.501472940 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/98e106c8-50c9-405e-b182-93fa1fe82bb0-service-ca-bundle") pod "router-default-7df748b4d9-d5wxd" (UID: "98e106c8-50c9-405e-b182-93fa1fe82bb0") : configmap references non-existent config key: service-ca.crt Jun 03 00:49:39.803176 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:39.803161 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/efc528c1-9886-493b-baae-3a407e726a91-cert\") pod \"ingress-canary-mvb7z\" (UID: \"efc528c1-9886-493b-baae-3a407e726a91\") " pod="openshift-ingress-canary/ingress-canary-mvb7z" Jun 03 00:49:39.803176 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:39.803167 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 00:49:39.803485 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:39.803226 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec8846c3-927f-4591-ab53-8ade3a5ae809-networking-console-plugin-cert podName:ec8846c3-927f-4591-ab53-8ade3a5ae809 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:55.803213504 +0000 UTC m=+66.501583990 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ec8846c3-927f-4591-ab53-8ade3a5ae809-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-vpcqx" (UID: "ec8846c3-927f-4591-ab53-8ade3a5ae809") : secret "networking-console-plugin-cert" not found Jun 03 00:49:39.803485 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:39.803235 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 00:49:39.803485 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:39.803267 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 00:49:39.803485 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:39.803302 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98e106c8-50c9-405e-b182-93fa1fe82bb0-metrics-certs podName:98e106c8-50c9-405e-b182-93fa1fe82bb0 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:55.803285063 +0000 UTC m=+66.501655533 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/98e106c8-50c9-405e-b182-93fa1fe82bb0-metrics-certs") pod "router-default-7df748b4d9-d5wxd" (UID: "98e106c8-50c9-405e-b182-93fa1fe82bb0") : secret "router-metrics-certs-default" not found Jun 03 00:49:39.803485 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:39.803317 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efc528c1-9886-493b-baae-3a407e726a91-cert podName:efc528c1-9886-493b-baae-3a407e726a91 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:55.803310959 +0000 UTC m=+66.501681429 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/efc528c1-9886-493b-baae-3a407e726a91-cert") pod "ingress-canary-mvb7z" (UID: "efc528c1-9886-493b-baae-3a407e726a91") : secret "canary-serving-cert" not found Jun 03 00:49:39.903737 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:39.903651 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1b3f280-8191-43b7-8885-0e3c3943141f-metrics-tls\") pod \"dns-default-xhlnm\" (UID: \"c1b3f280-8191-43b7-8885-0e3c3943141f\") " pod="openshift-dns/dns-default-xhlnm" Jun 03 00:49:39.903871 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:39.903767 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 00:49:39.903871 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:39.903817 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1b3f280-8191-43b7-8885-0e3c3943141f-metrics-tls podName:c1b3f280-8191-43b7-8885-0e3c3943141f nodeName:}" failed. No retries permitted until 2026-06-03 00:49:55.903803241 +0000 UTC m=+66.602173711 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1b3f280-8191-43b7-8885-0e3c3943141f-metrics-tls") pod "dns-default-xhlnm" (UID: "c1b3f280-8191-43b7-8885-0e3c3943141f") : secret "dns-default-metrics-tls" not found Jun 03 00:49:40.711499 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:40.711454 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/18b7f7cc-985e-4434-b5fe-fe236d95cb37-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txrgw\" (UID: \"18b7f7cc-985e-4434-b5fe-fe236d95cb37\") " pod="openshift-insights/insights-runtime-extractor-txrgw" Jun 03 00:49:40.711926 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:40.711622 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 03 00:49:40.711926 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:40.711699 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18b7f7cc-985e-4434-b5fe-fe236d95cb37-insights-runtime-extractor-tls podName:18b7f7cc-985e-4434-b5fe-fe236d95cb37 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:44.711684404 +0000 UTC m=+55.410054874 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/18b7f7cc-985e-4434-b5fe-fe236d95cb37-insights-runtime-extractor-tls") pod "insights-runtime-extractor-txrgw" (UID: "18b7f7cc-985e-4434-b5fe-fe236d95cb37") : secret "insights-runtime-extractor-tls" not found Jun 03 00:49:44.044236 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:44.044195 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-bqt4t" Jun 03 00:49:44.044236 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:44.044243 2558 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-bqt4t" Jun 03 00:49:44.044687 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:44.044629 2558 scope.go:117] "RemoveContainer" containerID="b80c4cdab0571f36641e714b55e9902bbf384461ef647c7514f5cfec0007d2e3" Jun 03 00:49:44.044810 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:44.044793 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-bqt4t_openshift-console-operator(73408f89-f08e-4719-b940-5acc39134ab3)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-bqt4t" podUID="73408f89-f08e-4719-b940-5acc39134ab3" Jun 03 00:49:44.750074 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:44.750039 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/18b7f7cc-985e-4434-b5fe-fe236d95cb37-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txrgw\" (UID: \"18b7f7cc-985e-4434-b5fe-fe236d95cb37\") " pod="openshift-insights/insights-runtime-extractor-txrgw" Jun 03 00:49:44.750364 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:44.750173 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 03 00:49:44.750364 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:49:44.750245 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18b7f7cc-985e-4434-b5fe-fe236d95cb37-insights-runtime-extractor-tls podName:18b7f7cc-985e-4434-b5fe-fe236d95cb37 nodeName:}" failed. No retries permitted until 2026-06-03 00:49:52.750222713 +0000 UTC m=+63.448593190 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/18b7f7cc-985e-4434-b5fe-fe236d95cb37-insights-runtime-extractor-tls") pod "insights-runtime-extractor-txrgw" (UID: "18b7f7cc-985e-4434-b5fe-fe236d95cb37") : secret "insights-runtime-extractor-tls" not found Jun 03 00:49:49.912894 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:49.912866 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8zww" Jun 03 00:49:52.825545 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:52.825482 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/18b7f7cc-985e-4434-b5fe-fe236d95cb37-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txrgw\" (UID: \"18b7f7cc-985e-4434-b5fe-fe236d95cb37\") " pod="openshift-insights/insights-runtime-extractor-txrgw" Jun 03 00:49:52.827776 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:52.827748 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/18b7f7cc-985e-4434-b5fe-fe236d95cb37-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txrgw\" (UID: \"18b7f7cc-985e-4434-b5fe-fe236d95cb37\") " pod="openshift-insights/insights-runtime-extractor-txrgw" Jun 03 00:49:52.961240 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:52.961209 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-crjds\"" Jun 03 00:49:52.969122 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:52.969102 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-txrgw" Jun 03 00:49:53.090554 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:53.090509 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-txrgw"] Jun 03 00:49:53.092790 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:49:53.092759 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18b7f7cc_985e_4434_b5fe_fe236d95cb37.slice/crio-58c684882982f41e5a0705b3533ed5ac5020d3bb008398825bff352ecf02667d WatchSource:0}: Error finding container 58c684882982f41e5a0705b3533ed5ac5020d3bb008398825bff352ecf02667d: Status 404 returned error can't find the container with id 58c684882982f41e5a0705b3533ed5ac5020d3bb008398825bff352ecf02667d Jun 03 00:49:54.040592 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:54.040496 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-txrgw" event={"ID":"18b7f7cc-985e-4434-b5fe-fe236d95cb37","Type":"ContainerStarted","Data":"041bf461d7c5edd7d2734ef1a335922178b3f1b7bfd648f7b83076ce85820a76"} Jun 03 00:49:54.040592 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:54.040545 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-txrgw" event={"ID":"18b7f7cc-985e-4434-b5fe-fe236d95cb37","Type":"ContainerStarted","Data":"e77b79550042928bd9a29ea1031b9b84c1053abbe01ff3a8d8a1f211d7ca5c2c"} Jun 03 00:49:54.040592 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:54.040555 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-txrgw" event={"ID":"18b7f7cc-985e-4434-b5fe-fe236d95cb37","Type":"ContainerStarted","Data":"58c684882982f41e5a0705b3533ed5ac5020d3bb008398825bff352ecf02667d"} Jun 03 00:49:55.452032 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.451933 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/905babfb-1634-4e78-a4b5-177ab08e7a3d-metrics-certs\") pod \"network-metrics-daemon-x67bk\" (UID: \"905babfb-1634-4e78-a4b5-177ab08e7a3d\") " pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:49:55.454511 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.454488 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 00:49:55.464618 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.464592 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/905babfb-1634-4e78-a4b5-177ab08e7a3d-metrics-certs\") pod \"network-metrics-daemon-x67bk\" (UID: \"905babfb-1634-4e78-a4b5-177ab08e7a3d\") " pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:49:55.653816 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.653777 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-registry-tls\") pod \"image-registry-79485bd5f7-vzv9g\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:55.654010 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.653833 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d252e0f3-7f51-4be9-a89e-eb9712947b24-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rb2zn\" (UID: \"d252e0f3-7f51-4be9-a89e-eb9712947b24\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rb2zn" Jun 03 00:49:55.654010 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.653908 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9j72n\" (UniqueName: \"kubernetes.io/projected/a5e76234-ae70-4046-8dbe-95f3f0441488-kube-api-access-9j72n\") pod \"network-check-target-cg5ft\" (UID: \"a5e76234-ae70-4046-8dbe-95f3f0441488\") " pod="openshift-network-diagnostics/network-check-target-cg5ft" Jun 03 00:49:55.656360 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.656331 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-registry-tls\") pod \"image-registry-79485bd5f7-vzv9g\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:55.656461 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.656396 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d252e0f3-7f51-4be9-a89e-eb9712947b24-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rb2zn\" (UID: \"d252e0f3-7f51-4be9-a89e-eb9712947b24\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rb2zn" Jun 03 00:49:55.656532 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.656501 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j72n\" (UniqueName: \"kubernetes.io/projected/a5e76234-ae70-4046-8dbe-95f3f0441488-kube-api-access-9j72n\") pod \"network-check-target-cg5ft\" (UID: \"a5e76234-ae70-4046-8dbe-95f3f0441488\") " pod="openshift-network-diagnostics/network-check-target-cg5ft" Jun 03 00:49:55.676587 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.676563 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9wvk5\"" Jun 03 00:49:55.682763 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.682743 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6vkdv\"" Jun 03 00:49:55.684652 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.684637 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cg5ft" Jun 03 00:49:55.691315 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.691294 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x67bk" Jun 03 00:49:55.754851 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.754817 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/70d6f7a4-8438-4163-8f07-b108e3a30736-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-kmx8n\" (UID: \"70d6f7a4-8438-4163-8f07-b108e3a30736\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kmx8n" Jun 03 00:49:55.757626 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.757595 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/70d6f7a4-8438-4163-8f07-b108e3a30736-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-kmx8n\" (UID: \"70d6f7a4-8438-4163-8f07-b108e3a30736\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kmx8n" Jun 03 00:49:55.819773 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.819653 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x67bk"] Jun 03 00:49:55.822155 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:49:55.822125 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod905babfb_1634_4e78_a4b5_177ab08e7a3d.slice/crio-047598ce748f4526f8a924b8383b952ec0eda5dfb0b9334dc95f02ca20e6e856 WatchSource:0}: Error finding container 047598ce748f4526f8a924b8383b952ec0eda5dfb0b9334dc95f02ca20e6e856: Status 404 returned error can't find the container with id 047598ce748f4526f8a924b8383b952ec0eda5dfb0b9334dc95f02ca20e6e856 Jun 03 00:49:55.828764 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.828746 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-svvm2\"" Jun 03 00:49:55.833955 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.833936 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cg5ft"] Jun 03 00:49:55.835974 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:49:55.835954 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5e76234_ae70_4046_8dbe_95f3f0441488.slice/crio-ce758928d46c4d1a9b4f362a118ce6bf1eb73848c06f3bf7aadec53205899ae6 WatchSource:0}: Error finding container ce758928d46c4d1a9b4f362a118ce6bf1eb73848c06f3bf7aadec53205899ae6: Status 404 returned error can't find the container with id ce758928d46c4d1a9b4f362a118ce6bf1eb73848c06f3bf7aadec53205899ae6 Jun 03 00:49:55.836823 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.836809 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:55.855648 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.855604 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98e106c8-50c9-405e-b182-93fa1fe82bb0-metrics-certs\") pod \"router-default-7df748b4d9-d5wxd\" (UID: \"98e106c8-50c9-405e-b182-93fa1fe82bb0\") " pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:55.855772 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.855690 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/efc528c1-9886-493b-baae-3a407e726a91-cert\") pod \"ingress-canary-mvb7z\" (UID: \"efc528c1-9886-493b-baae-3a407e726a91\") " pod="openshift-ingress-canary/ingress-canary-mvb7z" Jun 03 00:49:55.855772 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.855742 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98e106c8-50c9-405e-b182-93fa1fe82bb0-service-ca-bundle\") pod \"router-default-7df748b4d9-d5wxd\" (UID: \"98e106c8-50c9-405e-b182-93fa1fe82bb0\") " pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:55.855932 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.855802 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ec8846c3-927f-4591-ab53-8ade3a5ae809-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-vpcqx\" (UID: \"ec8846c3-927f-4591-ab53-8ade3a5ae809\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vpcqx" Jun 03 00:49:55.856642 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.856620 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98e106c8-50c9-405e-b182-93fa1fe82bb0-service-ca-bundle\") pod \"router-default-7df748b4d9-d5wxd\" (UID: \"98e106c8-50c9-405e-b182-93fa1fe82bb0\") " pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:55.858109 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.858080 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98e106c8-50c9-405e-b182-93fa1fe82bb0-metrics-certs\") pod \"router-default-7df748b4d9-d5wxd\" (UID: \"98e106c8-50c9-405e-b182-93fa1fe82bb0\") " pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:55.858571 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.858549 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ec8846c3-927f-4591-ab53-8ade3a5ae809-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-vpcqx\" (UID: \"ec8846c3-927f-4591-ab53-8ade3a5ae809\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vpcqx" Jun 03 00:49:55.858659 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.858611 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/efc528c1-9886-493b-baae-3a407e726a91-cert\") pod \"ingress-canary-mvb7z\" (UID: \"efc528c1-9886-493b-baae-3a407e726a91\") " pod="openshift-ingress-canary/ingress-canary-mvb7z" Jun 03 00:49:55.863898 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.863880 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lfx49\"" Jun 03 00:49:55.871666 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.871647 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rb2zn" Jun 03 00:49:55.933786 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.933758 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-68scc\"" Jun 03 00:49:55.942340 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.942293 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kmx8n" Jun 03 00:49:55.956556 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.956495 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1b3f280-8191-43b7-8885-0e3c3943141f-metrics-tls\") pod \"dns-default-xhlnm\" (UID: \"c1b3f280-8191-43b7-8885-0e3c3943141f\") " pod="openshift-dns/dns-default-xhlnm" Jun 03 00:49:55.958665 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.958644 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1b3f280-8191-43b7-8885-0e3c3943141f-metrics-tls\") pod \"dns-default-xhlnm\" (UID: \"c1b3f280-8191-43b7-8885-0e3c3943141f\") " pod="openshift-dns/dns-default-xhlnm" Jun 03 00:49:55.985404 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:55.983579 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79485bd5f7-vzv9g"] Jun 03 00:49:55.998663 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:49:55.998255 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb3e4bb4_793d_4303_9ee7_d168801986a5.slice/crio-fe0876cbef70a5904280c2958f083f2783580fea5d4e4b74ee5f0b26291c5fad WatchSource:0}: Error finding container fe0876cbef70a5904280c2958f083f2783580fea5d4e4b74ee5f0b26291c5fad: Status 404 returned error can't find the container with id fe0876cbef70a5904280c2958f083f2783580fea5d4e4b74ee5f0b26291c5fad Jun 03 00:49:56.007086 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:56.007045 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-5chd8\"" Jun 03 00:49:56.008997 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:56.008928 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vpcqx" Jun 03 00:49:56.026162 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:56.026134 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-skfr9\"" Jun 03 00:49:56.033729 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:56.033705 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mvb7z" Jun 03 00:49:56.046687 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:56.046605 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rb2zn"] Jun 03 00:49:56.055087 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:56.055038 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-txrgw" event={"ID":"18b7f7cc-985e-4434-b5fe-fe236d95cb37","Type":"ContainerStarted","Data":"361d50fb04b6a446dc4fa75b4417dc92f45c86235a9bf5bb80af1f66195b56b4"} Jun 03 00:49:56.057132 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:56.056624 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" event={"ID":"cb3e4bb4-793d-4303-9ee7-d168801986a5","Type":"ContainerStarted","Data":"fe0876cbef70a5904280c2958f083f2783580fea5d4e4b74ee5f0b26291c5fad"} Jun 03 00:49:56.061256 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:56.059265 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x67bk" event={"ID":"905babfb-1634-4e78-a4b5-177ab08e7a3d","Type":"ContainerStarted","Data":"047598ce748f4526f8a924b8383b952ec0eda5dfb0b9334dc95f02ca20e6e856"} Jun 03 00:49:56.064114 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:56.063944 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cg5ft" event={"ID":"a5e76234-ae70-4046-8dbe-95f3f0441488","Type":"ContainerStarted","Data":"ba45b6a8303cf184622d8a7cb5ed580b798a55c2df232afa7a61758a7124e656"} Jun 03 00:49:56.064114 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:56.063976 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cg5ft" event={"ID":"a5e76234-ae70-4046-8dbe-95f3f0441488","Type":"ContainerStarted","Data":"ce758928d46c4d1a9b4f362a118ce6bf1eb73848c06f3bf7aadec53205899ae6"} Jun 03 00:49:56.064356 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:56.064170 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cg5ft" Jun 03 00:49:56.068014 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:56.067988 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-222jx\"" Jun 03 00:49:56.075784 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:56.075735 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:56.092140 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:56.090246 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cg5ft" podStartSLOduration=66.090226282 podStartE2EDuration="1m6.090226282s" podCreationTimestamp="2026-06-03 00:48:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:49:56.089398476 +0000 UTC m=+66.787768968" watchObservedRunningTime="2026-06-03 00:49:56.090226282 +0000 UTC m=+66.788596775" Jun 03 00:49:56.092462 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:56.092381 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-txrgw" podStartSLOduration=17.132855445 podStartE2EDuration="19.092368355s" podCreationTimestamp="2026-06-03 00:49:37 +0000 UTC" firstStartedPulling="2026-06-03 00:49:53.231768833 +0000 UTC m=+63.930139306" lastFinishedPulling="2026-06-03 00:49:55.191281738 +0000 UTC m=+65.889652216" observedRunningTime="2026-06-03 00:49:56.074632598 +0000 UTC m=+66.773003091" watchObservedRunningTime="2026-06-03 00:49:56.092368355 +0000 UTC m=+66.790738848" Jun 03 00:49:56.121006 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:56.120687 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kmx8n"] Jun 03 00:49:56.121401 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:56.121380 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9sxhx\"" Jun 03 00:49:56.123806 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:49:56.123304 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70d6f7a4_8438_4163_8f07_b108e3a30736.slice/crio-eeb11e3bb3f11913e6d6c057ecc15f790b8695635ae5787693c0b7d79389bc6f WatchSource:0}: Error finding container eeb11e3bb3f11913e6d6c057ecc15f790b8695635ae5787693c0b7d79389bc6f: Status 404 returned error can't find the container with id eeb11e3bb3f11913e6d6c057ecc15f790b8695635ae5787693c0b7d79389bc6f Jun 03 00:49:56.127803 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:56.127764 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xhlnm" Jun 03 00:49:56.183652 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:56.183622 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-vpcqx"] Jun 03 00:49:56.186963 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:49:56.186919 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec8846c3_927f_4591_ab53_8ade3a5ae809.slice/crio-c0002363841d5e1572c982010a88497e71b17b480c46065b301eb396422de3aa WatchSource:0}: Error finding container c0002363841d5e1572c982010a88497e71b17b480c46065b301eb396422de3aa: Status 404 returned error can't find the container with id c0002363841d5e1572c982010a88497e71b17b480c46065b301eb396422de3aa Jun 03 00:49:56.201321 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:56.201288 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mvb7z"] Jun 03 00:49:56.250288 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:56.250212 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7df748b4d9-d5wxd"] Jun 03 00:49:56.254290 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:49:56.254259 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98e106c8_50c9_405e_b182_93fa1fe82bb0.slice/crio-aec1e602d1bf0265c9856f2300bf0173bd8dee77fcb22d62f8a8d98444307bba WatchSource:0}: Error finding container aec1e602d1bf0265c9856f2300bf0173bd8dee77fcb22d62f8a8d98444307bba: Status 404 returned error can't find the container with id aec1e602d1bf0265c9856f2300bf0173bd8dee77fcb22d62f8a8d98444307bba Jun 03 00:49:56.283919 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:56.283892 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xhlnm"] Jun 03 00:49:56.287289 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:49:56.287260 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1b3f280_8191_43b7_8885_0e3c3943141f.slice/crio-03e596136099f777b69637c39b10716d47b93b93f6514290dbc5438d37603b77 WatchSource:0}: Error finding container 03e596136099f777b69637c39b10716d47b93b93f6514290dbc5438d37603b77: Status 404 returned error can't find the container with id 03e596136099f777b69637c39b10716d47b93b93f6514290dbc5438d37603b77 Jun 03 00:49:57.069815 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:57.069686 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xhlnm" event={"ID":"c1b3f280-8191-43b7-8885-0e3c3943141f","Type":"ContainerStarted","Data":"03e596136099f777b69637c39b10716d47b93b93f6514290dbc5438d37603b77"} Jun 03 00:49:57.074747 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:57.073975 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7df748b4d9-d5wxd" event={"ID":"98e106c8-50c9-405e-b182-93fa1fe82bb0","Type":"ContainerStarted","Data":"217ff322d5a6564e4b5fa9ec9a955ae515ce7aa80d276903b57fc5a0f5462483"} Jun 03 00:49:57.074747 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:57.074013 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7df748b4d9-d5wxd" event={"ID":"98e106c8-50c9-405e-b182-93fa1fe82bb0","Type":"ContainerStarted","Data":"aec1e602d1bf0265c9856f2300bf0173bd8dee77fcb22d62f8a8d98444307bba"} Jun 03 00:49:57.076625 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:57.076591 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:57.077358 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:57.077305 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kmx8n" event={"ID":"70d6f7a4-8438-4163-8f07-b108e3a30736","Type":"ContainerStarted","Data":"eeb11e3bb3f11913e6d6c057ecc15f790b8695635ae5787693c0b7d79389bc6f"} Jun 03 00:49:57.080197 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:57.080169 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:57.081672 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:57.081638 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rb2zn" event={"ID":"d252e0f3-7f51-4be9-a89e-eb9712947b24","Type":"ContainerStarted","Data":"c69b2ed1dd73f694843f983b15ea235f215281cb27569566273a76e77be4491a"} Jun 03 00:49:57.084134 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:57.083626 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" event={"ID":"cb3e4bb4-793d-4303-9ee7-d168801986a5","Type":"ContainerStarted","Data":"7f17c62ae28199cc2b59f91b41050b393d3c0738b919c4e81e1ec6201f0394e0"} Jun 03 00:49:57.084134 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:57.084075 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:49:57.085582 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:57.085508 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vpcqx" event={"ID":"ec8846c3-927f-4591-ab53-8ade3a5ae809","Type":"ContainerStarted","Data":"c0002363841d5e1572c982010a88497e71b17b480c46065b301eb396422de3aa"} Jun 03 00:49:57.087936 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:57.087337 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mvb7z" event={"ID":"efc528c1-9886-493b-baae-3a407e726a91","Type":"ContainerStarted","Data":"dbba4444704285a2793f994615411ebde08315e7a9aef04722ba26703aa38e6d"} Jun 03 00:49:57.101533 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:57.098240 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-7df748b4d9-d5wxd" podStartSLOduration=38.098223311 podStartE2EDuration="38.098223311s" podCreationTimestamp="2026-06-03 00:49:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:49:57.096507446 +0000 UTC m=+67.794877941" watchObservedRunningTime="2026-06-03 00:49:57.098223311 +0000 UTC m=+67.796593808" Jun 03 00:49:57.119013 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:57.118956 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" podStartSLOduration=67.118943448 podStartE2EDuration="1m7.118943448s" podCreationTimestamp="2026-06-03 00:48:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:49:57.117715489 +0000 UTC m=+67.816085982" watchObservedRunningTime="2026-06-03 00:49:57.118943448 +0000 UTC m=+67.817313943" Jun 03 00:49:58.092506 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:58.092389 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x67bk" event={"ID":"905babfb-1634-4e78-a4b5-177ab08e7a3d","Type":"ContainerStarted","Data":"c98500f835f1578464a62ae2d18ec6c0e36c1fb8b9f5ea5041d236a0d38622e2"} Jun 03 00:49:58.093001 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:58.092974 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:58.094201 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:58.094177 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7df748b4d9-d5wxd" Jun 03 00:49:58.762501 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:49:58.762472 2558 scope.go:117] "RemoveContainer" containerID="b80c4cdab0571f36641e714b55e9902bbf384461ef647c7514f5cfec0007d2e3" Jun 03 00:50:00.101018 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:00.100978 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x67bk" event={"ID":"905babfb-1634-4e78-a4b5-177ab08e7a3d","Type":"ContainerStarted","Data":"d8be590938e149305f8e5f6ff796005e82937166af2e7c8efe1374f9547e7f5a"} Jun 03 00:50:00.102725 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:00.102700 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vpcqx" event={"ID":"ec8846c3-927f-4591-ab53-8ade3a5ae809","Type":"ContainerStarted","Data":"ad9991f6fc6abb26550313d96e88305575338a72d239951679ebd0e1faaf9fec"} Jun 03 00:50:00.104083 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:00.104052 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mvb7z" event={"ID":"efc528c1-9886-493b-baae-3a407e726a91","Type":"ContainerStarted","Data":"1df16f587d5c580a2b87f4fe1b6f5eb9696b2494dd969e409ddfc9dd08c483b7"} Jun 03 00:50:00.105707 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:00.105681 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-bqt4t_73408f89-f08e-4719-b940-5acc39134ab3/console-operator/1.log" Jun 03 00:50:00.105797 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:00.105778 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-bqt4t" event={"ID":"73408f89-f08e-4719-b940-5acc39134ab3","Type":"ContainerStarted","Data":"22e9a6b9f9c2da143c696993068e005b51c10d042bd60f99d4bc71e017c9a359"} Jun 03 00:50:00.106267 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:00.106234 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-bqt4t" Jun 03 00:50:00.108083 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:00.108064 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xhlnm" event={"ID":"c1b3f280-8191-43b7-8885-0e3c3943141f","Type":"ContainerStarted","Data":"028f534e42c10a5f3aeba0d2bb5bbdf4be9807300b1f0c7bd4db851325d5483a"} Jun 03 00:50:00.108083 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:00.108088 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xhlnm" event={"ID":"c1b3f280-8191-43b7-8885-0e3c3943141f","Type":"ContainerStarted","Data":"ab583a4039b336a0cbfd7c9f1ce3877f419643f86267bece2fb07e8cdfcc093c"} Jun 03 00:50:00.108287 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:00.108194 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xhlnm" Jun 03 00:50:00.109438 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:00.109416 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kmx8n" event={"ID":"70d6f7a4-8438-4163-8f07-b108e3a30736","Type":"ContainerStarted","Data":"6800da9dc72d79ae9f36a9aace482dc5dbf4ad145f84598b444cdb5ac21b96b5"} Jun 03 00:50:00.111055 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:00.111033 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rb2zn" event={"ID":"d252e0f3-7f51-4be9-a89e-eb9712947b24","Type":"ContainerStarted","Data":"35d75c369c16271598de630434e96b294a93d5817c8714e1e7682afbe9f6a7b8"} Jun 03 00:50:00.111123 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:00.111072 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rb2zn" event={"ID":"d252e0f3-7f51-4be9-a89e-eb9712947b24","Type":"ContainerStarted","Data":"67d34292457ba54e43856f9cde58766dfd4561b3a203249244305f7eb6d67428"} Jun 03 00:50:00.118413 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:00.118365 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-x67bk" podStartSLOduration=69.620046803 podStartE2EDuration="1m11.118350609s" podCreationTimestamp="2026-06-03 00:48:49 +0000 UTC" firstStartedPulling="2026-06-03 00:49:55.824159968 +0000 UTC m=+66.522530441" lastFinishedPulling="2026-06-03 00:49:57.322463762 +0000 UTC m=+68.020834247" observedRunningTime="2026-06-03 00:50:00.117921436 +0000 UTC m=+70.816291941" watchObservedRunningTime="2026-06-03 00:50:00.118350609 +0000 UTC m=+70.816721102" Jun 03 00:50:00.137475 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:00.137404 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-bqt4t" podStartSLOduration=32.174201945 podStartE2EDuration="41.137391072s" podCreationTimestamp="2026-06-03 00:49:19 +0000 UTC" firstStartedPulling="2026-06-03 00:49:24.288760328 +0000 UTC m=+34.987130799" lastFinishedPulling="2026-06-03 00:49:33.251949442 +0000 UTC m=+43.950319926" observedRunningTime="2026-06-03 00:50:00.136688723 +0000 UTC m=+70.835059216" watchObservedRunningTime="2026-06-03 00:50:00.137391072 +0000 UTC m=+70.835761565" Jun 03 00:50:00.154277 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:00.154227 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kmx8n" podStartSLOduration=37.599208808 podStartE2EDuration="41.154217645s" podCreationTimestamp="2026-06-03 00:49:19 +0000 UTC" firstStartedPulling="2026-06-03 00:49:56.126334817 +0000 UTC m=+66.824705286" lastFinishedPulling="2026-06-03 00:49:59.681343639 +0000 UTC m=+70.379714123" observedRunningTime="2026-06-03 00:50:00.153906638 +0000 UTC m=+70.852277130" watchObservedRunningTime="2026-06-03 00:50:00.154217645 +0000 UTC m=+70.852588138" Jun 03 00:50:00.169573 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:00.169513 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vpcqx" podStartSLOduration=37.683127896 podStartE2EDuration="41.169501405s" podCreationTimestamp="2026-06-03 00:49:19 +0000 UTC" firstStartedPulling="2026-06-03 00:49:56.189661853 +0000 UTC m=+66.888032327" lastFinishedPulling="2026-06-03 00:49:59.676035354 +0000 UTC m=+70.374405836" observedRunningTime="2026-06-03 00:50:00.168406415 +0000 UTC m=+70.866776912" watchObservedRunningTime="2026-06-03 00:50:00.169501405 +0000 UTC m=+70.867871896" Jun 03 00:50:00.204385 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:00.204337 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mvb7z" podStartSLOduration=33.73248815 podStartE2EDuration="37.204325246s" podCreationTimestamp="2026-06-03 00:49:23 +0000 UTC" firstStartedPulling="2026-06-03 00:49:56.210038163 +0000 UTC m=+66.908408647" lastFinishedPulling="2026-06-03 00:49:59.681875267 +0000 UTC m=+70.380245743" observedRunningTime="2026-06-03 00:50:00.203156095 +0000 UTC m=+70.901526592" watchObservedRunningTime="2026-06-03 00:50:00.204325246 +0000 UTC m=+70.902695738" Jun 03 00:50:00.204611 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:00.204511 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rb2zn" podStartSLOduration=37.622411535 podStartE2EDuration="41.204502165s" podCreationTimestamp="2026-06-03 00:49:19 +0000 UTC" firstStartedPulling="2026-06-03 00:49:56.09924963 +0000 UTC m=+66.797620117" lastFinishedPulling="2026-06-03 00:49:59.681340269 +0000 UTC m=+70.379710747" observedRunningTime="2026-06-03 00:50:00.18451193 +0000 UTC m=+70.882882423" watchObservedRunningTime="2026-06-03 00:50:00.204502165 +0000 UTC m=+70.902872659" Jun 03 00:50:00.229489 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:00.229437 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-xhlnm" podStartSLOduration=33.837315511 podStartE2EDuration="37.229423438s" podCreationTimestamp="2026-06-03 00:49:23 +0000 UTC" firstStartedPulling="2026-06-03 00:49:56.289234759 +0000 UTC m=+66.987605243" lastFinishedPulling="2026-06-03 00:49:59.681342684 +0000 UTC m=+70.379713170" observedRunningTime="2026-06-03 00:50:00.228649459 +0000 UTC m=+70.927019952" watchObservedRunningTime="2026-06-03 00:50:00.229423438 +0000 UTC m=+70.927793965" Jun 03 00:50:00.847677 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:00.847646 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-bqt4t" Jun 03 00:50:01.027567 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:01.027526 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-5gm52"] Jun 03 00:50:01.030855 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:01.030837 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-5gm52" Jun 03 00:50:01.033279 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:01.033251 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 00:50:01.033401 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:01.033331 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 00:50:01.033401 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:01.033331 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-9sv9d\"" Jun 03 00:50:01.039763 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:01.039741 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-5gm52"] Jun 03 00:50:01.102728 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:01.102640 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjls4\" (UniqueName: \"kubernetes.io/projected/8a550a04-4cbd-4ae6-b8d0-0c3151f86a73-kube-api-access-jjls4\") pod \"downloads-c65b8dc4b-5gm52\" (UID: \"8a550a04-4cbd-4ae6-b8d0-0c3151f86a73\") " pod="openshift-console/downloads-c65b8dc4b-5gm52" Jun 03 00:50:01.204009 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:01.203973 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jjls4\" (UniqueName: \"kubernetes.io/projected/8a550a04-4cbd-4ae6-b8d0-0c3151f86a73-kube-api-access-jjls4\") pod \"downloads-c65b8dc4b-5gm52\" (UID: \"8a550a04-4cbd-4ae6-b8d0-0c3151f86a73\") " pod="openshift-console/downloads-c65b8dc4b-5gm52" Jun 03 00:50:01.212895 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:01.212865 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjls4\" (UniqueName: \"kubernetes.io/projected/8a550a04-4cbd-4ae6-b8d0-0c3151f86a73-kube-api-access-jjls4\") pod \"downloads-c65b8dc4b-5gm52\" (UID: \"8a550a04-4cbd-4ae6-b8d0-0c3151f86a73\") " pod="openshift-console/downloads-c65b8dc4b-5gm52" Jun 03 00:50:01.342190 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:01.342148 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-5gm52" Jun 03 00:50:01.466890 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:01.466784 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-5gm52"] Jun 03 00:50:01.469551 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:50:01.469505 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a550a04_4cbd_4ae6_b8d0_0c3151f86a73.slice/crio-b935d645f4f61ae4fd7f5eee9fd468d8afecdf18aad675c2908490d91c364374 WatchSource:0}: Error finding container b935d645f4f61ae4fd7f5eee9fd468d8afecdf18aad675c2908490d91c364374: Status 404 returned error can't find the container with id b935d645f4f61ae4fd7f5eee9fd468d8afecdf18aad675c2908490d91c364374 Jun 03 00:50:02.123172 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:02.123133 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-5gm52" event={"ID":"8a550a04-4cbd-4ae6-b8d0-0c3151f86a73","Type":"ContainerStarted","Data":"b935d645f4f61ae4fd7f5eee9fd468d8afecdf18aad675c2908490d91c364374"} Jun 03 00:50:10.120534 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.120475 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xhlnm" Jun 03 00:50:10.747988 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.747953 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wz9wp"] Jun 03 00:50:10.752637 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.752613 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wz9wp" Jun 03 00:50:10.756594 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.756572 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 00:50:10.756719 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.756681 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 00:50:10.756719 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.756708 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 00:50:10.756952 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.756933 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7drv6\"" Jun 03 00:50:10.757665 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.757640 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 00:50:10.772461 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.772436 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-szpvm"] Jun 03 00:50:10.775508 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.775490 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-szpvm" Jun 03 00:50:10.778409 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.778387 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 03 00:50:10.778508 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.778437 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 03 00:50:10.778852 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.778835 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 03 00:50:10.778980 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.778962 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-h7vv5\"" Jun 03 00:50:10.789686 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.789662 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-szpvm"] Jun 03 00:50:10.894002 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.893964 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6b42cdfd-0b61-4313-8eb0-8c10ccca5eca-root\") pod \"node-exporter-wz9wp\" (UID: \"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca\") " pod="openshift-monitoring/node-exporter-wz9wp" Jun 03 00:50:10.894189 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.894017 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6226e2a1-2c12-4787-9f93-a90248395773-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-szpvm\" (UID: \"6226e2a1-2c12-4787-9f93-a90248395773\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-szpvm" Jun 03 00:50:10.894189 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.894048 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b42cdfd-0b61-4313-8eb0-8c10ccca5eca-sys\") pod \"node-exporter-wz9wp\" (UID: \"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca\") " pod="openshift-monitoring/node-exporter-wz9wp" Jun 03 00:50:10.894189 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.894072 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6b42cdfd-0b61-4313-8eb0-8c10ccca5eca-node-exporter-wtmp\") pod \"node-exporter-wz9wp\" (UID: \"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca\") " pod="openshift-monitoring/node-exporter-wz9wp" Jun 03 00:50:10.894189 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.894102 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b42cdfd-0b61-4313-8eb0-8c10ccca5eca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wz9wp\" (UID: \"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca\") " pod="openshift-monitoring/node-exporter-wz9wp" Jun 03 00:50:10.894402 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.894189 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6b42cdfd-0b61-4313-8eb0-8c10ccca5eca-node-exporter-textfile\") pod \"node-exporter-wz9wp\" (UID: \"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca\") " pod="openshift-monitoring/node-exporter-wz9wp" Jun 03 00:50:10.894402 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.894236 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6226e2a1-2c12-4787-9f93-a90248395773-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-szpvm\" (UID: \"6226e2a1-2c12-4787-9f93-a90248395773\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-szpvm" Jun 03 00:50:10.894402 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.894280 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b42cdfd-0b61-4313-8eb0-8c10ccca5eca-metrics-client-ca\") pod \"node-exporter-wz9wp\" (UID: \"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca\") " pod="openshift-monitoring/node-exporter-wz9wp" Jun 03 00:50:10.894402 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.894301 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6226e2a1-2c12-4787-9f93-a90248395773-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-szpvm\" (UID: \"6226e2a1-2c12-4787-9f93-a90248395773\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-szpvm" Jun 03 00:50:10.894402 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.894328 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6b42cdfd-0b61-4313-8eb0-8c10ccca5eca-node-exporter-accelerators-collector-config\") pod \"node-exporter-wz9wp\" (UID: \"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca\") " pod="openshift-monitoring/node-exporter-wz9wp" Jun 03 00:50:10.894402 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.894383 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqsfq\" (UniqueName: \"kubernetes.io/projected/6b42cdfd-0b61-4313-8eb0-8c10ccca5eca-kube-api-access-dqsfq\") pod \"node-exporter-wz9wp\" (UID: \"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca\") " pod="openshift-monitoring/node-exporter-wz9wp" Jun 03 00:50:10.894731 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.894438 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6226e2a1-2c12-4787-9f93-a90248395773-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-szpvm\" (UID: \"6226e2a1-2c12-4787-9f93-a90248395773\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-szpvm" Jun 03 00:50:10.894731 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.894482 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55xr2\" (UniqueName: \"kubernetes.io/projected/6226e2a1-2c12-4787-9f93-a90248395773-kube-api-access-55xr2\") pod \"kube-state-metrics-8469c486bb-szpvm\" (UID: \"6226e2a1-2c12-4787-9f93-a90248395773\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-szpvm" Jun 03 00:50:10.894731 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.894557 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b42cdfd-0b61-4313-8eb0-8c10ccca5eca-node-exporter-tls\") pod \"node-exporter-wz9wp\" (UID: \"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca\") " pod="openshift-monitoring/node-exporter-wz9wp" Jun 03 00:50:10.894731 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.894593 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6226e2a1-2c12-4787-9f93-a90248395773-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-szpvm\" (UID: \"6226e2a1-2c12-4787-9f93-a90248395773\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-szpvm" Jun 03 00:50:10.995651 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.995616 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b42cdfd-0b61-4313-8eb0-8c10ccca5eca-node-exporter-tls\") pod \"node-exporter-wz9wp\" (UID: \"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca\") " pod="openshift-monitoring/node-exporter-wz9wp" Jun 03 00:50:10.995828 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.995662 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6226e2a1-2c12-4787-9f93-a90248395773-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-szpvm\" (UID: \"6226e2a1-2c12-4787-9f93-a90248395773\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-szpvm" Jun 03 00:50:10.995828 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.995704 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6b42cdfd-0b61-4313-8eb0-8c10ccca5eca-root\") pod \"node-exporter-wz9wp\" (UID: \"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca\") " pod="openshift-monitoring/node-exporter-wz9wp" Jun 03 00:50:10.995828 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.995730 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6226e2a1-2c12-4787-9f93-a90248395773-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-szpvm\" (UID: \"6226e2a1-2c12-4787-9f93-a90248395773\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-szpvm" Jun 03 00:50:10.995828 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.995755 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b42cdfd-0b61-4313-8eb0-8c10ccca5eca-sys\") pod \"node-exporter-wz9wp\" (UID: \"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca\") " pod="openshift-monitoring/node-exporter-wz9wp" Jun 03 00:50:10.995828 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.995776 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6b42cdfd-0b61-4313-8eb0-8c10ccca5eca-node-exporter-wtmp\") pod \"node-exporter-wz9wp\" (UID: \"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca\") " pod="openshift-monitoring/node-exporter-wz9wp" Jun 03 00:50:10.995828 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.995801 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b42cdfd-0b61-4313-8eb0-8c10ccca5eca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wz9wp\" (UID: \"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca\") " pod="openshift-monitoring/node-exporter-wz9wp" Jun 03 00:50:10.996127 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.995822 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6b42cdfd-0b61-4313-8eb0-8c10ccca5eca-root\") pod \"node-exporter-wz9wp\" (UID: \"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca\") " pod="openshift-monitoring/node-exporter-wz9wp" Jun 03 00:50:10.996127 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.995840 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6b42cdfd-0b61-4313-8eb0-8c10ccca5eca-node-exporter-textfile\") pod \"node-exporter-wz9wp\" (UID: \"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca\") " pod="openshift-monitoring/node-exporter-wz9wp" Jun 03 00:50:10.996127 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:50:10.995868 2558 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 03 00:50:10.996127 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.995877 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6226e2a1-2c12-4787-9f93-a90248395773-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-szpvm\" (UID: \"6226e2a1-2c12-4787-9f93-a90248395773\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-szpvm" Jun 03 00:50:10.996127 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.995917 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b42cdfd-0b61-4313-8eb0-8c10ccca5eca-sys\") pod \"node-exporter-wz9wp\" (UID: \"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca\") " pod="openshift-monitoring/node-exporter-wz9wp" Jun 03 00:50:10.996127 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.996025 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6b42cdfd-0b61-4313-8eb0-8c10ccca5eca-node-exporter-wtmp\") pod \"node-exporter-wz9wp\" (UID: \"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca\") " pod="openshift-monitoring/node-exporter-wz9wp" Jun 03 00:50:10.996425 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:50:10.996132 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6226e2a1-2c12-4787-9f93-a90248395773-kube-state-metrics-tls podName:6226e2a1-2c12-4787-9f93-a90248395773 nodeName:}" failed. No retries permitted until 2026-06-03 00:50:11.496104701 +0000 UTC m=+82.194475176 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/6226e2a1-2c12-4787-9f93-a90248395773-kube-state-metrics-tls") pod "kube-state-metrics-8469c486bb-szpvm" (UID: "6226e2a1-2c12-4787-9f93-a90248395773") : secret "kube-state-metrics-tls" not found Jun 03 00:50:10.996425 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.996179 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6b42cdfd-0b61-4313-8eb0-8c10ccca5eca-node-exporter-textfile\") pod \"node-exporter-wz9wp\" (UID: \"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca\") " pod="openshift-monitoring/node-exporter-wz9wp" Jun 03 00:50:10.996425 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.996231 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b42cdfd-0b61-4313-8eb0-8c10ccca5eca-metrics-client-ca\") pod \"node-exporter-wz9wp\" (UID: \"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca\") " pod="openshift-monitoring/node-exporter-wz9wp" Jun 03 00:50:10.996425 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.996269 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6226e2a1-2c12-4787-9f93-a90248395773-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-szpvm\" (UID: \"6226e2a1-2c12-4787-9f93-a90248395773\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-szpvm" Jun 03 00:50:10.996425 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.996305 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6b42cdfd-0b61-4313-8eb0-8c10ccca5eca-node-exporter-accelerators-collector-config\") pod \"node-exporter-wz9wp\" (UID: \"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca\") " pod="openshift-monitoring/node-exporter-wz9wp" Jun 03 00:50:10.996425 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.996332 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dqsfq\" (UniqueName: \"kubernetes.io/projected/6b42cdfd-0b61-4313-8eb0-8c10ccca5eca-kube-api-access-dqsfq\") pod \"node-exporter-wz9wp\" (UID: \"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca\") " pod="openshift-monitoring/node-exporter-wz9wp" Jun 03 00:50:10.996425 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.996355 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6226e2a1-2c12-4787-9f93-a90248395773-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-szpvm\" (UID: \"6226e2a1-2c12-4787-9f93-a90248395773\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-szpvm" Jun 03 00:50:10.996425 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.996391 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-55xr2\" (UniqueName: \"kubernetes.io/projected/6226e2a1-2c12-4787-9f93-a90248395773-kube-api-access-55xr2\") pod \"kube-state-metrics-8469c486bb-szpvm\" (UID: \"6226e2a1-2c12-4787-9f93-a90248395773\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-szpvm" Jun 03 00:50:10.996848 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.996613 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6226e2a1-2c12-4787-9f93-a90248395773-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-szpvm\" (UID: \"6226e2a1-2c12-4787-9f93-a90248395773\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-szpvm" Jun 03 00:50:10.996848 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.996619 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6226e2a1-2c12-4787-9f93-a90248395773-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-szpvm\" (UID: \"6226e2a1-2c12-4787-9f93-a90248395773\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-szpvm" Jun 03 00:50:10.996942 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.996855 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6226e2a1-2c12-4787-9f93-a90248395773-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-szpvm\" (UID: \"6226e2a1-2c12-4787-9f93-a90248395773\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-szpvm" Jun 03 00:50:10.997114 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.997087 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b42cdfd-0b61-4313-8eb0-8c10ccca5eca-metrics-client-ca\") pod \"node-exporter-wz9wp\" (UID: \"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca\") " pod="openshift-monitoring/node-exporter-wz9wp" Jun 03 00:50:10.997255 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.997212 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6b42cdfd-0b61-4313-8eb0-8c10ccca5eca-node-exporter-accelerators-collector-config\") pod \"node-exporter-wz9wp\" (UID: \"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca\") " pod="openshift-monitoring/node-exporter-wz9wp" Jun 03 00:50:10.998815 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.998749 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b42cdfd-0b61-4313-8eb0-8c10ccca5eca-node-exporter-tls\") pod \"node-exporter-wz9wp\" (UID: \"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca\") " pod="openshift-monitoring/node-exporter-wz9wp" Jun 03 00:50:10.999296 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.999269 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b42cdfd-0b61-4313-8eb0-8c10ccca5eca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wz9wp\" (UID: \"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca\") " pod="openshift-monitoring/node-exporter-wz9wp" Jun 03 00:50:10.999377 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:10.999326 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6226e2a1-2c12-4787-9f93-a90248395773-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-szpvm\" (UID: \"6226e2a1-2c12-4787-9f93-a90248395773\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-szpvm" Jun 03 00:50:11.005150 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.005117 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqsfq\" (UniqueName: \"kubernetes.io/projected/6b42cdfd-0b61-4313-8eb0-8c10ccca5eca-kube-api-access-dqsfq\") pod \"node-exporter-wz9wp\" (UID: \"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca\") " pod="openshift-monitoring/node-exporter-wz9wp" Jun 03 00:50:11.005277 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.005260 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55xr2\" (UniqueName: \"kubernetes.io/projected/6226e2a1-2c12-4787-9f93-a90248395773-kube-api-access-55xr2\") pod \"kube-state-metrics-8469c486bb-szpvm\" (UID: \"6226e2a1-2c12-4787-9f93-a90248395773\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-szpvm" Jun 03 00:50:11.063419 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.063380 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wz9wp" Jun 03 00:50:11.502057 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.502014 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6226e2a1-2c12-4787-9f93-a90248395773-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-szpvm\" (UID: \"6226e2a1-2c12-4787-9f93-a90248395773\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-szpvm" Jun 03 00:50:11.504694 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.504662 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6226e2a1-2c12-4787-9f93-a90248395773-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-szpvm\" (UID: \"6226e2a1-2c12-4787-9f93-a90248395773\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-szpvm" Jun 03 00:50:11.685952 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.685912 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-szpvm" Jun 03 00:50:11.836050 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.836013 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 00:50:11.841342 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.841318 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:11.844673 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.844648 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 00:50:11.845465 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.845434 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 00:50:11.845465 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.845455 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 00:50:11.845777 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.845725 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7bbzt\"" Jun 03 00:50:11.845777 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.845774 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 00:50:11.845996 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.845785 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 00:50:11.845996 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.845846 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 00:50:11.845996 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.845727 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 00:50:11.845996 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.845985 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 00:50:11.846697 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.846679 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 00:50:11.855896 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.855868 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 00:50:11.904697 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.904659 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd398da0-0769-4c68-9a70-7c1d89d5ec09-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:11.904871 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.904731 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-web-config\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:11.904871 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.904763 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22jcm\" (UniqueName: \"kubernetes.io/projected/bd398da0-0769-4c68-9a70-7c1d89d5ec09-kube-api-access-22jcm\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:11.904871 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.904864 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd398da0-0769-4c68-9a70-7c1d89d5ec09-config-out\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:11.905031 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.904890 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:11.905031 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.904919 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:11.905031 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.904997 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:11.905192 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.905038 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd398da0-0769-4c68-9a70-7c1d89d5ec09-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:11.905192 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.905068 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd398da0-0769-4c68-9a70-7c1d89d5ec09-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:11.905192 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.905098 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:11.905342 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.905183 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bd398da0-0769-4c68-9a70-7c1d89d5ec09-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:11.905342 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.905265 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-config-volume\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:11.905342 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:11.905294 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:12.005853 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:12.005808 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd398da0-0769-4c68-9a70-7c1d89d5ec09-config-out\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:12.006041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:12.005865 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:12.006041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:12.005896 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:12.006041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:12.005922 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:12.006041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:12.005960 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd398da0-0769-4c68-9a70-7c1d89d5ec09-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:12.006041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:12.005990 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd398da0-0769-4c68-9a70-7c1d89d5ec09-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:12.006041 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:12.006022 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:12.006357 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:12.006059 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bd398da0-0769-4c68-9a70-7c1d89d5ec09-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:12.006357 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:12.006092 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-config-volume\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:12.006357 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:12.006117 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:12.006357 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:12.006157 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd398da0-0769-4c68-9a70-7c1d89d5ec09-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:12.006357 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:50:12.006181 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd398da0-0769-4c68-9a70-7c1d89d5ec09-alertmanager-trusted-ca-bundle podName:bd398da0-0769-4c68-9a70-7c1d89d5ec09 nodeName:}" failed. No retries permitted until 2026-06-03 00:50:12.506152117 +0000 UTC m=+83.204522586 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/bd398da0-0769-4c68-9a70-7c1d89d5ec09-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "bd398da0-0769-4c68-9a70-7c1d89d5ec09") : configmap references non-existent config key: ca-bundle.crt Jun 03 00:50:12.006357 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:12.006247 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-web-config\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:12.006357 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:12.006278 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-22jcm\" (UniqueName: \"kubernetes.io/projected/bd398da0-0769-4c68-9a70-7c1d89d5ec09-kube-api-access-22jcm\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:12.006753 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:12.006606 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bd398da0-0769-4c68-9a70-7c1d89d5ec09-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:12.007814 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:12.007535 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd398da0-0769-4c68-9a70-7c1d89d5ec09-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:12.010148 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:12.010122 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd398da0-0769-4c68-9a70-7c1d89d5ec09-config-out\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:12.010323 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:12.010280 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:12.010575 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:12.010552 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:12.011105 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:12.011081 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd398da0-0769-4c68-9a70-7c1d89d5ec09-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:12.011922 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:12.011900 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-web-config\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:12.012025 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:12.011909 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:12.012025 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:12.011988 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:12.012235 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:12.012211 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:12.013447 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:12.013426 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-config-volume\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:12.014912 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:12.014890 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22jcm\" (UniqueName: \"kubernetes.io/projected/bd398da0-0769-4c68-9a70-7c1d89d5ec09-kube-api-access-22jcm\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:12.510836 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:12.510797 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd398da0-0769-4c68-9a70-7c1d89d5ec09-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:12.511832 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:12.511803 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd398da0-0769-4c68-9a70-7c1d89d5ec09-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:12.755584 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:12.755542 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:50:15.511317 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:15.511280 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-ddk6g"] Jun 03 00:50:15.516102 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:15.516077 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ddk6g" Jun 03 00:50:15.519132 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:15.518708 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 03 00:50:15.519132 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:15.518977 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-v7ghw\"" Jun 03 00:50:15.520677 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:15.520654 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-ddk6g"] Jun 03 00:50:15.539803 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:15.539771 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52c3e4e9-5715-4c35-9e2f-d049e962e81a-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-ddk6g\" (UID: \"52c3e4e9-5715-4c35-9e2f-d049e962e81a\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ddk6g" Jun 03 00:50:15.641215 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:15.641173 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52c3e4e9-5715-4c35-9e2f-d049e962e81a-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-ddk6g\" (UID: \"52c3e4e9-5715-4c35-9e2f-d049e962e81a\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ddk6g" Jun 03 00:50:15.641489 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:50:15.641324 2558 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 03 00:50:15.641489 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:50:15.641394 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52c3e4e9-5715-4c35-9e2f-d049e962e81a-monitoring-plugin-cert podName:52c3e4e9-5715-4c35-9e2f-d049e962e81a nodeName:}" failed. No retries permitted until 2026-06-03 00:50:16.141377143 +0000 UTC m=+86.839747613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/52c3e4e9-5715-4c35-9e2f-d049e962e81a-monitoring-plugin-cert") pod "monitoring-plugin-5768fcc9dd-ddk6g" (UID: "52c3e4e9-5715-4c35-9e2f-d049e962e81a") : secret "monitoring-plugin-cert" not found Jun 03 00:50:16.146234 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:16.146170 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52c3e4e9-5715-4c35-9e2f-d049e962e81a-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-ddk6g\" (UID: \"52c3e4e9-5715-4c35-9e2f-d049e962e81a\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ddk6g" Jun 03 00:50:16.148712 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:16.148681 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52c3e4e9-5715-4c35-9e2f-d049e962e81a-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-ddk6g\" (UID: \"52c3e4e9-5715-4c35-9e2f-d049e962e81a\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ddk6g" Jun 03 00:50:16.428164 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:16.428060 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ddk6g" Jun 03 00:50:16.934194 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:16.934156 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 00:50:16.938581 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:16.938561 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:16.941110 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:16.941085 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 00:50:16.941310 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:16.941085 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 00:50:16.941310 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:16.941214 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 00:50:16.942078 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:16.942055 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-l67srm36tqhr\"" Jun 03 00:50:16.942199 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:16.942176 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 00:50:16.942265 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:16.942186 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 00:50:16.942466 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:16.942325 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 00:50:16.942466 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:16.942387 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 00:50:16.942466 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:16.942450 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 00:50:16.942466 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:16.942459 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 00:50:16.942738 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:16.942686 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 00:50:16.943534 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:16.943362 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 00:50:16.943942 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:16.943922 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qfkb5\"" Jun 03 00:50:16.945170 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:16.945115 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 00:50:16.947856 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:16.947831 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 00:50:16.950211 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:16.950192 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 00:50:17.053202 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.053156 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.053393 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.053213 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.053393 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.053244 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.053393 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.053271 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-config\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.053393 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.053298 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.053393 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.053320 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.053393 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.053369 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.053740 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.053451 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8228210a-899b-431e-b606-70e67ae93825-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.053740 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.053495 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-web-config\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.053740 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.053538 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8228210a-899b-431e-b606-70e67ae93825-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.053740 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.053570 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8228210a-899b-431e-b606-70e67ae93825-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.053740 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.053623 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8228210a-899b-431e-b606-70e67ae93825-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.053740 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.053656 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8228210a-899b-431e-b606-70e67ae93825-config-out\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.053740 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.053683 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.053740 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.053721 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7b2q\" (UniqueName: \"kubernetes.io/projected/8228210a-899b-431e-b606-70e67ae93825-kube-api-access-k7b2q\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.054037 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.053756 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8228210a-899b-431e-b606-70e67ae93825-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.054037 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.053785 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8228210a-899b-431e-b606-70e67ae93825-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.054037 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.053813 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8228210a-899b-431e-b606-70e67ae93825-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.154514 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.154475 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.154696 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.154538 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.154696 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.154562 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-config\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.154696 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.154583 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.154696 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.154602 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.154696 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.154643 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.154696 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.154680 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8228210a-899b-431e-b606-70e67ae93825-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.154980 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.154709 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-web-config\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.154980 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.154732 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8228210a-899b-431e-b606-70e67ae93825-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.154980 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.154762 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8228210a-899b-431e-b606-70e67ae93825-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.154980 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.154809 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8228210a-899b-431e-b606-70e67ae93825-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.154980 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.154841 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8228210a-899b-431e-b606-70e67ae93825-config-out\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.154980 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.154863 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.154980 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.154883 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7b2q\" (UniqueName: \"kubernetes.io/projected/8228210a-899b-431e-b606-70e67ae93825-kube-api-access-k7b2q\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.154980 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.154917 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8228210a-899b-431e-b606-70e67ae93825-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.154980 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.154946 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8228210a-899b-431e-b606-70e67ae93825-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.154980 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.154975 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8228210a-899b-431e-b606-70e67ae93825-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.155658 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.155029 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.155658 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.155264 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8228210a-899b-431e-b606-70e67ae93825-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.156422 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.155855 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8228210a-899b-431e-b606-70e67ae93825-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.157028 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.156675 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8228210a-899b-431e-b606-70e67ae93825-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.158560 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.157916 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.158560 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.158181 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.158560 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.158503 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8228210a-899b-431e-b606-70e67ae93825-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.159502 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.159202 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.159502 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.159462 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8228210a-899b-431e-b606-70e67ae93825-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.160128 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.160099 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.160294 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.160276 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8228210a-899b-431e-b606-70e67ae93825-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.161205 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.161171 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.161205 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.161197 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-config\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.161467 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.161421 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8228210a-899b-431e-b606-70e67ae93825-config-out\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.161634 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.161614 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-web-config\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.161697 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.161647 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.162219 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.162200 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.163709 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.163687 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8228210a-899b-431e-b606-70e67ae93825-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.168361 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.168335 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7b2q\" (UniqueName: \"kubernetes.io/projected/8228210a-899b-431e-b606-70e67ae93825-kube-api-access-k7b2q\") pod \"prometheus-k8s-0\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:17.252556 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:17.252389 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:18.043128 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:18.043096 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 00:50:18.044154 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:50:18.044121 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8228210a_899b_431e_b606_70e67ae93825.slice/crio-22d59e01204af96c5af4b4ee36c857140d9f1b93a19ca93a1069ff57f8b74619 WatchSource:0}: Error finding container 22d59e01204af96c5af4b4ee36c857140d9f1b93a19ca93a1069ff57f8b74619: Status 404 returned error can't find the container with id 22d59e01204af96c5af4b4ee36c857140d9f1b93a19ca93a1069ff57f8b74619 Jun 03 00:50:18.097009 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:18.096931 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:50:18.177656 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:18.177618 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wz9wp" event={"ID":"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca","Type":"ContainerStarted","Data":"d9d464a69be02380bbd0a0d6ca111a60aa286671a735cd446c9d112652aef805"} Jun 03 00:50:18.179055 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:18.179021 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-5gm52" event={"ID":"8a550a04-4cbd-4ae6-b8d0-0c3151f86a73","Type":"ContainerStarted","Data":"ef3667d474fdc716edbc00bdc048041afd20be411a1b587c4837175d7227dc38"} Jun 03 00:50:18.179246 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:18.179223 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-5gm52" Jun 03 00:50:18.180240 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:18.180214 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8228210a-899b-431e-b606-70e67ae93825","Type":"ContainerStarted","Data":"22d59e01204af96c5af4b4ee36c857140d9f1b93a19ca93a1069ff57f8b74619"} Jun 03 00:50:18.180802 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:18.180765 2558 patch_prober.go:28] interesting pod/downloads-c65b8dc4b-5gm52 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.20:8080/\": dial tcp 10.132.0.20:8080: connect: connection refused" start-of-body= Jun 03 00:50:18.180863 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:18.180834 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-c65b8dc4b-5gm52" podUID="8a550a04-4cbd-4ae6-b8d0-0c3151f86a73" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.20:8080/\": dial tcp 10.132.0.20:8080: connect: connection refused" Jun 03 00:50:18.194799 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:18.194740 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-5gm52" podStartSLOduration=0.711631243 podStartE2EDuration="17.194722559s" podCreationTimestamp="2026-06-03 00:50:01 +0000 UTC" firstStartedPulling="2026-06-03 00:50:01.471629555 +0000 UTC m=+72.170000027" lastFinishedPulling="2026-06-03 00:50:17.954720871 +0000 UTC m=+88.653091343" observedRunningTime="2026-06-03 00:50:18.193826487 +0000 UTC m=+88.892196974" watchObservedRunningTime="2026-06-03 00:50:18.194722559 +0000 UTC m=+88.893093052" Jun 03 00:50:18.260914 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:18.260882 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-ddk6g"] Jun 03 00:50:18.263568 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:50:18.263506 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52c3e4e9_5715_4c35_9e2f_d049e962e81a.slice/crio-c633a0976ec6b822366478acf44428616dff2f068a0ce5a432292d2358982fc9 WatchSource:0}: Error finding container c633a0976ec6b822366478acf44428616dff2f068a0ce5a432292d2358982fc9: Status 404 returned error can't find the container with id c633a0976ec6b822366478acf44428616dff2f068a0ce5a432292d2358982fc9 Jun 03 00:50:18.264137 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:18.264083 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-szpvm"] Jun 03 00:50:18.267295 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:50:18.267257 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6226e2a1_2c12_4787_9f93_a90248395773.slice/crio-d10bcc4001ba2e1fbb5f70cc2e33f54d826163b255c1d152751fcc9e3d53e756 WatchSource:0}: Error finding container d10bcc4001ba2e1fbb5f70cc2e33f54d826163b255c1d152751fcc9e3d53e756: Status 404 returned error can't find the container with id d10bcc4001ba2e1fbb5f70cc2e33f54d826163b255c1d152751fcc9e3d53e756 Jun 03 00:50:18.270730 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:50:18.270540 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd398da0_0769_4c68_9a70_7c1d89d5ec09.slice/crio-0b712937aede39e4bbbd404f5dafee36f7fabb9aad5c197503ee08208e8eb9bd WatchSource:0}: Error finding container 0b712937aede39e4bbbd404f5dafee36f7fabb9aad5c197503ee08208e8eb9bd: Status 404 returned error can't find the container with id 0b712937aede39e4bbbd404f5dafee36f7fabb9aad5c197503ee08208e8eb9bd Jun 03 00:50:18.270861 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:18.270722 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 00:50:19.185177 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:19.185121 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ddk6g" event={"ID":"52c3e4e9-5715-4c35-9e2f-d049e962e81a","Type":"ContainerStarted","Data":"c633a0976ec6b822366478acf44428616dff2f068a0ce5a432292d2358982fc9"} Jun 03 00:50:19.186586 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:19.186544 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-szpvm" event={"ID":"6226e2a1-2c12-4787-9f93-a90248395773","Type":"ContainerStarted","Data":"d10bcc4001ba2e1fbb5f70cc2e33f54d826163b255c1d152751fcc9e3d53e756"} Jun 03 00:50:19.188643 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:19.188594 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd398da0-0769-4c68-9a70-7c1d89d5ec09","Type":"ContainerStarted","Data":"0b712937aede39e4bbbd404f5dafee36f7fabb9aad5c197503ee08208e8eb9bd"} Jun 03 00:50:19.206101 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:19.206062 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-5gm52" Jun 03 00:50:20.194006 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:20.193926 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wz9wp" event={"ID":"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca","Type":"ContainerStarted","Data":"808b4c1d2ed713b125752e33d770b0f168ddfe4ead838a87090c217f0054e3e0"} Jun 03 00:50:20.196541 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:20.196133 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8228210a-899b-431e-b606-70e67ae93825","Type":"ContainerStarted","Data":"2007debd4d5c471db3bd69e2b893b4539dcaa591603944cbc4e105b5c1a7129f"} Jun 03 00:50:20.605238 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:20.605201 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79485bd5f7-vzv9g"] Jun 03 00:50:21.201280 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:21.201242 2558 generic.go:358] "Generic (PLEG): container finished" podID="6b42cdfd-0b61-4313-8eb0-8c10ccca5eca" containerID="808b4c1d2ed713b125752e33d770b0f168ddfe4ead838a87090c217f0054e3e0" exitCode=0 Jun 03 00:50:21.201765 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:21.201329 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wz9wp" event={"ID":"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca","Type":"ContainerDied","Data":"808b4c1d2ed713b125752e33d770b0f168ddfe4ead838a87090c217f0054e3e0"} Jun 03 00:50:21.203165 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:21.203138 2558 generic.go:358] "Generic (PLEG): container finished" podID="8228210a-899b-431e-b606-70e67ae93825" containerID="2007debd4d5c471db3bd69e2b893b4539dcaa591603944cbc4e105b5c1a7129f" exitCode=0 Jun 03 00:50:21.203294 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:21.203214 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8228210a-899b-431e-b606-70e67ae93825","Type":"ContainerDied","Data":"2007debd4d5c471db3bd69e2b893b4539dcaa591603944cbc4e105b5c1a7129f"} Jun 03 00:50:21.204760 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:21.204734 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-szpvm" event={"ID":"6226e2a1-2c12-4787-9f93-a90248395773","Type":"ContainerStarted","Data":"6bc847d780cb656c54d0370aaaeeac6ded10b690b472d02e5a638b86d85fc1fa"} Jun 03 00:50:21.206395 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:21.206315 2558 generic.go:358] "Generic (PLEG): container finished" podID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerID="fa11feb81c32e0d6c50e3bd2b34c610c17415decd71d319e7ac5fa4bfee1faa5" exitCode=0 Jun 03 00:50:21.206395 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:21.206368 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd398da0-0769-4c68-9a70-7c1d89d5ec09","Type":"ContainerDied","Data":"fa11feb81c32e0d6c50e3bd2b34c610c17415decd71d319e7ac5fa4bfee1faa5"} Jun 03 00:50:22.216975 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:22.216028 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wz9wp" event={"ID":"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca","Type":"ContainerStarted","Data":"aabda5deb24d76ade1fbe5c9c9f87930f37df6b4258e587315072cee50d8002d"} Jun 03 00:50:22.216975 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:22.216075 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wz9wp" event={"ID":"6b42cdfd-0b61-4313-8eb0-8c10ccca5eca","Type":"ContainerStarted","Data":"6dd708eb927d15e186aa1aa5bb6c8170253bb1103341f214c431485a29d5c854"} Jun 03 00:50:22.221231 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:22.220395 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ddk6g" event={"ID":"52c3e4e9-5715-4c35-9e2f-d049e962e81a","Type":"ContainerStarted","Data":"3383948cbcd9b7f58104d9b66595bbee8ce11564df09fc8412337153f285330f"} Jun 03 00:50:22.221231 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:22.221134 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ddk6g" Jun 03 00:50:22.225710 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:22.225651 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-szpvm" event={"ID":"6226e2a1-2c12-4787-9f93-a90248395773","Type":"ContainerStarted","Data":"f19e0a9d725dfc81e9ee5f1891afab3243a676204e21893dc0de5a52c373fdd2"} Jun 03 00:50:22.225710 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:22.225689 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-szpvm" event={"ID":"6226e2a1-2c12-4787-9f93-a90248395773","Type":"ContainerStarted","Data":"5dc674fd4076e290312e482e953d0bc65a3e6990660165ed69da992d01e6ff04"} Jun 03 00:50:22.228106 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:22.228085 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ddk6g" Jun 03 00:50:22.240280 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:22.239758 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wz9wp" podStartSLOduration=10.500918092 podStartE2EDuration="12.239740567s" podCreationTimestamp="2026-06-03 00:50:10 +0000 UTC" firstStartedPulling="2026-06-03 00:50:17.872825969 +0000 UTC m=+88.571196439" lastFinishedPulling="2026-06-03 00:50:19.61164843 +0000 UTC m=+90.310018914" observedRunningTime="2026-06-03 00:50:22.236031928 +0000 UTC m=+92.934402421" watchObservedRunningTime="2026-06-03 00:50:22.239740567 +0000 UTC m=+92.938111060" Jun 03 00:50:22.256722 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:22.256661 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ddk6g" podStartSLOduration=4.061521942 podStartE2EDuration="7.256643338s" podCreationTimestamp="2026-06-03 00:50:15 +0000 UTC" firstStartedPulling="2026-06-03 00:50:18.265803518 +0000 UTC m=+88.964173988" lastFinishedPulling="2026-06-03 00:50:21.46092491 +0000 UTC m=+92.159295384" observedRunningTime="2026-06-03 00:50:22.254956999 +0000 UTC m=+92.953327538" watchObservedRunningTime="2026-06-03 00:50:22.256643338 +0000 UTC m=+92.955013831" Jun 03 00:50:22.278631 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:22.278392 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-szpvm" podStartSLOduration=10.052191671 podStartE2EDuration="12.278373805s" podCreationTimestamp="2026-06-03 00:50:10 +0000 UTC" firstStartedPulling="2026-06-03 00:50:18.271034238 +0000 UTC m=+88.969404712" lastFinishedPulling="2026-06-03 00:50:20.497216372 +0000 UTC m=+91.195586846" observedRunningTime="2026-06-03 00:50:22.277054459 +0000 UTC m=+92.975424955" watchObservedRunningTime="2026-06-03 00:50:22.278373805 +0000 UTC m=+92.976744298" Jun 03 00:50:26.249707 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:26.249666 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd398da0-0769-4c68-9a70-7c1d89d5ec09","Type":"ContainerStarted","Data":"30e042fa76ddc8c011188e00ef9491ffd70fcd373dce9bd33e6352562aaa9b7e"} Jun 03 00:50:26.250151 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:26.249715 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd398da0-0769-4c68-9a70-7c1d89d5ec09","Type":"ContainerStarted","Data":"ba2c3a7a3ee183bc63adc7a23c933cb6add9846e8a4b12611f0e689e025b5720"} Jun 03 00:50:26.250151 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:26.249730 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd398da0-0769-4c68-9a70-7c1d89d5ec09","Type":"ContainerStarted","Data":"f1ed9777843b321f79c2bfb08c115b79c577f4eaeb44b90ef6b9abece9be163b"} Jun 03 00:50:26.250151 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:26.249743 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd398da0-0769-4c68-9a70-7c1d89d5ec09","Type":"ContainerStarted","Data":"b9c8148cd784923cf5d2cb90962e5c3c6737b35175380dc9aa1266151f71d185"} Jun 03 00:50:26.250151 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:26.249760 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd398da0-0769-4c68-9a70-7c1d89d5ec09","Type":"ContainerStarted","Data":"dd439bad4422f7582ad03fc488947f987886631d019251821eb5bd325db73fa0"} Jun 03 00:50:26.252827 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:26.252791 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8228210a-899b-431e-b606-70e67ae93825","Type":"ContainerStarted","Data":"859f2eb01b5acf58faad5a3d29626199267b6fc05057e70ce7fb36cb581345d2"} Jun 03 00:50:26.253007 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:26.252829 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8228210a-899b-431e-b606-70e67ae93825","Type":"ContainerStarted","Data":"10e548e4a994be1c0e406dd36dd7094f54902a13b46a79388d3fdeba63741d9c"} Jun 03 00:50:27.090650 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:27.090614 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cg5ft" Jun 03 00:50:28.262236 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:28.262162 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd398da0-0769-4c68-9a70-7c1d89d5ec09","Type":"ContainerStarted","Data":"ade1fbd0f906adb11f4d7035caedb48604b9b3120f3321c15ab9a570b068cd00"} Jun 03 00:50:28.288959 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:28.288892 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=7.5682387779999996 podStartE2EDuration="17.288874371s" podCreationTimestamp="2026-06-03 00:50:11 +0000 UTC" firstStartedPulling="2026-06-03 00:50:18.273191932 +0000 UTC m=+88.971562405" lastFinishedPulling="2026-06-03 00:50:27.993827528 +0000 UTC m=+98.692197998" observedRunningTime="2026-06-03 00:50:28.28753526 +0000 UTC m=+98.985905753" watchObservedRunningTime="2026-06-03 00:50:28.288874371 +0000 UTC m=+98.987244864" Jun 03 00:50:29.268482 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:29.268435 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8228210a-899b-431e-b606-70e67ae93825","Type":"ContainerStarted","Data":"a3e229e1975253d51404406fa9f8b19f2c1d4c43a3d6c36288470da960c8832a"} Jun 03 00:50:29.268482 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:29.268478 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8228210a-899b-431e-b606-70e67ae93825","Type":"ContainerStarted","Data":"83e47388758696703f64fce55c121a0ee34ba84a562c286da23f4d86a5330c4c"} Jun 03 00:50:29.268482 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:29.268488 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8228210a-899b-431e-b606-70e67ae93825","Type":"ContainerStarted","Data":"6999cb2cbe44d5eb3adbbf85c0dce12c845c5bfa245711f4f7d86b32fd1df8fa"} Jun 03 00:50:29.269084 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:29.268496 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8228210a-899b-431e-b606-70e67ae93825","Type":"ContainerStarted","Data":"bb4a8fdec26b30494cfbf5eba7bdaf89122a30269bb5086fe8262e5af420ef19"} Jun 03 00:50:29.299932 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:29.299885 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.002851182 podStartE2EDuration="13.299870367s" podCreationTimestamp="2026-06-03 00:50:16 +0000 UTC" firstStartedPulling="2026-06-03 00:50:18.047057428 +0000 UTC m=+88.745427923" lastFinishedPulling="2026-06-03 00:50:28.344076624 +0000 UTC m=+99.042447108" observedRunningTime="2026-06-03 00:50:29.296744449 +0000 UTC m=+99.995114964" watchObservedRunningTime="2026-06-03 00:50:29.299870367 +0000 UTC m=+99.998240860" Jun 03 00:50:32.252955 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:32.252912 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:50:45.633712 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:45.633648 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" podUID="cb3e4bb4-793d-4303-9ee7-d168801986a5" containerName="registry" containerID="cri-o://7f17c62ae28199cc2b59f91b41050b393d3c0738b919c4e81e1ec6201f0394e0" gracePeriod=30 Jun 03 00:50:45.877893 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:45.877870 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:50:46.041551 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.041456 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cb3e4bb4-793d-4303-9ee7-d168801986a5-installation-pull-secrets\") pod \"cb3e4bb4-793d-4303-9ee7-d168801986a5\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " Jun 03 00:50:46.041551 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.041501 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cb3e4bb4-793d-4303-9ee7-d168801986a5-image-registry-private-configuration\") pod \"cb3e4bb4-793d-4303-9ee7-d168801986a5\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " Jun 03 00:50:46.041779 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.041555 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb3e4bb4-793d-4303-9ee7-d168801986a5-trusted-ca\") pod \"cb3e4bb4-793d-4303-9ee7-d168801986a5\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " Jun 03 00:50:46.041779 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.041593 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-registry-tls\") pod \"cb3e4bb4-793d-4303-9ee7-d168801986a5\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " Jun 03 00:50:46.041779 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.041618 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cb3e4bb4-793d-4303-9ee7-d168801986a5-registry-certificates\") pod \"cb3e4bb4-793d-4303-9ee7-d168801986a5\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " Jun 03 00:50:46.041779 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.041643 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9vf9\" (UniqueName: \"kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-kube-api-access-k9vf9\") pod \"cb3e4bb4-793d-4303-9ee7-d168801986a5\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " Jun 03 00:50:46.041779 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.041721 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-bound-sa-token\") pod \"cb3e4bb4-793d-4303-9ee7-d168801986a5\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " Jun 03 00:50:46.041779 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.041765 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cb3e4bb4-793d-4303-9ee7-d168801986a5-ca-trust-extracted\") pod \"cb3e4bb4-793d-4303-9ee7-d168801986a5\" (UID: \"cb3e4bb4-793d-4303-9ee7-d168801986a5\") " Jun 03 00:50:46.042095 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.042072 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb3e4bb4-793d-4303-9ee7-d168801986a5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "cb3e4bb4-793d-4303-9ee7-d168801986a5" (UID: "cb3e4bb4-793d-4303-9ee7-d168801986a5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 00:50:46.042447 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.042418 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb3e4bb4-793d-4303-9ee7-d168801986a5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "cb3e4bb4-793d-4303-9ee7-d168801986a5" (UID: "cb3e4bb4-793d-4303-9ee7-d168801986a5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 00:50:46.044604 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.044573 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb3e4bb4-793d-4303-9ee7-d168801986a5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "cb3e4bb4-793d-4303-9ee7-d168801986a5" (UID: "cb3e4bb4-793d-4303-9ee7-d168801986a5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:50:46.044713 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.044635 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb3e4bb4-793d-4303-9ee7-d168801986a5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "cb3e4bb4-793d-4303-9ee7-d168801986a5" (UID: "cb3e4bb4-793d-4303-9ee7-d168801986a5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:50:46.044713 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.044638 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-kube-api-access-k9vf9" (OuterVolumeSpecName: "kube-api-access-k9vf9") pod "cb3e4bb4-793d-4303-9ee7-d168801986a5" (UID: "cb3e4bb4-793d-4303-9ee7-d168801986a5"). InnerVolumeSpecName "kube-api-access-k9vf9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:50:46.044713 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.044675 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "cb3e4bb4-793d-4303-9ee7-d168801986a5" (UID: "cb3e4bb4-793d-4303-9ee7-d168801986a5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:50:46.044713 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.044683 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "cb3e4bb4-793d-4303-9ee7-d168801986a5" (UID: "cb3e4bb4-793d-4303-9ee7-d168801986a5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:50:46.050733 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.050694 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb3e4bb4-793d-4303-9ee7-d168801986a5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "cb3e4bb4-793d-4303-9ee7-d168801986a5" (UID: "cb3e4bb4-793d-4303-9ee7-d168801986a5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 00:50:46.143262 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.143230 2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cb3e4bb4-793d-4303-9ee7-d168801986a5-ca-trust-extracted\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:50:46.143262 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.143258 2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cb3e4bb4-793d-4303-9ee7-d168801986a5-installation-pull-secrets\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:50:46.143262 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.143270 2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cb3e4bb4-793d-4303-9ee7-d168801986a5-image-registry-private-configuration\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:50:46.143487 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.143280 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb3e4bb4-793d-4303-9ee7-d168801986a5-trusted-ca\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:50:46.143487 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.143289 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-registry-tls\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:50:46.143487 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.143297 2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cb3e4bb4-793d-4303-9ee7-d168801986a5-registry-certificates\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:50:46.143487 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.143312 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9vf9\" (UniqueName: \"kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-kube-api-access-k9vf9\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:50:46.143487 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.143329 2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb3e4bb4-793d-4303-9ee7-d168801986a5-bound-sa-token\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:50:46.325329 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.325292 2558 generic.go:358] "Generic (PLEG): container finished" podID="cb3e4bb4-793d-4303-9ee7-d168801986a5" containerID="7f17c62ae28199cc2b59f91b41050b393d3c0738b919c4e81e1ec6201f0394e0" exitCode=0 Jun 03 00:50:46.325509 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.325343 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" event={"ID":"cb3e4bb4-793d-4303-9ee7-d168801986a5","Type":"ContainerDied","Data":"7f17c62ae28199cc2b59f91b41050b393d3c0738b919c4e81e1ec6201f0394e0"} Jun 03 00:50:46.325509 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.325369 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" event={"ID":"cb3e4bb4-793d-4303-9ee7-d168801986a5","Type":"ContainerDied","Data":"fe0876cbef70a5904280c2958f083f2783580fea5d4e4b74ee5f0b26291c5fad"} Jun 03 00:50:46.325509 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.325375 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79485bd5f7-vzv9g" Jun 03 00:50:46.325509 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.325384 2558 scope.go:117] "RemoveContainer" containerID="7f17c62ae28199cc2b59f91b41050b393d3c0738b919c4e81e1ec6201f0394e0" Jun 03 00:50:46.334434 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.334415 2558 scope.go:117] "RemoveContainer" containerID="7f17c62ae28199cc2b59f91b41050b393d3c0738b919c4e81e1ec6201f0394e0" Jun 03 00:50:46.334699 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:50:46.334677 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f17c62ae28199cc2b59f91b41050b393d3c0738b919c4e81e1ec6201f0394e0\": container with ID starting with 7f17c62ae28199cc2b59f91b41050b393d3c0738b919c4e81e1ec6201f0394e0 not found: ID does not exist" containerID="7f17c62ae28199cc2b59f91b41050b393d3c0738b919c4e81e1ec6201f0394e0" Jun 03 00:50:46.334755 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.334707 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f17c62ae28199cc2b59f91b41050b393d3c0738b919c4e81e1ec6201f0394e0"} err="failed to get container status \"7f17c62ae28199cc2b59f91b41050b393d3c0738b919c4e81e1ec6201f0394e0\": rpc error: code = NotFound desc = could not find container \"7f17c62ae28199cc2b59f91b41050b393d3c0738b919c4e81e1ec6201f0394e0\": container with ID starting with 7f17c62ae28199cc2b59f91b41050b393d3c0738b919c4e81e1ec6201f0394e0 not found: ID does not exist" Jun 03 00:50:46.345374 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.345351 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79485bd5f7-vzv9g"] Jun 03 00:50:46.350984 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:46.350956 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-79485bd5f7-vzv9g"] Jun 03 00:50:47.766237 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:47.766196 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb3e4bb4-793d-4303-9ee7-d168801986a5" path="/var/lib/kubelet/pods/cb3e4bb4-793d-4303-9ee7-d168801986a5/volumes" Jun 03 00:50:50.338948 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:50.338917 2558 generic.go:358] "Generic (PLEG): container finished" podID="0ebe13d2-fdee-4751-9034-879309f00a91" containerID="0201bdeeb70ffa14781f446c81dc335446e1cc3a27eb1273b523bff6585ce0f8" exitCode=0 Jun 03 00:50:50.339335 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:50.338992 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8srzc" event={"ID":"0ebe13d2-fdee-4751-9034-879309f00a91","Type":"ContainerDied","Data":"0201bdeeb70ffa14781f446c81dc335446e1cc3a27eb1273b523bff6585ce0f8"} Jun 03 00:50:50.339380 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:50.339341 2558 scope.go:117] "RemoveContainer" containerID="0201bdeeb70ffa14781f446c81dc335446e1cc3a27eb1273b523bff6585ce0f8" Jun 03 00:50:51.343936 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:51.343903 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8srzc" event={"ID":"0ebe13d2-fdee-4751-9034-879309f00a91","Type":"ContainerStarted","Data":"550037f81745b75353c467331c93b25106b0861bed23dd2c40ba4de2947f1e48"} Jun 03 00:50:55.360956 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:55.360921 2558 generic.go:358] "Generic (PLEG): container finished" podID="b1724670-2476-4c56-977b-f55a85a996ca" containerID="312573fb1dc8152a20e141faa73051fcdffbe33c1308b1f3cea8fe3e2f9b5826" exitCode=0 Jun 03 00:50:55.361354 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:55.360996 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-gvqx8" event={"ID":"b1724670-2476-4c56-977b-f55a85a996ca","Type":"ContainerDied","Data":"312573fb1dc8152a20e141faa73051fcdffbe33c1308b1f3cea8fe3e2f9b5826"} Jun 03 00:50:55.361397 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:55.361354 2558 scope.go:117] "RemoveContainer" containerID="312573fb1dc8152a20e141faa73051fcdffbe33c1308b1f3cea8fe3e2f9b5826" Jun 03 00:50:56.365294 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:50:56.365257 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-gvqx8" event={"ID":"b1724670-2476-4c56-977b-f55a85a996ca","Type":"ContainerStarted","Data":"d8ab7ba0755307157492dfde4c074fe0b3e311ecefcfc505c2ef4671536db522"} Jun 03 00:51:00.379826 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:00.379792 2558 generic.go:358] "Generic (PLEG): container finished" podID="4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641" containerID="ad4bb0de239d6b186b02c2bc9d1194b6691a80c5abe3468734619ef9dd256c0c" exitCode=0 Jun 03 00:51:00.380308 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:00.379868 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-9thxf" event={"ID":"4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641","Type":"ContainerDied","Data":"ad4bb0de239d6b186b02c2bc9d1194b6691a80c5abe3468734619ef9dd256c0c"} Jun 03 00:51:00.380375 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:00.380316 2558 scope.go:117] "RemoveContainer" containerID="ad4bb0de239d6b186b02c2bc9d1194b6691a80c5abe3468734619ef9dd256c0c" Jun 03 00:51:01.384400 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:01.384363 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-9thxf" event={"ID":"4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641","Type":"ContainerStarted","Data":"b02be1d0d36b219f3fe706d3dd011241f00045fb12d5611a573b6a753fefd56e"} Jun 03 00:51:17.253439 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:17.253397 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:17.269288 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:17.269252 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:17.450043 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:17.450007 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:31.476791 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:31.476759 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-kmx8n_70d6f7a4-8438-4163-8f07-b108e3a30736/cluster-monitoring-operator/0.log" Jun 03 00:51:31.477182 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:31.476802 2558 generic.go:358] "Generic (PLEG): container finished" podID="70d6f7a4-8438-4163-8f07-b108e3a30736" containerID="6800da9dc72d79ae9f36a9aace482dc5dbf4ad145f84598b444cdb5ac21b96b5" exitCode=2 Jun 03 00:51:31.477182 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:31.476860 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kmx8n" event={"ID":"70d6f7a4-8438-4163-8f07-b108e3a30736","Type":"ContainerDied","Data":"6800da9dc72d79ae9f36a9aace482dc5dbf4ad145f84598b444cdb5ac21b96b5"} Jun 03 00:51:31.477182 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:31.477173 2558 scope.go:117] "RemoveContainer" containerID="6800da9dc72d79ae9f36a9aace482dc5dbf4ad145f84598b444cdb5ac21b96b5" Jun 03 00:51:32.481871 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:32.481844 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-kmx8n_70d6f7a4-8438-4163-8f07-b108e3a30736/cluster-monitoring-operator/0.log" Jun 03 00:51:32.482264 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:32.481938 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kmx8n" event={"ID":"70d6f7a4-8438-4163-8f07-b108e3a30736","Type":"ContainerStarted","Data":"ea9f1464468b611572d8e793f4843fe200c999086ec8f2f0c66bd025edbf44b5"} Jun 03 00:51:35.954385 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:35.954347 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 00:51:35.954822 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:35.954790 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerName="alertmanager" containerID="cri-o://dd439bad4422f7582ad03fc488947f987886631d019251821eb5bd325db73fa0" gracePeriod=120 Jun 03 00:51:35.954999 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:35.954878 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerName="kube-rbac-proxy-metric" containerID="cri-o://30e042fa76ddc8c011188e00ef9491ffd70fcd373dce9bd33e6352562aaa9b7e" gracePeriod=120 Jun 03 00:51:35.954999 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:35.954885 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerName="prom-label-proxy" containerID="cri-o://ade1fbd0f906adb11f4d7035caedb48604b9b3120f3321c15ab9a570b068cd00" gracePeriod=120 Jun 03 00:51:35.954999 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:35.954946 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerName="kube-rbac-proxy" containerID="cri-o://ba2c3a7a3ee183bc63adc7a23c933cb6add9846e8a4b12611f0e689e025b5720" gracePeriod=120 Jun 03 00:51:35.955260 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:35.954968 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerName="config-reloader" containerID="cri-o://b9c8148cd784923cf5d2cb90962e5c3c6737b35175380dc9aa1266151f71d185" gracePeriod=120 Jun 03 00:51:35.955260 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:35.954946 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerName="kube-rbac-proxy-web" containerID="cri-o://f1ed9777843b321f79c2bfb08c115b79c577f4eaeb44b90ef6b9abece9be163b" gracePeriod=120 Jun 03 00:51:36.497746 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:36.497704 2558 generic.go:358] "Generic (PLEG): container finished" podID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerID="ade1fbd0f906adb11f4d7035caedb48604b9b3120f3321c15ab9a570b068cd00" exitCode=0 Jun 03 00:51:36.497746 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:36.497732 2558 generic.go:358] "Generic (PLEG): container finished" podID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerID="ba2c3a7a3ee183bc63adc7a23c933cb6add9846e8a4b12611f0e689e025b5720" exitCode=0 Jun 03 00:51:36.497746 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:36.497741 2558 generic.go:358] "Generic (PLEG): container finished" podID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerID="b9c8148cd784923cf5d2cb90962e5c3c6737b35175380dc9aa1266151f71d185" exitCode=0 Jun 03 00:51:36.497746 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:36.497749 2558 generic.go:358] "Generic (PLEG): container finished" podID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerID="dd439bad4422f7582ad03fc488947f987886631d019251821eb5bd325db73fa0" exitCode=0 Jun 03 00:51:36.498012 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:36.497775 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd398da0-0769-4c68-9a70-7c1d89d5ec09","Type":"ContainerDied","Data":"ade1fbd0f906adb11f4d7035caedb48604b9b3120f3321c15ab9a570b068cd00"} Jun 03 00:51:36.498012 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:36.497811 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd398da0-0769-4c68-9a70-7c1d89d5ec09","Type":"ContainerDied","Data":"ba2c3a7a3ee183bc63adc7a23c933cb6add9846e8a4b12611f0e689e025b5720"} Jun 03 00:51:36.498012 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:36.497821 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd398da0-0769-4c68-9a70-7c1d89d5ec09","Type":"ContainerDied","Data":"b9c8148cd784923cf5d2cb90962e5c3c6737b35175380dc9aa1266151f71d185"} Jun 03 00:51:36.498012 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:36.497830 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd398da0-0769-4c68-9a70-7c1d89d5ec09","Type":"ContainerDied","Data":"dd439bad4422f7582ad03fc488947f987886631d019251821eb5bd325db73fa0"} Jun 03 00:51:37.213154 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.213133 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.387784 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.387748 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-secret-alertmanager-main-tls\") pod \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " Jun 03 00:51:37.387979 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.387792 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-secret-alertmanager-kube-rbac-proxy-web\") pod \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " Jun 03 00:51:37.387979 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.387836 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd398da0-0769-4c68-9a70-7c1d89d5ec09-tls-assets\") pod \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " Jun 03 00:51:37.387979 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.387938 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bd398da0-0769-4c68-9a70-7c1d89d5ec09-alertmanager-main-db\") pod \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " Jun 03 00:51:37.387979 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.387974 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd398da0-0769-4c68-9a70-7c1d89d5ec09-config-out\") pod \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " Jun 03 00:51:37.388206 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.388007 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-secret-alertmanager-kube-rbac-proxy\") pod \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " Jun 03 00:51:37.388206 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.388050 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-cluster-tls-config\") pod \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " Jun 03 00:51:37.388206 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.388092 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-secret-alertmanager-kube-rbac-proxy-metric\") pod \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " Jun 03 00:51:37.388206 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.388118 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd398da0-0769-4c68-9a70-7c1d89d5ec09-metrics-client-ca\") pod \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " Jun 03 00:51:37.388206 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.388165 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-config-volume\") pod \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " Jun 03 00:51:37.388206 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.388201 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-web-config\") pod \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " Jun 03 00:51:37.388576 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.388267 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd398da0-0769-4c68-9a70-7c1d89d5ec09-alertmanager-trusted-ca-bundle\") pod \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " Jun 03 00:51:37.388576 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.388288 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd398da0-0769-4c68-9a70-7c1d89d5ec09-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "bd398da0-0769-4c68-9a70-7c1d89d5ec09" (UID: "bd398da0-0769-4c68-9a70-7c1d89d5ec09"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 00:51:37.388576 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.388300 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22jcm\" (UniqueName: \"kubernetes.io/projected/bd398da0-0769-4c68-9a70-7c1d89d5ec09-kube-api-access-22jcm\") pod \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\" (UID: \"bd398da0-0769-4c68-9a70-7c1d89d5ec09\") " Jun 03 00:51:37.388735 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.388669 2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bd398da0-0769-4c68-9a70-7c1d89d5ec09-alertmanager-main-db\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:51:37.389156 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.388930 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd398da0-0769-4c68-9a70-7c1d89d5ec09-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "bd398da0-0769-4c68-9a70-7c1d89d5ec09" (UID: "bd398da0-0769-4c68-9a70-7c1d89d5ec09"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 00:51:37.391003 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.390737 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd398da0-0769-4c68-9a70-7c1d89d5ec09-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "bd398da0-0769-4c68-9a70-7c1d89d5ec09" (UID: "bd398da0-0769-4c68-9a70-7c1d89d5ec09"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:51:37.391003 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.390759 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "bd398da0-0769-4c68-9a70-7c1d89d5ec09" (UID: "bd398da0-0769-4c68-9a70-7c1d89d5ec09"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:51:37.391003 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.390825 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd398da0-0769-4c68-9a70-7c1d89d5ec09-config-out" (OuterVolumeSpecName: "config-out") pod "bd398da0-0769-4c68-9a70-7c1d89d5ec09" (UID: "bd398da0-0769-4c68-9a70-7c1d89d5ec09"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 00:51:37.391003 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.390830 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd398da0-0769-4c68-9a70-7c1d89d5ec09-kube-api-access-22jcm" (OuterVolumeSpecName: "kube-api-access-22jcm") pod "bd398da0-0769-4c68-9a70-7c1d89d5ec09" (UID: "bd398da0-0769-4c68-9a70-7c1d89d5ec09"). InnerVolumeSpecName "kube-api-access-22jcm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:51:37.391003 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.390934 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "bd398da0-0769-4c68-9a70-7c1d89d5ec09" (UID: "bd398da0-0769-4c68-9a70-7c1d89d5ec09"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:51:37.391249 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.391135 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd398da0-0769-4c68-9a70-7c1d89d5ec09-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "bd398da0-0769-4c68-9a70-7c1d89d5ec09" (UID: "bd398da0-0769-4c68-9a70-7c1d89d5ec09"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 00:51:37.391867 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.391836 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "bd398da0-0769-4c68-9a70-7c1d89d5ec09" (UID: "bd398da0-0769-4c68-9a70-7c1d89d5ec09"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:51:37.392690 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.392666 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-config-volume" (OuterVolumeSpecName: "config-volume") pod "bd398da0-0769-4c68-9a70-7c1d89d5ec09" (UID: "bd398da0-0769-4c68-9a70-7c1d89d5ec09"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:51:37.392911 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.392892 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "bd398da0-0769-4c68-9a70-7c1d89d5ec09" (UID: "bd398da0-0769-4c68-9a70-7c1d89d5ec09"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:51:37.395742 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.395721 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "bd398da0-0769-4c68-9a70-7c1d89d5ec09" (UID: "bd398da0-0769-4c68-9a70-7c1d89d5ec09"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:51:37.403402 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.403373 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-web-config" (OuterVolumeSpecName: "web-config") pod "bd398da0-0769-4c68-9a70-7c1d89d5ec09" (UID: "bd398da0-0769-4c68-9a70-7c1d89d5ec09"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:51:37.489138 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.489095 2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd398da0-0769-4c68-9a70-7c1d89d5ec09-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:51:37.489138 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.489132 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22jcm\" (UniqueName: \"kubernetes.io/projected/bd398da0-0769-4c68-9a70-7c1d89d5ec09-kube-api-access-22jcm\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:51:37.489138 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.489146 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-secret-alertmanager-main-tls\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:51:37.489402 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.489160 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:51:37.489402 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.489173 2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd398da0-0769-4c68-9a70-7c1d89d5ec09-tls-assets\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:51:37.489402 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.489184 2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd398da0-0769-4c68-9a70-7c1d89d5ec09-config-out\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:51:37.489402 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.489195 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:51:37.489402 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.489206 2558 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-cluster-tls-config\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:51:37.489402 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.489218 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:51:37.489402 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.489232 2558 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd398da0-0769-4c68-9a70-7c1d89d5ec09-metrics-client-ca\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:51:37.489402 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.489244 2558 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-config-volume\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:51:37.489402 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.489257 2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd398da0-0769-4c68-9a70-7c1d89d5ec09-web-config\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:51:37.503420 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.503375 2558 generic.go:358] "Generic (PLEG): container finished" podID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerID="30e042fa76ddc8c011188e00ef9491ffd70fcd373dce9bd33e6352562aaa9b7e" exitCode=0 Jun 03 00:51:37.503420 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.503411 2558 generic.go:358] "Generic (PLEG): container finished" podID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerID="f1ed9777843b321f79c2bfb08c115b79c577f4eaeb44b90ef6b9abece9be163b" exitCode=0 Jun 03 00:51:37.503637 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.503461 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd398da0-0769-4c68-9a70-7c1d89d5ec09","Type":"ContainerDied","Data":"30e042fa76ddc8c011188e00ef9491ffd70fcd373dce9bd33e6352562aaa9b7e"} Jun 03 00:51:37.503637 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.503488 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.503637 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.503508 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd398da0-0769-4c68-9a70-7c1d89d5ec09","Type":"ContainerDied","Data":"f1ed9777843b321f79c2bfb08c115b79c577f4eaeb44b90ef6b9abece9be163b"} Jun 03 00:51:37.503637 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.503535 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd398da0-0769-4c68-9a70-7c1d89d5ec09","Type":"ContainerDied","Data":"0b712937aede39e4bbbd404f5dafee36f7fabb9aad5c197503ee08208e8eb9bd"} Jun 03 00:51:37.503637 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.503541 2558 scope.go:117] "RemoveContainer" containerID="ade1fbd0f906adb11f4d7035caedb48604b9b3120f3321c15ab9a570b068cd00" Jun 03 00:51:37.511420 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.511319 2558 scope.go:117] "RemoveContainer" containerID="30e042fa76ddc8c011188e00ef9491ffd70fcd373dce9bd33e6352562aaa9b7e" Jun 03 00:51:37.518330 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.518313 2558 scope.go:117] "RemoveContainer" containerID="ba2c3a7a3ee183bc63adc7a23c933cb6add9846e8a4b12611f0e689e025b5720" Jun 03 00:51:37.525044 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.525030 2558 scope.go:117] "RemoveContainer" containerID="f1ed9777843b321f79c2bfb08c115b79c577f4eaeb44b90ef6b9abece9be163b" Jun 03 00:51:37.527679 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.527654 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 00:51:37.531767 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.531743 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 00:51:37.532753 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.532733 2558 scope.go:117] "RemoveContainer" containerID="b9c8148cd784923cf5d2cb90962e5c3c6737b35175380dc9aa1266151f71d185" Jun 03 00:51:37.539303 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.539285 2558 scope.go:117] "RemoveContainer" containerID="dd439bad4422f7582ad03fc488947f987886631d019251821eb5bd325db73fa0" Jun 03 00:51:37.546016 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.546000 2558 scope.go:117] "RemoveContainer" containerID="fa11feb81c32e0d6c50e3bd2b34c610c17415decd71d319e7ac5fa4bfee1faa5" Jun 03 00:51:37.552994 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.552971 2558 scope.go:117] "RemoveContainer" containerID="ade1fbd0f906adb11f4d7035caedb48604b9b3120f3321c15ab9a570b068cd00" Jun 03 00:51:37.553289 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:51:37.553268 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ade1fbd0f906adb11f4d7035caedb48604b9b3120f3321c15ab9a570b068cd00\": container with ID starting with ade1fbd0f906adb11f4d7035caedb48604b9b3120f3321c15ab9a570b068cd00 not found: ID does not exist" containerID="ade1fbd0f906adb11f4d7035caedb48604b9b3120f3321c15ab9a570b068cd00" Jun 03 00:51:37.553368 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.553299 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ade1fbd0f906adb11f4d7035caedb48604b9b3120f3321c15ab9a570b068cd00"} err="failed to get container status \"ade1fbd0f906adb11f4d7035caedb48604b9b3120f3321c15ab9a570b068cd00\": rpc error: code = NotFound desc = could not find container \"ade1fbd0f906adb11f4d7035caedb48604b9b3120f3321c15ab9a570b068cd00\": container with ID starting with ade1fbd0f906adb11f4d7035caedb48604b9b3120f3321c15ab9a570b068cd00 not found: ID does not exist" Jun 03 00:51:37.553368 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.553320 2558 scope.go:117] "RemoveContainer" containerID="30e042fa76ddc8c011188e00ef9491ffd70fcd373dce9bd33e6352562aaa9b7e" Jun 03 00:51:37.553603 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:51:37.553584 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30e042fa76ddc8c011188e00ef9491ffd70fcd373dce9bd33e6352562aaa9b7e\": container with ID starting with 30e042fa76ddc8c011188e00ef9491ffd70fcd373dce9bd33e6352562aaa9b7e not found: ID does not exist" containerID="30e042fa76ddc8c011188e00ef9491ffd70fcd373dce9bd33e6352562aaa9b7e" Jun 03 00:51:37.553652 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.553610 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30e042fa76ddc8c011188e00ef9491ffd70fcd373dce9bd33e6352562aaa9b7e"} err="failed to get container status \"30e042fa76ddc8c011188e00ef9491ffd70fcd373dce9bd33e6352562aaa9b7e\": rpc error: code = NotFound desc = could not find container \"30e042fa76ddc8c011188e00ef9491ffd70fcd373dce9bd33e6352562aaa9b7e\": container with ID starting with 30e042fa76ddc8c011188e00ef9491ffd70fcd373dce9bd33e6352562aaa9b7e not found: ID does not exist" Jun 03 00:51:37.553652 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.553630 2558 scope.go:117] "RemoveContainer" containerID="ba2c3a7a3ee183bc63adc7a23c933cb6add9846e8a4b12611f0e689e025b5720" Jun 03 00:51:37.553881 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:51:37.553864 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba2c3a7a3ee183bc63adc7a23c933cb6add9846e8a4b12611f0e689e025b5720\": container with ID starting with ba2c3a7a3ee183bc63adc7a23c933cb6add9846e8a4b12611f0e689e025b5720 not found: ID does not exist" containerID="ba2c3a7a3ee183bc63adc7a23c933cb6add9846e8a4b12611f0e689e025b5720" Jun 03 00:51:37.553943 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.553891 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba2c3a7a3ee183bc63adc7a23c933cb6add9846e8a4b12611f0e689e025b5720"} err="failed to get container status \"ba2c3a7a3ee183bc63adc7a23c933cb6add9846e8a4b12611f0e689e025b5720\": rpc error: code = NotFound desc = could not find container \"ba2c3a7a3ee183bc63adc7a23c933cb6add9846e8a4b12611f0e689e025b5720\": container with ID starting with ba2c3a7a3ee183bc63adc7a23c933cb6add9846e8a4b12611f0e689e025b5720 not found: ID does not exist" Jun 03 00:51:37.553943 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.553915 2558 scope.go:117] "RemoveContainer" containerID="f1ed9777843b321f79c2bfb08c115b79c577f4eaeb44b90ef6b9abece9be163b" Jun 03 00:51:37.554167 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:51:37.554148 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1ed9777843b321f79c2bfb08c115b79c577f4eaeb44b90ef6b9abece9be163b\": container with ID starting with f1ed9777843b321f79c2bfb08c115b79c577f4eaeb44b90ef6b9abece9be163b not found: ID does not exist" containerID="f1ed9777843b321f79c2bfb08c115b79c577f4eaeb44b90ef6b9abece9be163b" Jun 03 00:51:37.554207 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.554173 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1ed9777843b321f79c2bfb08c115b79c577f4eaeb44b90ef6b9abece9be163b"} err="failed to get container status \"f1ed9777843b321f79c2bfb08c115b79c577f4eaeb44b90ef6b9abece9be163b\": rpc error: code = NotFound desc = could not find container \"f1ed9777843b321f79c2bfb08c115b79c577f4eaeb44b90ef6b9abece9be163b\": container with ID starting with f1ed9777843b321f79c2bfb08c115b79c577f4eaeb44b90ef6b9abece9be163b not found: ID does not exist" Jun 03 00:51:37.554207 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.554188 2558 scope.go:117] "RemoveContainer" containerID="b9c8148cd784923cf5d2cb90962e5c3c6737b35175380dc9aa1266151f71d185" Jun 03 00:51:37.554396 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:51:37.554373 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9c8148cd784923cf5d2cb90962e5c3c6737b35175380dc9aa1266151f71d185\": container with ID starting with b9c8148cd784923cf5d2cb90962e5c3c6737b35175380dc9aa1266151f71d185 not found: ID does not exist" containerID="b9c8148cd784923cf5d2cb90962e5c3c6737b35175380dc9aa1266151f71d185" Jun 03 00:51:37.554478 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.554396 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9c8148cd784923cf5d2cb90962e5c3c6737b35175380dc9aa1266151f71d185"} err="failed to get container status \"b9c8148cd784923cf5d2cb90962e5c3c6737b35175380dc9aa1266151f71d185\": rpc error: code = NotFound desc = could not find container \"b9c8148cd784923cf5d2cb90962e5c3c6737b35175380dc9aa1266151f71d185\": container with ID starting with b9c8148cd784923cf5d2cb90962e5c3c6737b35175380dc9aa1266151f71d185 not found: ID does not exist" Jun 03 00:51:37.554478 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.554410 2558 scope.go:117] "RemoveContainer" containerID="dd439bad4422f7582ad03fc488947f987886631d019251821eb5bd325db73fa0" Jun 03 00:51:37.554656 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:51:37.554640 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd439bad4422f7582ad03fc488947f987886631d019251821eb5bd325db73fa0\": container with ID starting with dd439bad4422f7582ad03fc488947f987886631d019251821eb5bd325db73fa0 not found: ID does not exist" containerID="dd439bad4422f7582ad03fc488947f987886631d019251821eb5bd325db73fa0" Jun 03 00:51:37.554694 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.554662 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd439bad4422f7582ad03fc488947f987886631d019251821eb5bd325db73fa0"} err="failed to get container status \"dd439bad4422f7582ad03fc488947f987886631d019251821eb5bd325db73fa0\": rpc error: code = NotFound desc = could not find container \"dd439bad4422f7582ad03fc488947f987886631d019251821eb5bd325db73fa0\": container with ID starting with dd439bad4422f7582ad03fc488947f987886631d019251821eb5bd325db73fa0 not found: ID does not exist" Jun 03 00:51:37.554694 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.554678 2558 scope.go:117] "RemoveContainer" containerID="fa11feb81c32e0d6c50e3bd2b34c610c17415decd71d319e7ac5fa4bfee1faa5" Jun 03 00:51:37.554891 ip-10-0-134-48 kubenswrapper[2558]: E0603 00:51:37.554873 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa11feb81c32e0d6c50e3bd2b34c610c17415decd71d319e7ac5fa4bfee1faa5\": container with ID starting with fa11feb81c32e0d6c50e3bd2b34c610c17415decd71d319e7ac5fa4bfee1faa5 not found: ID does not exist" containerID="fa11feb81c32e0d6c50e3bd2b34c610c17415decd71d319e7ac5fa4bfee1faa5" Jun 03 00:51:37.554938 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.554894 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa11feb81c32e0d6c50e3bd2b34c610c17415decd71d319e7ac5fa4bfee1faa5"} err="failed to get container status \"fa11feb81c32e0d6c50e3bd2b34c610c17415decd71d319e7ac5fa4bfee1faa5\": rpc error: code = NotFound desc = could not find container \"fa11feb81c32e0d6c50e3bd2b34c610c17415decd71d319e7ac5fa4bfee1faa5\": container with ID starting with fa11feb81c32e0d6c50e3bd2b34c610c17415decd71d319e7ac5fa4bfee1faa5 not found: ID does not exist" Jun 03 00:51:37.554938 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.554906 2558 scope.go:117] "RemoveContainer" containerID="ade1fbd0f906adb11f4d7035caedb48604b9b3120f3321c15ab9a570b068cd00" Jun 03 00:51:37.555096 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.555074 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ade1fbd0f906adb11f4d7035caedb48604b9b3120f3321c15ab9a570b068cd00"} err="failed to get container status \"ade1fbd0f906adb11f4d7035caedb48604b9b3120f3321c15ab9a570b068cd00\": rpc error: code = NotFound desc = could not find container \"ade1fbd0f906adb11f4d7035caedb48604b9b3120f3321c15ab9a570b068cd00\": container with ID starting with ade1fbd0f906adb11f4d7035caedb48604b9b3120f3321c15ab9a570b068cd00 not found: ID does not exist" Jun 03 00:51:37.555133 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.555097 2558 scope.go:117] "RemoveContainer" containerID="30e042fa76ddc8c011188e00ef9491ffd70fcd373dce9bd33e6352562aaa9b7e" Jun 03 00:51:37.555336 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.555317 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30e042fa76ddc8c011188e00ef9491ffd70fcd373dce9bd33e6352562aaa9b7e"} err="failed to get container status \"30e042fa76ddc8c011188e00ef9491ffd70fcd373dce9bd33e6352562aaa9b7e\": rpc error: code = NotFound desc = could not find container \"30e042fa76ddc8c011188e00ef9491ffd70fcd373dce9bd33e6352562aaa9b7e\": container with ID starting with 30e042fa76ddc8c011188e00ef9491ffd70fcd373dce9bd33e6352562aaa9b7e not found: ID does not exist" Jun 03 00:51:37.555387 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.555338 2558 scope.go:117] "RemoveContainer" containerID="ba2c3a7a3ee183bc63adc7a23c933cb6add9846e8a4b12611f0e689e025b5720" Jun 03 00:51:37.555590 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.555573 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba2c3a7a3ee183bc63adc7a23c933cb6add9846e8a4b12611f0e689e025b5720"} err="failed to get container status \"ba2c3a7a3ee183bc63adc7a23c933cb6add9846e8a4b12611f0e689e025b5720\": rpc error: code = NotFound desc = could not find container \"ba2c3a7a3ee183bc63adc7a23c933cb6add9846e8a4b12611f0e689e025b5720\": container with ID starting with ba2c3a7a3ee183bc63adc7a23c933cb6add9846e8a4b12611f0e689e025b5720 not found: ID does not exist" Jun 03 00:51:37.555628 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.555591 2558 scope.go:117] "RemoveContainer" containerID="f1ed9777843b321f79c2bfb08c115b79c577f4eaeb44b90ef6b9abece9be163b" Jun 03 00:51:37.555824 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.555805 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1ed9777843b321f79c2bfb08c115b79c577f4eaeb44b90ef6b9abece9be163b"} err="failed to get container status \"f1ed9777843b321f79c2bfb08c115b79c577f4eaeb44b90ef6b9abece9be163b\": rpc error: code = NotFound desc = could not find container \"f1ed9777843b321f79c2bfb08c115b79c577f4eaeb44b90ef6b9abece9be163b\": container with ID starting with f1ed9777843b321f79c2bfb08c115b79c577f4eaeb44b90ef6b9abece9be163b not found: ID does not exist" Jun 03 00:51:37.555880 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.555825 2558 scope.go:117] "RemoveContainer" containerID="b9c8148cd784923cf5d2cb90962e5c3c6737b35175380dc9aa1266151f71d185" Jun 03 00:51:37.556016 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.556001 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9c8148cd784923cf5d2cb90962e5c3c6737b35175380dc9aa1266151f71d185"} err="failed to get container status \"b9c8148cd784923cf5d2cb90962e5c3c6737b35175380dc9aa1266151f71d185\": rpc error: code = NotFound desc = could not find container \"b9c8148cd784923cf5d2cb90962e5c3c6737b35175380dc9aa1266151f71d185\": container with ID starting with b9c8148cd784923cf5d2cb90962e5c3c6737b35175380dc9aa1266151f71d185 not found: ID does not exist" Jun 03 00:51:37.556052 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.556015 2558 scope.go:117] "RemoveContainer" containerID="dd439bad4422f7582ad03fc488947f987886631d019251821eb5bd325db73fa0" Jun 03 00:51:37.556214 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.556198 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd439bad4422f7582ad03fc488947f987886631d019251821eb5bd325db73fa0"} err="failed to get container status \"dd439bad4422f7582ad03fc488947f987886631d019251821eb5bd325db73fa0\": rpc error: code = NotFound desc = could not find container \"dd439bad4422f7582ad03fc488947f987886631d019251821eb5bd325db73fa0\": container with ID starting with dd439bad4422f7582ad03fc488947f987886631d019251821eb5bd325db73fa0 not found: ID does not exist" Jun 03 00:51:37.556258 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.556215 2558 scope.go:117] "RemoveContainer" containerID="fa11feb81c32e0d6c50e3bd2b34c610c17415decd71d319e7ac5fa4bfee1faa5" Jun 03 00:51:37.556405 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.556390 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa11feb81c32e0d6c50e3bd2b34c610c17415decd71d319e7ac5fa4bfee1faa5"} err="failed to get container status \"fa11feb81c32e0d6c50e3bd2b34c610c17415decd71d319e7ac5fa4bfee1faa5\": rpc error: code = NotFound desc = could not find container \"fa11feb81c32e0d6c50e3bd2b34c610c17415decd71d319e7ac5fa4bfee1faa5\": container with ID starting with fa11feb81c32e0d6c50e3bd2b34c610c17415decd71d319e7ac5fa4bfee1faa5 not found: ID does not exist" Jun 03 00:51:37.560410 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.560389 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 00:51:37.560783 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.560765 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerName="config-reloader" Jun 03 00:51:37.560866 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.560785 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerName="config-reloader" Jun 03 00:51:37.560866 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.560798 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerName="kube-rbac-proxy-web" Jun 03 00:51:37.560866 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.560806 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerName="kube-rbac-proxy-web" Jun 03 00:51:37.560866 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.560827 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerName="init-config-reloader" Jun 03 00:51:37.560866 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.560836 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerName="init-config-reloader" Jun 03 00:51:37.560866 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.560850 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb3e4bb4-793d-4303-9ee7-d168801986a5" containerName="registry" Jun 03 00:51:37.560866 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.560858 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb3e4bb4-793d-4303-9ee7-d168801986a5" containerName="registry" Jun 03 00:51:37.561196 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.560869 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerName="kube-rbac-proxy" Jun 03 00:51:37.561196 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.560878 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerName="kube-rbac-proxy" Jun 03 00:51:37.561196 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.560896 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerName="kube-rbac-proxy-metric" Jun 03 00:51:37.561196 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.560905 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerName="kube-rbac-proxy-metric" Jun 03 00:51:37.561196 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.560915 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerName="prom-label-proxy" Jun 03 00:51:37.561196 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.560924 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerName="prom-label-proxy" Jun 03 00:51:37.561196 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.560936 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerName="alertmanager" Jun 03 00:51:37.561196 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.560945 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerName="alertmanager" Jun 03 00:51:37.561196 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.561085 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="cb3e4bb4-793d-4303-9ee7-d168801986a5" containerName="registry" Jun 03 00:51:37.561196 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.561130 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerName="kube-rbac-proxy" Jun 03 00:51:37.561196 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.561143 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerName="kube-rbac-proxy-web" Jun 03 00:51:37.561196 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.561154 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerName="config-reloader" Jun 03 00:51:37.561196 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.561164 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerName="kube-rbac-proxy-metric" Jun 03 00:51:37.561196 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.561181 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerName="prom-label-proxy" Jun 03 00:51:37.561196 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.561195 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" containerName="alertmanager" Jun 03 00:51:37.566543 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.566510 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.569148 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.569130 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 00:51:37.569294 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.569279 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 00:51:37.569416 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.569401 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 00:51:37.569474 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.569408 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7bbzt\"" Jun 03 00:51:37.569474 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.569407 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 00:51:37.569785 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.569740 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 00:51:37.569785 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.569760 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 00:51:37.569785 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.569769 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 00:51:37.569959 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.569816 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 00:51:37.574320 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.574298 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 00:51:37.576253 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.576232 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 00:51:37.690735 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.690635 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f7983430-c43c-4bfd-b9d8-e417595cfd5f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.690735 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.690682 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f7983430-c43c-4bfd-b9d8-e417595cfd5f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.690959 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.690746 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld9st\" (UniqueName: \"kubernetes.io/projected/f7983430-c43c-4bfd-b9d8-e417595cfd5f-kube-api-access-ld9st\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.690959 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.690801 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f7983430-c43c-4bfd-b9d8-e417595cfd5f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.690959 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.690896 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f7983430-c43c-4bfd-b9d8-e417595cfd5f-web-config\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.690959 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.690936 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f7983430-c43c-4bfd-b9d8-e417595cfd5f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.691158 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.690965 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f7983430-c43c-4bfd-b9d8-e417595cfd5f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.691158 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.690991 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f7983430-c43c-4bfd-b9d8-e417595cfd5f-config-out\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.691158 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.691017 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7983430-c43c-4bfd-b9d8-e417595cfd5f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.691158 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.691060 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f7983430-c43c-4bfd-b9d8-e417595cfd5f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.691158 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.691093 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f7983430-c43c-4bfd-b9d8-e417595cfd5f-config-volume\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.691158 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.691125 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f7983430-c43c-4bfd-b9d8-e417595cfd5f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.691366 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.691185 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7983430-c43c-4bfd-b9d8-e417595cfd5f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.766406 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.766372 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd398da0-0769-4c68-9a70-7c1d89d5ec09" path="/var/lib/kubelet/pods/bd398da0-0769-4c68-9a70-7c1d89d5ec09/volumes" Jun 03 00:51:37.791972 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.791942 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7983430-c43c-4bfd-b9d8-e417595cfd5f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.792056 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.791991 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f7983430-c43c-4bfd-b9d8-e417595cfd5f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.792056 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.792010 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f7983430-c43c-4bfd-b9d8-e417595cfd5f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.792056 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.792030 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ld9st\" (UniqueName: \"kubernetes.io/projected/f7983430-c43c-4bfd-b9d8-e417595cfd5f-kube-api-access-ld9st\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.792214 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.792067 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f7983430-c43c-4bfd-b9d8-e417595cfd5f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.792214 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.792120 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f7983430-c43c-4bfd-b9d8-e417595cfd5f-web-config\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.792214 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.792148 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f7983430-c43c-4bfd-b9d8-e417595cfd5f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.792214 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.792171 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f7983430-c43c-4bfd-b9d8-e417595cfd5f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.792214 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.792195 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f7983430-c43c-4bfd-b9d8-e417595cfd5f-config-out\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.792481 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.792222 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7983430-c43c-4bfd-b9d8-e417595cfd5f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.792481 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.792265 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f7983430-c43c-4bfd-b9d8-e417595cfd5f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.792481 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.792291 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f7983430-c43c-4bfd-b9d8-e417595cfd5f-config-volume\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.792481 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.792321 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f7983430-c43c-4bfd-b9d8-e417595cfd5f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.792481 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.792418 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f7983430-c43c-4bfd-b9d8-e417595cfd5f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.792913 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.792888 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7983430-c43c-4bfd-b9d8-e417595cfd5f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.793574 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.793221 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7983430-c43c-4bfd-b9d8-e417595cfd5f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.795079 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.795050 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f7983430-c43c-4bfd-b9d8-e417595cfd5f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.795176 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.795147 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f7983430-c43c-4bfd-b9d8-e417595cfd5f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.795266 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.795239 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f7983430-c43c-4bfd-b9d8-e417595cfd5f-web-config\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.795366 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.795339 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f7983430-c43c-4bfd-b9d8-e417595cfd5f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.795441 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.795352 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f7983430-c43c-4bfd-b9d8-e417595cfd5f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.795441 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.795403 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f7983430-c43c-4bfd-b9d8-e417595cfd5f-config-out\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.795583 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.795567 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f7983430-c43c-4bfd-b9d8-e417595cfd5f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.796003 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.795984 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f7983430-c43c-4bfd-b9d8-e417595cfd5f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.796927 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.796909 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f7983430-c43c-4bfd-b9d8-e417595cfd5f-config-volume\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.800161 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.800141 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld9st\" (UniqueName: \"kubernetes.io/projected/f7983430-c43c-4bfd-b9d8-e417595cfd5f-kube-api-access-ld9st\") pod \"alertmanager-main-0\" (UID: \"f7983430-c43c-4bfd-b9d8-e417595cfd5f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:37.876385 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:37.876350 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:51:38.012636 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:38.012582 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 00:51:38.016503 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:51:38.016474 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7983430_c43c_4bfd_b9d8_e417595cfd5f.slice/crio-64ef0e6b40992c334b2752a0881e722659452eacfb562cee4c6abff2c1b97837 WatchSource:0}: Error finding container 64ef0e6b40992c334b2752a0881e722659452eacfb562cee4c6abff2c1b97837: Status 404 returned error can't find the container with id 64ef0e6b40992c334b2752a0881e722659452eacfb562cee4c6abff2c1b97837 Jun 03 00:51:38.508975 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:38.508939 2558 generic.go:358] "Generic (PLEG): container finished" podID="f7983430-c43c-4bfd-b9d8-e417595cfd5f" containerID="151f6ccefa04289b7e99544ea77082ba321e51ad75ba01ec1b2d90793db051be" exitCode=0 Jun 03 00:51:38.508975 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:38.508970 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7983430-c43c-4bfd-b9d8-e417595cfd5f","Type":"ContainerDied","Data":"151f6ccefa04289b7e99544ea77082ba321e51ad75ba01ec1b2d90793db051be"} Jun 03 00:51:38.509382 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:38.509001 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7983430-c43c-4bfd-b9d8-e417595cfd5f","Type":"ContainerStarted","Data":"64ef0e6b40992c334b2752a0881e722659452eacfb562cee4c6abff2c1b97837"} Jun 03 00:51:39.515173 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:39.515139 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7983430-c43c-4bfd-b9d8-e417595cfd5f","Type":"ContainerStarted","Data":"4d914fc8e40d7278171fcc6731d620c51c614bc4929aada943f67383f8d4978a"} Jun 03 00:51:39.515173 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:39.515174 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7983430-c43c-4bfd-b9d8-e417595cfd5f","Type":"ContainerStarted","Data":"86cc175e0ce4bf85768df2b080ff07f0eb099b36d37940a9415ae4b3117c2d99"} Jun 03 00:51:39.515613 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:39.515183 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7983430-c43c-4bfd-b9d8-e417595cfd5f","Type":"ContainerStarted","Data":"e340df103149594ebb050521777299ecfc14690505d9a5cca1989cb4e66fa940"} Jun 03 00:51:39.515613 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:39.515192 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7983430-c43c-4bfd-b9d8-e417595cfd5f","Type":"ContainerStarted","Data":"a38db99980d4c57c5dcc0975504321afb0ffb09a04a97986fe2f01307580eb14"} Jun 03 00:51:39.515613 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:39.515201 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7983430-c43c-4bfd-b9d8-e417595cfd5f","Type":"ContainerStarted","Data":"6b4fb9947b79ab8c8a019d4347c56b5ac733e242f359f558abac1e01fc1f0fbb"} Jun 03 00:51:39.515613 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:39.515209 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7983430-c43c-4bfd-b9d8-e417595cfd5f","Type":"ContainerStarted","Data":"4c7fabb7c5f427a4dddcb111d836c584e36077003ba9ebad94824d66119addb6"} Jun 03 00:51:39.542359 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:39.542298 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.542283292 podStartE2EDuration="2.542283292s" podCreationTimestamp="2026-06-03 00:51:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:51:39.5398447 +0000 UTC m=+170.238215183" watchObservedRunningTime="2026-06-03 00:51:39.542283292 +0000 UTC m=+170.240653783" Jun 03 00:51:39.945786 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:39.945743 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7b7765564d-npmxf"] Jun 03 00:51:39.949648 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:39.949629 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b7765564d-npmxf" Jun 03 00:51:39.952045 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:39.952021 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9mp5c\"" Jun 03 00:51:39.952147 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:39.952120 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 03 00:51:39.952257 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:39.952193 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 03 00:51:39.952321 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:39.952265 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 03 00:51:39.952377 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:39.952317 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 03 00:51:39.952377 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:39.952345 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 03 00:51:39.957416 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:39.957389 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 03 00:51:39.960048 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:39.960018 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b7765564d-npmxf"] Jun 03 00:51:40.112606 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.112573 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3-secret-telemeter-client\") pod \"telemeter-client-7b7765564d-npmxf\" (UID: \"332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3\") " pod="openshift-monitoring/telemeter-client-7b7765564d-npmxf" Jun 03 00:51:40.112784 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.112612 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3-serving-certs-ca-bundle\") pod \"telemeter-client-7b7765564d-npmxf\" (UID: \"332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3\") " pod="openshift-monitoring/telemeter-client-7b7765564d-npmxf" Jun 03 00:51:40.112784 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.112646 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b7765564d-npmxf\" (UID: \"332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3\") " pod="openshift-monitoring/telemeter-client-7b7765564d-npmxf" Jun 03 00:51:40.112784 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.112691 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3-federate-client-tls\") pod \"telemeter-client-7b7765564d-npmxf\" (UID: \"332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3\") " pod="openshift-monitoring/telemeter-client-7b7765564d-npmxf" Jun 03 00:51:40.112784 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.112714 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b7765564d-npmxf\" (UID: \"332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3\") " pod="openshift-monitoring/telemeter-client-7b7765564d-npmxf" Jun 03 00:51:40.112784 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.112751 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3-metrics-client-ca\") pod \"telemeter-client-7b7765564d-npmxf\" (UID: \"332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3\") " pod="openshift-monitoring/telemeter-client-7b7765564d-npmxf" Jun 03 00:51:40.112784 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.112769 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrxnv\" (UniqueName: \"kubernetes.io/projected/332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3-kube-api-access-jrxnv\") pod \"telemeter-client-7b7765564d-npmxf\" (UID: \"332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3\") " pod="openshift-monitoring/telemeter-client-7b7765564d-npmxf" Jun 03 00:51:40.113034 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.112883 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3-telemeter-client-tls\") pod \"telemeter-client-7b7765564d-npmxf\" (UID: \"332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3\") " pod="openshift-monitoring/telemeter-client-7b7765564d-npmxf" Jun 03 00:51:40.213734 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.213650 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3-metrics-client-ca\") pod \"telemeter-client-7b7765564d-npmxf\" (UID: \"332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3\") " pod="openshift-monitoring/telemeter-client-7b7765564d-npmxf" Jun 03 00:51:40.213734 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.213687 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jrxnv\" (UniqueName: \"kubernetes.io/projected/332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3-kube-api-access-jrxnv\") pod \"telemeter-client-7b7765564d-npmxf\" (UID: \"332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3\") " pod="openshift-monitoring/telemeter-client-7b7765564d-npmxf" Jun 03 00:51:40.213913 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.213823 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3-telemeter-client-tls\") pod \"telemeter-client-7b7765564d-npmxf\" (UID: \"332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3\") " pod="openshift-monitoring/telemeter-client-7b7765564d-npmxf" Jun 03 00:51:40.213962 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.213923 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3-secret-telemeter-client\") pod \"telemeter-client-7b7765564d-npmxf\" (UID: \"332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3\") " pod="openshift-monitoring/telemeter-client-7b7765564d-npmxf" Jun 03 00:51:40.214001 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.213960 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3-serving-certs-ca-bundle\") pod \"telemeter-client-7b7765564d-npmxf\" (UID: \"332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3\") " pod="openshift-monitoring/telemeter-client-7b7765564d-npmxf" Jun 03 00:51:40.214001 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.213988 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b7765564d-npmxf\" (UID: \"332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3\") " pod="openshift-monitoring/telemeter-client-7b7765564d-npmxf" Jun 03 00:51:40.214100 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.214022 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3-federate-client-tls\") pod \"telemeter-client-7b7765564d-npmxf\" (UID: \"332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3\") " pod="openshift-monitoring/telemeter-client-7b7765564d-npmxf" Jun 03 00:51:40.214422 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.214147 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b7765564d-npmxf\" (UID: \"332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3\") " pod="openshift-monitoring/telemeter-client-7b7765564d-npmxf" Jun 03 00:51:40.214574 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.214431 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3-metrics-client-ca\") pod \"telemeter-client-7b7765564d-npmxf\" (UID: \"332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3\") " pod="openshift-monitoring/telemeter-client-7b7765564d-npmxf" Jun 03 00:51:40.214661 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.214616 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3-serving-certs-ca-bundle\") pod \"telemeter-client-7b7765564d-npmxf\" (UID: \"332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3\") " pod="openshift-monitoring/telemeter-client-7b7765564d-npmxf" Jun 03 00:51:40.214917 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.214894 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b7765564d-npmxf\" (UID: \"332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3\") " pod="openshift-monitoring/telemeter-client-7b7765564d-npmxf" Jun 03 00:51:40.216371 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.216343 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3-federate-client-tls\") pod \"telemeter-client-7b7765564d-npmxf\" (UID: \"332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3\") " pod="openshift-monitoring/telemeter-client-7b7765564d-npmxf" Jun 03 00:51:40.216460 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.216443 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b7765564d-npmxf\" (UID: \"332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3\") " pod="openshift-monitoring/telemeter-client-7b7765564d-npmxf" Jun 03 00:51:40.216758 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.216742 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3-secret-telemeter-client\") pod \"telemeter-client-7b7765564d-npmxf\" (UID: \"332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3\") " pod="openshift-monitoring/telemeter-client-7b7765564d-npmxf" Jun 03 00:51:40.216816 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.216797 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3-telemeter-client-tls\") pod \"telemeter-client-7b7765564d-npmxf\" (UID: \"332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3\") " pod="openshift-monitoring/telemeter-client-7b7765564d-npmxf" Jun 03 00:51:40.221705 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.221680 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrxnv\" (UniqueName: \"kubernetes.io/projected/332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3-kube-api-access-jrxnv\") pod \"telemeter-client-7b7765564d-npmxf\" (UID: \"332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3\") " pod="openshift-monitoring/telemeter-client-7b7765564d-npmxf" Jun 03 00:51:40.229322 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.229300 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 00:51:40.229997 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.229880 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8228210a-899b-431e-b606-70e67ae93825" containerName="prometheus" containerID="cri-o://10e548e4a994be1c0e406dd36dd7094f54902a13b46a79388d3fdeba63741d9c" gracePeriod=600 Jun 03 00:51:40.229997 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.229894 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8228210a-899b-431e-b606-70e67ae93825" containerName="kube-rbac-proxy" containerID="cri-o://83e47388758696703f64fce55c121a0ee34ba84a562c286da23f4d86a5330c4c" gracePeriod=600 Jun 03 00:51:40.229997 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.229909 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8228210a-899b-431e-b606-70e67ae93825" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a3e229e1975253d51404406fa9f8b19f2c1d4c43a3d6c36288470da960c8832a" gracePeriod=600 Jun 03 00:51:40.229997 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.229919 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8228210a-899b-431e-b606-70e67ae93825" containerName="thanos-sidecar" containerID="cri-o://bb4a8fdec26b30494cfbf5eba7bdaf89122a30269bb5086fe8262e5af420ef19" gracePeriod=600 Jun 03 00:51:40.229997 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.229931 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8228210a-899b-431e-b606-70e67ae93825" containerName="kube-rbac-proxy-web" containerID="cri-o://6999cb2cbe44d5eb3adbbf85c0dce12c845c5bfa245711f4f7d86b32fd1df8fa" gracePeriod=600 Jun 03 00:51:40.229997 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.229980 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8228210a-899b-431e-b606-70e67ae93825" containerName="config-reloader" containerID="cri-o://859f2eb01b5acf58faad5a3d29626199267b6fc05057e70ce7fb36cb581345d2" gracePeriod=600 Jun 03 00:51:40.264738 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.264707 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b7765564d-npmxf" Jun 03 00:51:40.399042 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.398692 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b7765564d-npmxf"] Jun 03 00:51:40.401182 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:51:40.401148 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod332f3895_8cbb_4ca5_9fbc_a0b04d7a72f3.slice/crio-f0919129934368408403652b0a15f4d4b1c0277dde5f14cdf0dca3b12b6561e2 WatchSource:0}: Error finding container f0919129934368408403652b0a15f4d4b1c0277dde5f14cdf0dca3b12b6561e2: Status 404 returned error can't find the container with id f0919129934368408403652b0a15f4d4b1c0277dde5f14cdf0dca3b12b6561e2 Jun 03 00:51:40.520957 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.520877 2558 generic.go:358] "Generic (PLEG): container finished" podID="8228210a-899b-431e-b606-70e67ae93825" containerID="a3e229e1975253d51404406fa9f8b19f2c1d4c43a3d6c36288470da960c8832a" exitCode=0 Jun 03 00:51:40.520957 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.520902 2558 generic.go:358] "Generic (PLEG): container finished" podID="8228210a-899b-431e-b606-70e67ae93825" containerID="83e47388758696703f64fce55c121a0ee34ba84a562c286da23f4d86a5330c4c" exitCode=0 Jun 03 00:51:40.520957 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.520908 2558 generic.go:358] "Generic (PLEG): container finished" podID="8228210a-899b-431e-b606-70e67ae93825" containerID="bb4a8fdec26b30494cfbf5eba7bdaf89122a30269bb5086fe8262e5af420ef19" exitCode=0 Jun 03 00:51:40.520957 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.520914 2558 generic.go:358] "Generic (PLEG): container finished" podID="8228210a-899b-431e-b606-70e67ae93825" containerID="859f2eb01b5acf58faad5a3d29626199267b6fc05057e70ce7fb36cb581345d2" exitCode=0 Jun 03 00:51:40.520957 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.520919 2558 generic.go:358] "Generic (PLEG): container finished" podID="8228210a-899b-431e-b606-70e67ae93825" containerID="10e548e4a994be1c0e406dd36dd7094f54902a13b46a79388d3fdeba63741d9c" exitCode=0 Jun 03 00:51:40.520957 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.520951 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8228210a-899b-431e-b606-70e67ae93825","Type":"ContainerDied","Data":"a3e229e1975253d51404406fa9f8b19f2c1d4c43a3d6c36288470da960c8832a"} Jun 03 00:51:40.521553 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.520985 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8228210a-899b-431e-b606-70e67ae93825","Type":"ContainerDied","Data":"83e47388758696703f64fce55c121a0ee34ba84a562c286da23f4d86a5330c4c"} Jun 03 00:51:40.521553 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.521002 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8228210a-899b-431e-b606-70e67ae93825","Type":"ContainerDied","Data":"bb4a8fdec26b30494cfbf5eba7bdaf89122a30269bb5086fe8262e5af420ef19"} Jun 03 00:51:40.521553 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.521014 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8228210a-899b-431e-b606-70e67ae93825","Type":"ContainerDied","Data":"859f2eb01b5acf58faad5a3d29626199267b6fc05057e70ce7fb36cb581345d2"} Jun 03 00:51:40.521553 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.521023 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8228210a-899b-431e-b606-70e67ae93825","Type":"ContainerDied","Data":"10e548e4a994be1c0e406dd36dd7094f54902a13b46a79388d3fdeba63741d9c"} Jun 03 00:51:40.522120 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:40.522090 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b7765564d-npmxf" event={"ID":"332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3","Type":"ContainerStarted","Data":"f0919129934368408403652b0a15f4d4b1c0277dde5f14cdf0dca3b12b6561e2"} Jun 03 00:51:41.529860 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.529824 2558 generic.go:358] "Generic (PLEG): container finished" podID="8228210a-899b-431e-b606-70e67ae93825" containerID="6999cb2cbe44d5eb3adbbf85c0dce12c845c5bfa245711f4f7d86b32fd1df8fa" exitCode=0 Jun 03 00:51:41.530204 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.529899 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8228210a-899b-431e-b606-70e67ae93825","Type":"ContainerDied","Data":"6999cb2cbe44d5eb3adbbf85c0dce12c845c5bfa245711f4f7d86b32fd1df8fa"} Jun 03 00:51:41.591303 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.591277 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:41.730611 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.730573 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-prometheus-k8s-tls\") pod \"8228210a-899b-431e-b606-70e67ae93825\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " Jun 03 00:51:41.730611 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.730615 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7b2q\" (UniqueName: \"kubernetes.io/projected/8228210a-899b-431e-b606-70e67ae93825-kube-api-access-k7b2q\") pod \"8228210a-899b-431e-b606-70e67ae93825\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " Jun 03 00:51:41.730854 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.730630 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8228210a-899b-431e-b606-70e67ae93825-tls-assets\") pod \"8228210a-899b-431e-b606-70e67ae93825\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " Jun 03 00:51:41.730854 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.730649 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-metrics-client-certs\") pod \"8228210a-899b-431e-b606-70e67ae93825\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " Jun 03 00:51:41.730854 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.730672 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-config\") pod \"8228210a-899b-431e-b606-70e67ae93825\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " Jun 03 00:51:41.730854 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.730693 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8228210a-899b-431e-b606-70e67ae93825-prometheus-trusted-ca-bundle\") pod \"8228210a-899b-431e-b606-70e67ae93825\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " Jun 03 00:51:41.730854 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.730715 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8228210a-899b-431e-b606-70e67ae93825-configmap-metrics-client-ca\") pod \"8228210a-899b-431e-b606-70e67ae93825\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " Jun 03 00:51:41.730854 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.730752 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-thanos-prometheus-http-client-file\") pod \"8228210a-899b-431e-b606-70e67ae93825\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " Jun 03 00:51:41.730854 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.730779 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-web-config\") pod \"8228210a-899b-431e-b606-70e67ae93825\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " Jun 03 00:51:41.730854 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.730804 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8228210a-899b-431e-b606-70e67ae93825-config-out\") pod \"8228210a-899b-431e-b606-70e67ae93825\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " Jun 03 00:51:41.730854 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.730839 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8228210a-899b-431e-b606-70e67ae93825-configmap-kubelet-serving-ca-bundle\") pod \"8228210a-899b-431e-b606-70e67ae93825\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " Jun 03 00:51:41.731281 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.730912 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"8228210a-899b-431e-b606-70e67ae93825\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " Jun 03 00:51:41.731281 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.730960 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-kube-rbac-proxy\") pod \"8228210a-899b-431e-b606-70e67ae93825\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " Jun 03 00:51:41.731281 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.730985 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"8228210a-899b-431e-b606-70e67ae93825\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " Jun 03 00:51:41.731281 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.731011 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8228210a-899b-431e-b606-70e67ae93825-prometheus-k8s-db\") pod \"8228210a-899b-431e-b606-70e67ae93825\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " Jun 03 00:51:41.731281 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.731044 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8228210a-899b-431e-b606-70e67ae93825-prometheus-k8s-rulefiles-0\") pod \"8228210a-899b-431e-b606-70e67ae93825\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " Jun 03 00:51:41.731281 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.731083 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-grpc-tls\") pod \"8228210a-899b-431e-b606-70e67ae93825\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " Jun 03 00:51:41.731281 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.731108 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8228210a-899b-431e-b606-70e67ae93825-configmap-serving-certs-ca-bundle\") pod \"8228210a-899b-431e-b606-70e67ae93825\" (UID: \"8228210a-899b-431e-b606-70e67ae93825\") " Jun 03 00:51:41.731281 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.731190 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8228210a-899b-431e-b606-70e67ae93825-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "8228210a-899b-431e-b606-70e67ae93825" (UID: "8228210a-899b-431e-b606-70e67ae93825"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 00:51:41.731724 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.731402 2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8228210a-899b-431e-b606-70e67ae93825-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:51:41.732059 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.731778 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8228210a-899b-431e-b606-70e67ae93825-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "8228210a-899b-431e-b606-70e67ae93825" (UID: "8228210a-899b-431e-b606-70e67ae93825"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 00:51:41.732059 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.732012 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8228210a-899b-431e-b606-70e67ae93825-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "8228210a-899b-431e-b606-70e67ae93825" (UID: "8228210a-899b-431e-b606-70e67ae93825"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 00:51:41.733208 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.733180 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8228210a-899b-431e-b606-70e67ae93825-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "8228210a-899b-431e-b606-70e67ae93825" (UID: "8228210a-899b-431e-b606-70e67ae93825"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 00:51:41.733699 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.733671 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8228210a-899b-431e-b606-70e67ae93825-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "8228210a-899b-431e-b606-70e67ae93825" (UID: "8228210a-899b-431e-b606-70e67ae93825"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 00:51:41.734318 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.734283 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8228210a-899b-431e-b606-70e67ae93825-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "8228210a-899b-431e-b606-70e67ae93825" (UID: "8228210a-899b-431e-b606-70e67ae93825"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 00:51:41.735107 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.735078 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "8228210a-899b-431e-b606-70e67ae93825" (UID: "8228210a-899b-431e-b606-70e67ae93825"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:51:41.735214 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.735100 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8228210a-899b-431e-b606-70e67ae93825-kube-api-access-k7b2q" (OuterVolumeSpecName: "kube-api-access-k7b2q") pod "8228210a-899b-431e-b606-70e67ae93825" (UID: "8228210a-899b-431e-b606-70e67ae93825"). InnerVolumeSpecName "kube-api-access-k7b2q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:51:41.735214 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.735113 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8228210a-899b-431e-b606-70e67ae93825-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8228210a-899b-431e-b606-70e67ae93825" (UID: "8228210a-899b-431e-b606-70e67ae93825"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:51:41.735326 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.735233 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "8228210a-899b-431e-b606-70e67ae93825" (UID: "8228210a-899b-431e-b606-70e67ae93825"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:51:41.735326 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.735240 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8228210a-899b-431e-b606-70e67ae93825-config-out" (OuterVolumeSpecName: "config-out") pod "8228210a-899b-431e-b606-70e67ae93825" (UID: "8228210a-899b-431e-b606-70e67ae93825"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 00:51:41.735435 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.735382 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "8228210a-899b-431e-b606-70e67ae93825" (UID: "8228210a-899b-431e-b606-70e67ae93825"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:51:41.735580 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.735538 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "8228210a-899b-431e-b606-70e67ae93825" (UID: "8228210a-899b-431e-b606-70e67ae93825"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:51:41.735774 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.735752 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-config" (OuterVolumeSpecName: "config") pod "8228210a-899b-431e-b606-70e67ae93825" (UID: "8228210a-899b-431e-b606-70e67ae93825"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:51:41.735981 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.735958 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "8228210a-899b-431e-b606-70e67ae93825" (UID: "8228210a-899b-431e-b606-70e67ae93825"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:51:41.736075 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.736052 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "8228210a-899b-431e-b606-70e67ae93825" (UID: "8228210a-899b-431e-b606-70e67ae93825"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:51:41.736734 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.736711 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "8228210a-899b-431e-b606-70e67ae93825" (UID: "8228210a-899b-431e-b606-70e67ae93825"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:51:41.746429 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.746404 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-web-config" (OuterVolumeSpecName: "web-config") pod "8228210a-899b-431e-b606-70e67ae93825" (UID: "8228210a-899b-431e-b606-70e67ae93825"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:51:41.832217 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.832180 2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:51:41.832217 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.832214 2558 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-kube-rbac-proxy\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:51:41.832445 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.832251 2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:51:41.832445 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.832266 2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8228210a-899b-431e-b606-70e67ae93825-prometheus-k8s-db\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:51:41.832445 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.832277 2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8228210a-899b-431e-b606-70e67ae93825-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:51:41.832445 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.832286 2558 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-grpc-tls\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:51:41.832445 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.832298 2558 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8228210a-899b-431e-b606-70e67ae93825-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:51:41.832445 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.832311 2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:51:41.832445 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.832325 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7b2q\" (UniqueName: \"kubernetes.io/projected/8228210a-899b-431e-b606-70e67ae93825-kube-api-access-k7b2q\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:51:41.832445 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.832336 2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8228210a-899b-431e-b606-70e67ae93825-tls-assets\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:51:41.832445 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.832345 2558 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-secret-metrics-client-certs\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:51:41.832445 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.832353 2558 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-config\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:51:41.832445 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.832389 2558 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8228210a-899b-431e-b606-70e67ae93825-configmap-metrics-client-ca\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:51:41.832445 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.832400 2558 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:51:41.832445 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.832413 2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8228210a-899b-431e-b606-70e67ae93825-web-config\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:51:41.832445 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.832421 2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8228210a-899b-431e-b606-70e67ae93825-config-out\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:51:41.832445 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:41.832434 2558 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8228210a-899b-431e-b606-70e67ae93825-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 00:51:42.536383 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.536300 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8228210a-899b-431e-b606-70e67ae93825","Type":"ContainerDied","Data":"22d59e01204af96c5af4b4ee36c857140d9f1b93a19ca93a1069ff57f8b74619"} Jun 03 00:51:42.536383 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.536351 2558 scope.go:117] "RemoveContainer" containerID="a3e229e1975253d51404406fa9f8b19f2c1d4c43a3d6c36288470da960c8832a" Jun 03 00:51:42.536835 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.536394 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.544723 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.544701 2558 scope.go:117] "RemoveContainer" containerID="83e47388758696703f64fce55c121a0ee34ba84a562c286da23f4d86a5330c4c" Jun 03 00:51:42.558954 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.558922 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 00:51:42.564316 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.564290 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 00:51:42.593319 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.593287 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 00:51:42.593707 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.593681 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8228210a-899b-431e-b606-70e67ae93825" containerName="config-reloader" Jun 03 00:51:42.593707 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.593704 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8228210a-899b-431e-b606-70e67ae93825" containerName="config-reloader" Jun 03 00:51:42.593811 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.593721 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8228210a-899b-431e-b606-70e67ae93825" containerName="init-config-reloader" Jun 03 00:51:42.593811 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.593728 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8228210a-899b-431e-b606-70e67ae93825" containerName="init-config-reloader" Jun 03 00:51:42.593811 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.593737 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8228210a-899b-431e-b606-70e67ae93825" containerName="prometheus" Jun 03 00:51:42.593811 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.593742 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8228210a-899b-431e-b606-70e67ae93825" containerName="prometheus" Jun 03 00:51:42.593811 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.593750 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8228210a-899b-431e-b606-70e67ae93825" containerName="kube-rbac-proxy-web" Jun 03 00:51:42.593811 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.593755 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8228210a-899b-431e-b606-70e67ae93825" containerName="kube-rbac-proxy-web" Jun 03 00:51:42.593811 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.593769 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8228210a-899b-431e-b606-70e67ae93825" containerName="thanos-sidecar" Jun 03 00:51:42.593811 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.593777 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8228210a-899b-431e-b606-70e67ae93825" containerName="thanos-sidecar" Jun 03 00:51:42.593811 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.593790 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8228210a-899b-431e-b606-70e67ae93825" containerName="kube-rbac-proxy" Jun 03 00:51:42.593811 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.593795 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8228210a-899b-431e-b606-70e67ae93825" containerName="kube-rbac-proxy" Jun 03 00:51:42.593811 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.593802 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8228210a-899b-431e-b606-70e67ae93825" containerName="kube-rbac-proxy-thanos" Jun 03 00:51:42.593811 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.593808 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8228210a-899b-431e-b606-70e67ae93825" containerName="kube-rbac-proxy-thanos" Jun 03 00:51:42.594202 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.593866 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="8228210a-899b-431e-b606-70e67ae93825" containerName="kube-rbac-proxy-web" Jun 03 00:51:42.594202 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.593875 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="8228210a-899b-431e-b606-70e67ae93825" containerName="kube-rbac-proxy" Jun 03 00:51:42.594202 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.593883 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="8228210a-899b-431e-b606-70e67ae93825" containerName="kube-rbac-proxy-thanos" Jun 03 00:51:42.594202 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.593894 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="8228210a-899b-431e-b606-70e67ae93825" containerName="prometheus" Jun 03 00:51:42.594202 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.593904 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="8228210a-899b-431e-b606-70e67ae93825" containerName="config-reloader" Jun 03 00:51:42.594202 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.593913 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="8228210a-899b-431e-b606-70e67ae93825" containerName="thanos-sidecar" Jun 03 00:51:42.598066 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.598044 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.601003 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.600847 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 00:51:42.601003 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.600863 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 00:51:42.601003 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.600922 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 00:51:42.601003 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.600938 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 00:51:42.601346 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.601009 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 00:51:42.601408 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.601376 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 00:51:42.601443 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.601406 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 00:51:42.601666 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.601646 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qfkb5\"" Jun 03 00:51:42.601825 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.601800 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 00:51:42.601919 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.601876 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 00:51:42.602043 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.601917 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 00:51:42.602101 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.602062 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 00:51:42.602147 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.602126 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-l67srm36tqhr\"" Jun 03 00:51:42.604052 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.604026 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 00:51:42.606972 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.606948 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 00:51:42.612009 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.611982 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 00:51:42.637943 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.637887 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/26496b35-81df-44e9-95be-da8586a86ad3-config\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.638237 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.637995 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26496b35-81df-44e9-95be-da8586a86ad3-config-out\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.638237 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.638048 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26496b35-81df-44e9-95be-da8586a86ad3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.638237 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.638184 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/26496b35-81df-44e9-95be-da8586a86ad3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.638237 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.638234 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26496b35-81df-44e9-95be-da8586a86ad3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.638464 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.638271 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/26496b35-81df-44e9-95be-da8586a86ad3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.638464 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.638299 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26496b35-81df-44e9-95be-da8586a86ad3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.638464 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.638322 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/26496b35-81df-44e9-95be-da8586a86ad3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.638464 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.638343 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26496b35-81df-44e9-95be-da8586a86ad3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.638464 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.638366 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmn8t\" (UniqueName: \"kubernetes.io/projected/26496b35-81df-44e9-95be-da8586a86ad3-kube-api-access-dmn8t\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.638464 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.638423 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/26496b35-81df-44e9-95be-da8586a86ad3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.638464 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.638453 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/26496b35-81df-44e9-95be-da8586a86ad3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.638814 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.638482 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/26496b35-81df-44e9-95be-da8586a86ad3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.638814 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.638540 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26496b35-81df-44e9-95be-da8586a86ad3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.638814 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.638561 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26496b35-81df-44e9-95be-da8586a86ad3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.638814 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.638590 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26496b35-81df-44e9-95be-da8586a86ad3-web-config\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.638814 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.638627 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26496b35-81df-44e9-95be-da8586a86ad3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.638814 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.638662 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26496b35-81df-44e9-95be-da8586a86ad3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.739867 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.739820 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/26496b35-81df-44e9-95be-da8586a86ad3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.740037 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.739883 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26496b35-81df-44e9-95be-da8586a86ad3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.740037 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.739909 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/26496b35-81df-44e9-95be-da8586a86ad3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.740037 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.739938 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26496b35-81df-44e9-95be-da8586a86ad3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.740189 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.740068 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/26496b35-81df-44e9-95be-da8586a86ad3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.740189 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.740100 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26496b35-81df-44e9-95be-da8586a86ad3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.740189 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.740120 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dmn8t\" (UniqueName: \"kubernetes.io/projected/26496b35-81df-44e9-95be-da8586a86ad3-kube-api-access-dmn8t\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.740189 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.740163 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/26496b35-81df-44e9-95be-da8586a86ad3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.740385 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.740199 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/26496b35-81df-44e9-95be-da8586a86ad3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.740385 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.740236 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/26496b35-81df-44e9-95be-da8586a86ad3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.740385 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.740280 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26496b35-81df-44e9-95be-da8586a86ad3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.740385 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.740302 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26496b35-81df-44e9-95be-da8586a86ad3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.740385 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.740328 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26496b35-81df-44e9-95be-da8586a86ad3-web-config\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.740385 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.740369 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26496b35-81df-44e9-95be-da8586a86ad3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.740698 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.740402 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26496b35-81df-44e9-95be-da8586a86ad3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.740698 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.740443 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/26496b35-81df-44e9-95be-da8586a86ad3-config\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.740698 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.740466 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26496b35-81df-44e9-95be-da8586a86ad3-config-out\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.740698 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.740491 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26496b35-81df-44e9-95be-da8586a86ad3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.740894 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.740717 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/26496b35-81df-44e9-95be-da8586a86ad3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.740894 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.740822 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26496b35-81df-44e9-95be-da8586a86ad3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.740894 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.740867 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26496b35-81df-44e9-95be-da8586a86ad3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.742471 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.742438 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26496b35-81df-44e9-95be-da8586a86ad3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.744937 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.744613 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/26496b35-81df-44e9-95be-da8586a86ad3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.744937 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.744780 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26496b35-81df-44e9-95be-da8586a86ad3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.745917 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.745848 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/26496b35-81df-44e9-95be-da8586a86ad3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.746686 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.746617 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/26496b35-81df-44e9-95be-da8586a86ad3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.747297 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.747270 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26496b35-81df-44e9-95be-da8586a86ad3-web-config\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.747409 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.747280 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/26496b35-81df-44e9-95be-da8586a86ad3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.747635 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.747611 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26496b35-81df-44e9-95be-da8586a86ad3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.748388 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.748362 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26496b35-81df-44e9-95be-da8586a86ad3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.748466 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.748371 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26496b35-81df-44e9-95be-da8586a86ad3-config-out\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.749079 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.749049 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26496b35-81df-44e9-95be-da8586a86ad3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.751818 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.749250 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26496b35-81df-44e9-95be-da8586a86ad3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.751818 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.749592 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/26496b35-81df-44e9-95be-da8586a86ad3-config\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.751818 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.750413 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmn8t\" (UniqueName: \"kubernetes.io/projected/26496b35-81df-44e9-95be-da8586a86ad3-kube-api-access-dmn8t\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.752581 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.752541 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/26496b35-81df-44e9-95be-da8586a86ad3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"26496b35-81df-44e9-95be-da8586a86ad3\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:42.910874 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:42.910828 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:51:43.006511 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:43.006484 2558 scope.go:117] "RemoveContainer" containerID="6999cb2cbe44d5eb3adbbf85c0dce12c845c5bfa245711f4f7d86b32fd1df8fa" Jun 03 00:51:43.014561 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:43.014541 2558 scope.go:117] "RemoveContainer" containerID="bb4a8fdec26b30494cfbf5eba7bdaf89122a30269bb5086fe8262e5af420ef19" Jun 03 00:51:43.054665 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:43.053909 2558 scope.go:117] "RemoveContainer" containerID="859f2eb01b5acf58faad5a3d29626199267b6fc05057e70ce7fb36cb581345d2" Jun 03 00:51:43.063433 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:43.063405 2558 scope.go:117] "RemoveContainer" containerID="10e548e4a994be1c0e406dd36dd7094f54902a13b46a79388d3fdeba63741d9c" Jun 03 00:51:43.071831 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:43.071801 2558 scope.go:117] "RemoveContainer" containerID="2007debd4d5c471db3bd69e2b893b4539dcaa591603944cbc4e105b5c1a7129f" Jun 03 00:51:43.145238 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:43.145209 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 00:51:43.148408 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:51:43.148378 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26496b35_81df_44e9_95be_da8586a86ad3.slice/crio-355f6d1b067f03b4cb856a2ddbe752b47b5bd00a35b178ec139054bb95c83a68 WatchSource:0}: Error finding container 355f6d1b067f03b4cb856a2ddbe752b47b5bd00a35b178ec139054bb95c83a68: Status 404 returned error can't find the container with id 355f6d1b067f03b4cb856a2ddbe752b47b5bd00a35b178ec139054bb95c83a68 Jun 03 00:51:43.545759 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:43.545658 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b7765564d-npmxf" event={"ID":"332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3","Type":"ContainerStarted","Data":"41ed9d0d4e6403874e7b24270cac31edb069939c03797aea5a699c5760ad17be"} Jun 03 00:51:43.545759 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:43.545704 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b7765564d-npmxf" event={"ID":"332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3","Type":"ContainerStarted","Data":"64e2b45f3ba3f6e0873c17438fe1bca729c9b2c91e9fcd4ad32bc3d025973c4d"} Jun 03 00:51:43.545759 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:43.545717 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b7765564d-npmxf" event={"ID":"332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3","Type":"ContainerStarted","Data":"3fd55f560121163a191207000e527c3aba9cf31c20029edb95d727193d9bdb40"} Jun 03 00:51:43.546957 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:43.546931 2558 generic.go:358] "Generic (PLEG): container finished" podID="26496b35-81df-44e9-95be-da8586a86ad3" containerID="877354ceaba09a94a1a960b5b0bbebc86bb38c9d0a3706175d2c11e2990dc11b" exitCode=0 Jun 03 00:51:43.547045 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:43.546981 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26496b35-81df-44e9-95be-da8586a86ad3","Type":"ContainerDied","Data":"877354ceaba09a94a1a960b5b0bbebc86bb38c9d0a3706175d2c11e2990dc11b"} Jun 03 00:51:43.547045 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:43.547005 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26496b35-81df-44e9-95be-da8586a86ad3","Type":"ContainerStarted","Data":"355f6d1b067f03b4cb856a2ddbe752b47b5bd00a35b178ec139054bb95c83a68"} Jun 03 00:51:43.567332 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:43.567281 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7b7765564d-npmxf" podStartSLOduration=1.90335769 podStartE2EDuration="4.567266025s" podCreationTimestamp="2026-06-03 00:51:39 +0000 UTC" firstStartedPulling="2026-06-03 00:51:40.403023692 +0000 UTC m=+171.101394162" lastFinishedPulling="2026-06-03 00:51:43.066932024 +0000 UTC m=+173.765302497" observedRunningTime="2026-06-03 00:51:43.564768449 +0000 UTC m=+174.263138941" watchObservedRunningTime="2026-06-03 00:51:43.567266025 +0000 UTC m=+174.265636516" Jun 03 00:51:43.774029 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:43.773967 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8228210a-899b-431e-b606-70e67ae93825" path="/var/lib/kubelet/pods/8228210a-899b-431e-b606-70e67ae93825/volumes" Jun 03 00:51:44.552851 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:44.552812 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26496b35-81df-44e9-95be-da8586a86ad3","Type":"ContainerStarted","Data":"5edf26325f3ba161239dbf183ad608d122baee1c5d6cd6439fb20dd3173fb952"} Jun 03 00:51:44.552851 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:44.552857 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26496b35-81df-44e9-95be-da8586a86ad3","Type":"ContainerStarted","Data":"9b9f189aa6a40f42d609d3337a01270e2af3b0a91be414c0478f78cc925002d3"} Jun 03 00:51:44.553235 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:44.552869 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26496b35-81df-44e9-95be-da8586a86ad3","Type":"ContainerStarted","Data":"501729eb656827505277d0e76adf95abfed39777675a6636f9c2dc13e7a418f6"} Jun 03 00:51:44.553235 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:44.552881 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26496b35-81df-44e9-95be-da8586a86ad3","Type":"ContainerStarted","Data":"23931a474c31ef5e05ea48ae9af3fd474e1f144ba5057f433b509d64dc8c420c"} Jun 03 00:51:44.553235 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:44.552890 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26496b35-81df-44e9-95be-da8586a86ad3","Type":"ContainerStarted","Data":"f4c14231d5bce7d36038f02e725020a7a926de4b0df2ae8fd87aebbd5611d303"} Jun 03 00:51:44.553235 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:44.552899 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26496b35-81df-44e9-95be-da8586a86ad3","Type":"ContainerStarted","Data":"82c02bdfff7dd22f92d1dde00a13b894b06b52de14c0e57e39d1543f00b51bce"} Jun 03 00:51:44.589643 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:44.589591 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.589575752 podStartE2EDuration="2.589575752s" podCreationTimestamp="2026-06-03 00:51:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:51:44.587820017 +0000 UTC m=+175.286190511" watchObservedRunningTime="2026-06-03 00:51:44.589575752 +0000 UTC m=+175.287946245" Jun 03 00:51:47.911423 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:51:47.911384 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:52:42.911000 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:52:42.910960 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:52:42.926405 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:52:42.926378 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:52:43.753373 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:52:43.753345 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:53:49.680578 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:53:49.680546 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-kmx8n_70d6f7a4-8438-4163-8f07-b108e3a30736/cluster-monitoring-operator/0.log" Jun 03 00:53:49.681143 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:53:49.681093 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-kmx8n_70d6f7a4-8438-4163-8f07-b108e3a30736/cluster-monitoring-operator/0.log" Jun 03 00:53:49.685615 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:53:49.685592 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-bqt4t_73408f89-f08e-4719-b940-5acc39134ab3/console-operator/1.log" Jun 03 00:53:49.685981 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:53:49.685963 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-bqt4t_73408f89-f08e-4719-b940-5acc39134ab3/console-operator/1.log" Jun 03 00:53:49.691381 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:53:49.691363 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8zww_c210edda-8849-4277-b258-5b40647200a9/ovn-acl-logging/0.log" Jun 03 00:53:49.691381 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:53:49.691374 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8zww_c210edda-8849-4277-b258-5b40647200a9/ovn-acl-logging/0.log" Jun 03 00:53:49.694670 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:53:49.694654 2558 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 00:54:43.404571 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:43.404533 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8474b9f56-rn7s7"] Jun 03 00:54:43.407799 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:43.407783 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8474b9f56-rn7s7" Jun 03 00:54:43.410319 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:43.410296 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 00:54:43.411560 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:43.411508 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 00:54:43.411661 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:43.411571 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 00:54:43.411661 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:43.411612 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 00:54:43.411661 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:43.411611 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-frtgw\"" Jun 03 00:54:43.411823 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:43.411571 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 00:54:43.428171 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:43.428148 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8474b9f56-rn7s7"] Jun 03 00:54:43.449568 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:43.449541 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88b22c67-f52b-4e3b-b6a3-72ca9cf7539e-cert\") pod \"lws-controller-manager-8474b9f56-rn7s7\" (UID: \"88b22c67-f52b-4e3b-b6a3-72ca9cf7539e\") " pod="openshift-lws-operator/lws-controller-manager-8474b9f56-rn7s7" Jun 03 00:54:43.449716 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:43.449629 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/88b22c67-f52b-4e3b-b6a3-72ca9cf7539e-metrics-cert\") pod \"lws-controller-manager-8474b9f56-rn7s7\" (UID: \"88b22c67-f52b-4e3b-b6a3-72ca9cf7539e\") " pod="openshift-lws-operator/lws-controller-manager-8474b9f56-rn7s7" Jun 03 00:54:43.449779 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:43.449734 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8d5v\" (UniqueName: \"kubernetes.io/projected/88b22c67-f52b-4e3b-b6a3-72ca9cf7539e-kube-api-access-l8d5v\") pod \"lws-controller-manager-8474b9f56-rn7s7\" (UID: \"88b22c67-f52b-4e3b-b6a3-72ca9cf7539e\") " pod="openshift-lws-operator/lws-controller-manager-8474b9f56-rn7s7" Jun 03 00:54:43.449835 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:43.449800 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/88b22c67-f52b-4e3b-b6a3-72ca9cf7539e-manager-config\") pod \"lws-controller-manager-8474b9f56-rn7s7\" (UID: \"88b22c67-f52b-4e3b-b6a3-72ca9cf7539e\") " pod="openshift-lws-operator/lws-controller-manager-8474b9f56-rn7s7" Jun 03 00:54:43.551061 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:43.551024 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/88b22c67-f52b-4e3b-b6a3-72ca9cf7539e-manager-config\") pod \"lws-controller-manager-8474b9f56-rn7s7\" (UID: \"88b22c67-f52b-4e3b-b6a3-72ca9cf7539e\") " pod="openshift-lws-operator/lws-controller-manager-8474b9f56-rn7s7" Jun 03 00:54:43.551245 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:43.551081 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88b22c67-f52b-4e3b-b6a3-72ca9cf7539e-cert\") pod \"lws-controller-manager-8474b9f56-rn7s7\" (UID: \"88b22c67-f52b-4e3b-b6a3-72ca9cf7539e\") " pod="openshift-lws-operator/lws-controller-manager-8474b9f56-rn7s7" Jun 03 00:54:43.551245 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:43.551116 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/88b22c67-f52b-4e3b-b6a3-72ca9cf7539e-metrics-cert\") pod \"lws-controller-manager-8474b9f56-rn7s7\" (UID: \"88b22c67-f52b-4e3b-b6a3-72ca9cf7539e\") " pod="openshift-lws-operator/lws-controller-manager-8474b9f56-rn7s7" Jun 03 00:54:43.551245 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:43.551152 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l8d5v\" (UniqueName: \"kubernetes.io/projected/88b22c67-f52b-4e3b-b6a3-72ca9cf7539e-kube-api-access-l8d5v\") pod \"lws-controller-manager-8474b9f56-rn7s7\" (UID: \"88b22c67-f52b-4e3b-b6a3-72ca9cf7539e\") " pod="openshift-lws-operator/lws-controller-manager-8474b9f56-rn7s7" Jun 03 00:54:43.551816 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:43.551788 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/88b22c67-f52b-4e3b-b6a3-72ca9cf7539e-manager-config\") pod \"lws-controller-manager-8474b9f56-rn7s7\" (UID: \"88b22c67-f52b-4e3b-b6a3-72ca9cf7539e\") " pod="openshift-lws-operator/lws-controller-manager-8474b9f56-rn7s7" Jun 03 00:54:43.553579 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:43.553558 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88b22c67-f52b-4e3b-b6a3-72ca9cf7539e-cert\") pod \"lws-controller-manager-8474b9f56-rn7s7\" (UID: \"88b22c67-f52b-4e3b-b6a3-72ca9cf7539e\") " pod="openshift-lws-operator/lws-controller-manager-8474b9f56-rn7s7" Jun 03 00:54:43.553727 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:43.553708 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/88b22c67-f52b-4e3b-b6a3-72ca9cf7539e-metrics-cert\") pod \"lws-controller-manager-8474b9f56-rn7s7\" (UID: \"88b22c67-f52b-4e3b-b6a3-72ca9cf7539e\") " pod="openshift-lws-operator/lws-controller-manager-8474b9f56-rn7s7" Jun 03 00:54:43.562290 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:43.562266 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8d5v\" (UniqueName: \"kubernetes.io/projected/88b22c67-f52b-4e3b-b6a3-72ca9cf7539e-kube-api-access-l8d5v\") pod \"lws-controller-manager-8474b9f56-rn7s7\" (UID: \"88b22c67-f52b-4e3b-b6a3-72ca9cf7539e\") " pod="openshift-lws-operator/lws-controller-manager-8474b9f56-rn7s7" Jun 03 00:54:43.717740 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:43.717645 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8474b9f56-rn7s7" Jun 03 00:54:43.856780 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:43.852809 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8474b9f56-rn7s7"] Jun 03 00:54:43.861245 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:43.861220 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 00:54:44.085037 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:44.085006 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8474b9f56-rn7s7" event={"ID":"88b22c67-f52b-4e3b-b6a3-72ca9cf7539e","Type":"ContainerStarted","Data":"3ed0273796329484f7ff92ad6f61a8ba10b69611351c9d4f7652b89058a2e67d"} Jun 03 00:54:46.503378 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:46.503343 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c859dd94f-9jhst"] Jun 03 00:54:46.507251 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:46.507228 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-9jhst" Jun 03 00:54:46.510082 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:46.510053 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 00:54:46.510196 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:46.510066 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 00:54:46.510276 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:46.510258 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 00:54:46.510354 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:46.510337 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-whgm8\"" Jun 03 00:54:46.510653 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:46.510638 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 00:54:46.519411 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:46.519388 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c859dd94f-9jhst"] Jun 03 00:54:46.581308 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:46.581228 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ec93bfc5-f888-433e-a038-520a03617a6f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c859dd94f-9jhst\" (UID: \"ec93bfc5-f888-433e-a038-520a03617a6f\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-9jhst" Jun 03 00:54:46.581308 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:46.581277 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ec93bfc5-f888-433e-a038-520a03617a6f-manifests\") pod \"opendatahub-operator-controller-manager-7c859dd94f-9jhst\" (UID: \"ec93bfc5-f888-433e-a038-520a03617a6f\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-9jhst" Jun 03 00:54:46.581308 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:46.581307 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjndq\" (UniqueName: \"kubernetes.io/projected/ec93bfc5-f888-433e-a038-520a03617a6f-kube-api-access-jjndq\") pod \"opendatahub-operator-controller-manager-7c859dd94f-9jhst\" (UID: \"ec93bfc5-f888-433e-a038-520a03617a6f\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-9jhst" Jun 03 00:54:46.581541 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:46.581361 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec93bfc5-f888-433e-a038-520a03617a6f-tmp\") pod \"opendatahub-operator-controller-manager-7c859dd94f-9jhst\" (UID: \"ec93bfc5-f888-433e-a038-520a03617a6f\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-9jhst" Jun 03 00:54:46.581541 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:46.581408 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec93bfc5-f888-433e-a038-520a03617a6f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c859dd94f-9jhst\" (UID: \"ec93bfc5-f888-433e-a038-520a03617a6f\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-9jhst" Jun 03 00:54:46.682846 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:46.682803 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec93bfc5-f888-433e-a038-520a03617a6f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c859dd94f-9jhst\" (UID: \"ec93bfc5-f888-433e-a038-520a03617a6f\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-9jhst" Jun 03 00:54:46.683050 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:46.682871 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ec93bfc5-f888-433e-a038-520a03617a6f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c859dd94f-9jhst\" (UID: \"ec93bfc5-f888-433e-a038-520a03617a6f\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-9jhst" Jun 03 00:54:46.683050 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:46.682910 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ec93bfc5-f888-433e-a038-520a03617a6f-manifests\") pod \"opendatahub-operator-controller-manager-7c859dd94f-9jhst\" (UID: \"ec93bfc5-f888-433e-a038-520a03617a6f\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-9jhst" Jun 03 00:54:46.683050 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:46.682938 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jjndq\" (UniqueName: \"kubernetes.io/projected/ec93bfc5-f888-433e-a038-520a03617a6f-kube-api-access-jjndq\") pod \"opendatahub-operator-controller-manager-7c859dd94f-9jhst\" (UID: \"ec93bfc5-f888-433e-a038-520a03617a6f\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-9jhst" Jun 03 00:54:46.683050 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:46.682977 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec93bfc5-f888-433e-a038-520a03617a6f-tmp\") pod \"opendatahub-operator-controller-manager-7c859dd94f-9jhst\" (UID: \"ec93bfc5-f888-433e-a038-520a03617a6f\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-9jhst" Jun 03 00:54:46.683490 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:46.683460 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ec93bfc5-f888-433e-a038-520a03617a6f-manifests\") pod \"opendatahub-operator-controller-manager-7c859dd94f-9jhst\" (UID: \"ec93bfc5-f888-433e-a038-520a03617a6f\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-9jhst" Jun 03 00:54:46.685407 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:46.685375 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec93bfc5-f888-433e-a038-520a03617a6f-tmp\") pod \"opendatahub-operator-controller-manager-7c859dd94f-9jhst\" (UID: \"ec93bfc5-f888-433e-a038-520a03617a6f\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-9jhst" Jun 03 00:54:46.685822 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:46.685797 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec93bfc5-f888-433e-a038-520a03617a6f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c859dd94f-9jhst\" (UID: \"ec93bfc5-f888-433e-a038-520a03617a6f\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-9jhst" Jun 03 00:54:46.685822 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:46.685807 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ec93bfc5-f888-433e-a038-520a03617a6f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c859dd94f-9jhst\" (UID: \"ec93bfc5-f888-433e-a038-520a03617a6f\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-9jhst" Jun 03 00:54:46.694717 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:46.694695 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjndq\" (UniqueName: \"kubernetes.io/projected/ec93bfc5-f888-433e-a038-520a03617a6f-kube-api-access-jjndq\") pod \"opendatahub-operator-controller-manager-7c859dd94f-9jhst\" (UID: \"ec93bfc5-f888-433e-a038-520a03617a6f\") " pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-9jhst" Jun 03 00:54:46.817954 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:46.817915 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-9jhst" Jun 03 00:54:46.947306 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:46.947267 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c859dd94f-9jhst"] Jun 03 00:54:46.949489 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:54:46.949465 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec93bfc5_f888_433e_a038_520a03617a6f.slice/crio-0bae3870215488b8dbf83e1b4ce729116e338be936cd81870541463befe0cde9 WatchSource:0}: Error finding container 0bae3870215488b8dbf83e1b4ce729116e338be936cd81870541463befe0cde9: Status 404 returned error can't find the container with id 0bae3870215488b8dbf83e1b4ce729116e338be936cd81870541463befe0cde9 Jun 03 00:54:47.097204 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:47.097169 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8474b9f56-rn7s7" event={"ID":"88b22c67-f52b-4e3b-b6a3-72ca9cf7539e","Type":"ContainerStarted","Data":"8567a37d806914430184ea14ef63a1ebf31c4866d664925c15c38f307f68d14e"} Jun 03 00:54:47.097391 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:47.097299 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8474b9f56-rn7s7" Jun 03 00:54:47.098432 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:47.098407 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-9jhst" event={"ID":"ec93bfc5-f888-433e-a038-520a03617a6f","Type":"ContainerStarted","Data":"0bae3870215488b8dbf83e1b4ce729116e338be936cd81870541463befe0cde9"} Jun 03 00:54:47.119332 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:47.119241 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8474b9f56-rn7s7" podStartSLOduration=1.6731268830000001 podStartE2EDuration="4.119229802s" podCreationTimestamp="2026-06-03 00:54:43 +0000 UTC" firstStartedPulling="2026-06-03 00:54:43.861401056 +0000 UTC m=+354.559771541" lastFinishedPulling="2026-06-03 00:54:46.30750399 +0000 UTC m=+357.005874460" observedRunningTime="2026-06-03 00:54:47.117450662 +0000 UTC m=+357.815821160" watchObservedRunningTime="2026-06-03 00:54:47.119229802 +0000 UTC m=+357.817600272" Jun 03 00:54:50.111176 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:50.111138 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-9jhst" event={"ID":"ec93bfc5-f888-433e-a038-520a03617a6f","Type":"ContainerStarted","Data":"d4715682f360f9292f94796d81ed5866b1bf07bb112e36c9ddd2e72ece60bf07"} Jun 03 00:54:51.115866 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:51.115773 2558 generic.go:358] "Generic (PLEG): container finished" podID="ec93bfc5-f888-433e-a038-520a03617a6f" containerID="d4715682f360f9292f94796d81ed5866b1bf07bb112e36c9ddd2e72ece60bf07" exitCode=0 Jun 03 00:54:51.116313 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:51.115861 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-9jhst" event={"ID":"ec93bfc5-f888-433e-a038-520a03617a6f","Type":"ContainerDied","Data":"d4715682f360f9292f94796d81ed5866b1bf07bb112e36c9ddd2e72ece60bf07"} Jun 03 00:54:52.120581 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:52.120547 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-9jhst" event={"ID":"ec93bfc5-f888-433e-a038-520a03617a6f","Type":"ContainerStarted","Data":"9dada91e63cfdcb94f18a1d2889f3d77dede4caaf25b1aa9e150baead583c45c"} Jun 03 00:54:52.120956 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:52.120665 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-9jhst" Jun 03 00:54:52.143105 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:52.143047 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-9jhst" podStartSLOduration=1.6561418589999999 podStartE2EDuration="6.143031937s" podCreationTimestamp="2026-06-03 00:54:46 +0000 UTC" firstStartedPulling="2026-06-03 00:54:46.951196324 +0000 UTC m=+357.649566795" lastFinishedPulling="2026-06-03 00:54:51.4380864 +0000 UTC m=+362.136456873" observedRunningTime="2026-06-03 00:54:52.141253825 +0000 UTC m=+362.839624326" watchObservedRunningTime="2026-06-03 00:54:52.143031937 +0000 UTC m=+362.841402430" Jun 03 00:54:58.104634 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:54:58.104602 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8474b9f56-rn7s7" Jun 03 00:55:03.126941 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:55:03.126899 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c859dd94f-9jhst" Jun 03 00:55:16.020748 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:55:16.020712 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-df58ddb79-tsxrt"] Jun 03 00:55:16.031049 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:55:16.031022 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-df58ddb79-tsxrt" Jun 03 00:55:16.034973 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:55:16.034944 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-vr84s\"" Jun 03 00:55:16.035111 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:55:16.034992 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 00:55:16.035111 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:55:16.034947 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 00:55:16.045754 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:55:16.045732 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-df58ddb79-tsxrt"] Jun 03 00:55:16.150002 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:55:16.149969 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08319995-c846-4ef5-a801-b402fb3a8d98-tls-certs\") pod \"kube-auth-proxy-df58ddb79-tsxrt\" (UID: \"08319995-c846-4ef5-a801-b402fb3a8d98\") " pod="openshift-ingress/kube-auth-proxy-df58ddb79-tsxrt" Jun 03 00:55:16.150185 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:55:16.150029 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwr9l\" (UniqueName: \"kubernetes.io/projected/08319995-c846-4ef5-a801-b402fb3a8d98-kube-api-access-fwr9l\") pod \"kube-auth-proxy-df58ddb79-tsxrt\" (UID: \"08319995-c846-4ef5-a801-b402fb3a8d98\") " pod="openshift-ingress/kube-auth-proxy-df58ddb79-tsxrt" Jun 03 00:55:16.150185 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:55:16.150109 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08319995-c846-4ef5-a801-b402fb3a8d98-tmp\") pod \"kube-auth-proxy-df58ddb79-tsxrt\" (UID: \"08319995-c846-4ef5-a801-b402fb3a8d98\") " pod="openshift-ingress/kube-auth-proxy-df58ddb79-tsxrt" Jun 03 00:55:16.251163 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:55:16.251123 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08319995-c846-4ef5-a801-b402fb3a8d98-tls-certs\") pod \"kube-auth-proxy-df58ddb79-tsxrt\" (UID: \"08319995-c846-4ef5-a801-b402fb3a8d98\") " pod="openshift-ingress/kube-auth-proxy-df58ddb79-tsxrt" Jun 03 00:55:16.251363 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:55:16.251184 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fwr9l\" (UniqueName: \"kubernetes.io/projected/08319995-c846-4ef5-a801-b402fb3a8d98-kube-api-access-fwr9l\") pod \"kube-auth-proxy-df58ddb79-tsxrt\" (UID: \"08319995-c846-4ef5-a801-b402fb3a8d98\") " pod="openshift-ingress/kube-auth-proxy-df58ddb79-tsxrt" Jun 03 00:55:16.251363 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:55:16.251235 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08319995-c846-4ef5-a801-b402fb3a8d98-tmp\") pod \"kube-auth-proxy-df58ddb79-tsxrt\" (UID: \"08319995-c846-4ef5-a801-b402fb3a8d98\") " pod="openshift-ingress/kube-auth-proxy-df58ddb79-tsxrt" Jun 03 00:55:16.253424 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:55:16.253396 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08319995-c846-4ef5-a801-b402fb3a8d98-tmp\") pod \"kube-auth-proxy-df58ddb79-tsxrt\" (UID: \"08319995-c846-4ef5-a801-b402fb3a8d98\") " pod="openshift-ingress/kube-auth-proxy-df58ddb79-tsxrt" Jun 03 00:55:16.253681 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:55:16.253659 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08319995-c846-4ef5-a801-b402fb3a8d98-tls-certs\") pod \"kube-auth-proxy-df58ddb79-tsxrt\" (UID: \"08319995-c846-4ef5-a801-b402fb3a8d98\") " pod="openshift-ingress/kube-auth-proxy-df58ddb79-tsxrt" Jun 03 00:55:16.259911 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:55:16.259887 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwr9l\" (UniqueName: \"kubernetes.io/projected/08319995-c846-4ef5-a801-b402fb3a8d98-kube-api-access-fwr9l\") pod \"kube-auth-proxy-df58ddb79-tsxrt\" (UID: \"08319995-c846-4ef5-a801-b402fb3a8d98\") " pod="openshift-ingress/kube-auth-proxy-df58ddb79-tsxrt" Jun 03 00:55:16.340506 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:55:16.340466 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-df58ddb79-tsxrt" Jun 03 00:55:16.489465 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:55:16.489359 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-df58ddb79-tsxrt"] Jun 03 00:55:16.492601 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:55:16.492575 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08319995_c846_4ef5_a801_b402fb3a8d98.slice/crio-707036dfd4603476f93d7a7138ee589213bc41e4a4e2fea85da612ecad3dd37b WatchSource:0}: Error finding container 707036dfd4603476f93d7a7138ee589213bc41e4a4e2fea85da612ecad3dd37b: Status 404 returned error can't find the container with id 707036dfd4603476f93d7a7138ee589213bc41e4a4e2fea85da612ecad3dd37b Jun 03 00:55:17.208026 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:55:17.207979 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-df58ddb79-tsxrt" event={"ID":"08319995-c846-4ef5-a801-b402fb3a8d98","Type":"ContainerStarted","Data":"707036dfd4603476f93d7a7138ee589213bc41e4a4e2fea85da612ecad3dd37b"} Jun 03 00:55:20.218560 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:55:20.218499 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-df58ddb79-tsxrt" event={"ID":"08319995-c846-4ef5-a801-b402fb3a8d98","Type":"ContainerStarted","Data":"c9d34ab82a124dfc834a17576da7e93b00f4cab20702d37a9169da6e18576e96"} Jun 03 00:55:20.235769 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:55:20.235715 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-df58ddb79-tsxrt" podStartSLOduration=2.349864198 podStartE2EDuration="5.235700552s" podCreationTimestamp="2026-06-03 00:55:15 +0000 UTC" firstStartedPulling="2026-06-03 00:55:16.494639683 +0000 UTC m=+387.193010153" lastFinishedPulling="2026-06-03 00:55:19.380476034 +0000 UTC m=+390.078846507" observedRunningTime="2026-06-03 00:55:20.23419205 +0000 UTC m=+390.932562542" watchObservedRunningTime="2026-06-03 00:55:20.235700552 +0000 UTC m=+390.934071089" Jun 03 00:56:53.656944 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:56:53.656909 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-c96d6"] Jun 03 00:56:53.660527 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:56:53.660496 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-c96d6" Jun 03 00:56:53.663233 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:56:53.663214 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 00:56:53.663343 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:56:53.663258 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-fx82g\"" Jun 03 00:56:53.664333 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:56:53.664319 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 00:56:53.668235 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:56:53.668205 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-c96d6"] Jun 03 00:56:53.725184 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:56:53.725139 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rshdq\" (UniqueName: \"kubernetes.io/projected/95a550a0-d056-4246-bb09-ee3da9b3c321-kube-api-access-rshdq\") pod \"authorino-operator-657f44b778-c96d6\" (UID: \"95a550a0-d056-4246-bb09-ee3da9b3c321\") " pod="kuadrant-system/authorino-operator-657f44b778-c96d6" Jun 03 00:56:53.825847 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:56:53.825808 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rshdq\" (UniqueName: \"kubernetes.io/projected/95a550a0-d056-4246-bb09-ee3da9b3c321-kube-api-access-rshdq\") pod \"authorino-operator-657f44b778-c96d6\" (UID: \"95a550a0-d056-4246-bb09-ee3da9b3c321\") " pod="kuadrant-system/authorino-operator-657f44b778-c96d6" Jun 03 00:56:53.839832 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:56:53.839791 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rshdq\" (UniqueName: \"kubernetes.io/projected/95a550a0-d056-4246-bb09-ee3da9b3c321-kube-api-access-rshdq\") pod \"authorino-operator-657f44b778-c96d6\" (UID: \"95a550a0-d056-4246-bb09-ee3da9b3c321\") " pod="kuadrant-system/authorino-operator-657f44b778-c96d6" Jun 03 00:56:53.971714 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:56:53.971626 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-c96d6" Jun 03 00:56:54.098910 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:56:54.098880 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-c96d6"] Jun 03 00:56:54.101598 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:56:54.101571 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95a550a0_d056_4246_bb09_ee3da9b3c321.slice/crio-1b369006eb10bb34ee8226b8a64c9dc798da88e3697e4009f74460f050b56a93 WatchSource:0}: Error finding container 1b369006eb10bb34ee8226b8a64c9dc798da88e3697e4009f74460f050b56a93: Status 404 returned error can't find the container with id 1b369006eb10bb34ee8226b8a64c9dc798da88e3697e4009f74460f050b56a93 Jun 03 00:56:54.542935 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:56:54.542900 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-c96d6" event={"ID":"95a550a0-d056-4246-bb09-ee3da9b3c321","Type":"ContainerStarted","Data":"1b369006eb10bb34ee8226b8a64c9dc798da88e3697e4009f74460f050b56a93"} Jun 03 00:56:57.557183 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:56:57.557143 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-c96d6" event={"ID":"95a550a0-d056-4246-bb09-ee3da9b3c321","Type":"ContainerStarted","Data":"25ea884f8a4d08546f0710c1ffa501c6fb42a024c82b7ed8e4f5b87a69226814"} Jun 03 00:56:57.557594 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:56:57.557328 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-c96d6" Jun 03 00:56:57.577385 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:56:57.577339 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-c96d6" podStartSLOduration=2.151549305 podStartE2EDuration="4.577327761s" podCreationTimestamp="2026-06-03 00:56:53 +0000 UTC" firstStartedPulling="2026-06-03 00:56:54.103592082 +0000 UTC m=+484.801962552" lastFinishedPulling="2026-06-03 00:56:56.529370537 +0000 UTC m=+487.227741008" observedRunningTime="2026-06-03 00:56:57.576048429 +0000 UTC m=+488.274418924" watchObservedRunningTime="2026-06-03 00:56:57.577327761 +0000 UTC m=+488.275698252" Jun 03 00:57:08.562489 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:57:08.562457 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-c96d6" Jun 03 00:57:35.673612 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:57:35.673531 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6cl2q"] Jun 03 00:57:35.677060 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:57:35.677043 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-6cl2q" Jun 03 00:57:35.679436 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:57:35.679415 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2d4wz\"" Jun 03 00:57:35.679564 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:57:35.679415 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 00:57:35.685644 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:57:35.685621 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6cl2q"] Jun 03 00:57:35.708879 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:57:35.708834 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6cl2q"] Jun 03 00:57:35.802747 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:57:35.802698 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/be56a61b-ac53-4670-b405-4ca06c734bc8-config-file\") pod \"limitador-limitador-78c99df468-6cl2q\" (UID: \"be56a61b-ac53-4670-b405-4ca06c734bc8\") " pod="kuadrant-system/limitador-limitador-78c99df468-6cl2q" Jun 03 00:57:35.802747 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:57:35.802754 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rszkc\" (UniqueName: \"kubernetes.io/projected/be56a61b-ac53-4670-b405-4ca06c734bc8-kube-api-access-rszkc\") pod \"limitador-limitador-78c99df468-6cl2q\" (UID: \"be56a61b-ac53-4670-b405-4ca06c734bc8\") " pod="kuadrant-system/limitador-limitador-78c99df468-6cl2q" Jun 03 00:57:35.904270 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:57:35.904237 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/be56a61b-ac53-4670-b405-4ca06c734bc8-config-file\") pod \"limitador-limitador-78c99df468-6cl2q\" (UID: \"be56a61b-ac53-4670-b405-4ca06c734bc8\") " pod="kuadrant-system/limitador-limitador-78c99df468-6cl2q" Jun 03 00:57:35.904426 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:57:35.904279 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rszkc\" (UniqueName: \"kubernetes.io/projected/be56a61b-ac53-4670-b405-4ca06c734bc8-kube-api-access-rszkc\") pod \"limitador-limitador-78c99df468-6cl2q\" (UID: \"be56a61b-ac53-4670-b405-4ca06c734bc8\") " pod="kuadrant-system/limitador-limitador-78c99df468-6cl2q" Jun 03 00:57:35.904842 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:57:35.904824 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/be56a61b-ac53-4670-b405-4ca06c734bc8-config-file\") pod \"limitador-limitador-78c99df468-6cl2q\" (UID: \"be56a61b-ac53-4670-b405-4ca06c734bc8\") " pod="kuadrant-system/limitador-limitador-78c99df468-6cl2q" Jun 03 00:57:35.912257 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:57:35.912233 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rszkc\" (UniqueName: \"kubernetes.io/projected/be56a61b-ac53-4670-b405-4ca06c734bc8-kube-api-access-rszkc\") pod \"limitador-limitador-78c99df468-6cl2q\" (UID: \"be56a61b-ac53-4670-b405-4ca06c734bc8\") " pod="kuadrant-system/limitador-limitador-78c99df468-6cl2q" Jun 03 00:57:35.988750 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:57:35.988669 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-6cl2q" Jun 03 00:57:36.125391 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:57:36.125365 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6cl2q"] Jun 03 00:57:36.127711 ip-10-0-134-48 kubenswrapper[2558]: W0603 00:57:36.127669 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe56a61b_ac53_4670_b405_4ca06c734bc8.slice/crio-681297cfa80509cdb6d4b8552b3a1644bdae70a1dd1e978fe94af0ca76144bf2 WatchSource:0}: Error finding container 681297cfa80509cdb6d4b8552b3a1644bdae70a1dd1e978fe94af0ca76144bf2: Status 404 returned error can't find the container with id 681297cfa80509cdb6d4b8552b3a1644bdae70a1dd1e978fe94af0ca76144bf2 Jun 03 00:57:36.710083 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:57:36.710042 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-6cl2q" event={"ID":"be56a61b-ac53-4670-b405-4ca06c734bc8","Type":"ContainerStarted","Data":"681297cfa80509cdb6d4b8552b3a1644bdae70a1dd1e978fe94af0ca76144bf2"} Jun 03 00:57:38.718758 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:57:38.718720 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-6cl2q" event={"ID":"be56a61b-ac53-4670-b405-4ca06c734bc8","Type":"ContainerStarted","Data":"266a1255e37dd1ed391912fb7eba89ef3a97d7017697c10a1d2b65aa4192c3a8"} Jun 03 00:57:38.719212 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:57:38.718822 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-6cl2q" Jun 03 00:57:38.735233 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:57:38.735185 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-6cl2q" podStartSLOduration=1.305464389 podStartE2EDuration="3.735171666s" podCreationTimestamp="2026-06-03 00:57:35 +0000 UTC" firstStartedPulling="2026-06-03 00:57:36.129483025 +0000 UTC m=+526.827853498" lastFinishedPulling="2026-06-03 00:57:38.559190292 +0000 UTC m=+529.257560775" observedRunningTime="2026-06-03 00:57:38.732646358 +0000 UTC m=+529.431016849" watchObservedRunningTime="2026-06-03 00:57:38.735171666 +0000 UTC m=+529.433542157" Jun 03 00:57:49.722472 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:57:49.722436 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-6cl2q" Jun 03 00:58:49.707055 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:58:49.707025 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-kmx8n_70d6f7a4-8438-4163-8f07-b108e3a30736/cluster-monitoring-operator/0.log" Jun 03 00:58:49.708771 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:58:49.708752 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-kmx8n_70d6f7a4-8438-4163-8f07-b108e3a30736/cluster-monitoring-operator/0.log" Jun 03 00:58:49.711206 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:58:49.711185 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-bqt4t_73408f89-f08e-4719-b940-5acc39134ab3/console-operator/1.log" Jun 03 00:58:49.712780 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:58:49.712766 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-bqt4t_73408f89-f08e-4719-b940-5acc39134ab3/console-operator/1.log" Jun 03 00:58:49.715993 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:58:49.715976 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8zww_c210edda-8849-4277-b258-5b40647200a9/ovn-acl-logging/0.log" Jun 03 00:58:49.717634 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:58:49.717618 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8zww_c210edda-8849-4277-b258-5b40647200a9/ovn-acl-logging/0.log" Jun 03 00:59:41.672178 ip-10-0-134-48 kubenswrapper[2558]: I0603 00:59:41.672138 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6cl2q"] Jun 03 01:00:00.139996 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:00.139955 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29674140-g7z6c"] Jun 03 01:00:00.143695 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:00.143675 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29674140-g7z6c" Jun 03 01:00:00.146060 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:00.146035 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-thxrv\"" Jun 03 01:00:00.147059 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:00.147032 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29674140-g7z6c"] Jun 03 01:00:00.180048 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:00.180014 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fx2r\" (UniqueName: \"kubernetes.io/projected/687adba7-ca1a-4844-9713-fe9d0a50c997-kube-api-access-8fx2r\") pod \"maas-api-key-cleanup-29674140-g7z6c\" (UID: \"687adba7-ca1a-4844-9713-fe9d0a50c997\") " pod="opendatahub/maas-api-key-cleanup-29674140-g7z6c" Jun 03 01:00:00.281109 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:00.281068 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8fx2r\" (UniqueName: \"kubernetes.io/projected/687adba7-ca1a-4844-9713-fe9d0a50c997-kube-api-access-8fx2r\") pod \"maas-api-key-cleanup-29674140-g7z6c\" (UID: \"687adba7-ca1a-4844-9713-fe9d0a50c997\") " pod="opendatahub/maas-api-key-cleanup-29674140-g7z6c" Jun 03 01:00:00.289766 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:00.289735 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fx2r\" (UniqueName: \"kubernetes.io/projected/687adba7-ca1a-4844-9713-fe9d0a50c997-kube-api-access-8fx2r\") pod \"maas-api-key-cleanup-29674140-g7z6c\" (UID: \"687adba7-ca1a-4844-9713-fe9d0a50c997\") " pod="opendatahub/maas-api-key-cleanup-29674140-g7z6c" Jun 03 01:00:00.456102 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:00.456010 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29674140-g7z6c" Jun 03 01:00:00.582336 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:00.582305 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29674140-g7z6c"] Jun 03 01:00:00.584463 ip-10-0-134-48 kubenswrapper[2558]: W0603 01:00:00.584436 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod687adba7_ca1a_4844_9713_fe9d0a50c997.slice/crio-ff80f164b83b57e1fdee0912c2c96d0019d7e0a853bd1d786c8bbeb2ce3f18a9 WatchSource:0}: Error finding container ff80f164b83b57e1fdee0912c2c96d0019d7e0a853bd1d786c8bbeb2ce3f18a9: Status 404 returned error can't find the container with id ff80f164b83b57e1fdee0912c2c96d0019d7e0a853bd1d786c8bbeb2ce3f18a9 Jun 03 01:00:00.586096 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:00.586076 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 01:00:01.216334 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:01.216294 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29674140-g7z6c" event={"ID":"687adba7-ca1a-4844-9713-fe9d0a50c997","Type":"ContainerStarted","Data":"ff80f164b83b57e1fdee0912c2c96d0019d7e0a853bd1d786c8bbeb2ce3f18a9"} Jun 03 01:00:07.238618 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:07.238529 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29674140-g7z6c" event={"ID":"687adba7-ca1a-4844-9713-fe9d0a50c997","Type":"ContainerStarted","Data":"7c7605f34a6b519b519cdf8d6e0ecd00a8e9fe345643ddcf1d60c605ff7f7a57"} Jun 03 01:00:07.254353 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:07.254303 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29674140-g7z6c" podStartSLOduration=1.249759202 podStartE2EDuration="7.254289295s" podCreationTimestamp="2026-06-03 01:00:00 +0000 UTC" firstStartedPulling="2026-06-03 01:00:00.586211597 +0000 UTC m=+671.284582067" lastFinishedPulling="2026-06-03 01:00:06.59074168 +0000 UTC m=+677.289112160" observedRunningTime="2026-06-03 01:00:07.252885323 +0000 UTC m=+677.951255827" watchObservedRunningTime="2026-06-03 01:00:07.254289295 +0000 UTC m=+677.952659787" Jun 03 01:00:08.243607 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:08.243571 2558 generic.go:358] "Generic (PLEG): container finished" podID="687adba7-ca1a-4844-9713-fe9d0a50c997" containerID="7c7605f34a6b519b519cdf8d6e0ecd00a8e9fe345643ddcf1d60c605ff7f7a57" exitCode=0 Jun 03 01:00:08.243991 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:08.243666 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29674140-g7z6c" event={"ID":"687adba7-ca1a-4844-9713-fe9d0a50c997","Type":"ContainerDied","Data":"7c7605f34a6b519b519cdf8d6e0ecd00a8e9fe345643ddcf1d60c605ff7f7a57"} Jun 03 01:00:09.375119 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:09.375096 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29674140-g7z6c" Jun 03 01:00:09.458017 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:09.457985 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fx2r\" (UniqueName: \"kubernetes.io/projected/687adba7-ca1a-4844-9713-fe9d0a50c997-kube-api-access-8fx2r\") pod \"687adba7-ca1a-4844-9713-fe9d0a50c997\" (UID: \"687adba7-ca1a-4844-9713-fe9d0a50c997\") " Jun 03 01:00:09.460234 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:09.460212 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/687adba7-ca1a-4844-9713-fe9d0a50c997-kube-api-access-8fx2r" (OuterVolumeSpecName: "kube-api-access-8fx2r") pod "687adba7-ca1a-4844-9713-fe9d0a50c997" (UID: "687adba7-ca1a-4844-9713-fe9d0a50c997"). InnerVolumeSpecName "kube-api-access-8fx2r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:00:09.558989 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:09.558960 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fx2r\" (UniqueName: \"kubernetes.io/projected/687adba7-ca1a-4844-9713-fe9d0a50c997-kube-api-access-8fx2r\") on node \"ip-10-0-134-48.ec2.internal\" DevicePath \"\"" Jun 03 01:00:10.251119 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:10.251087 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29674140-g7z6c" Jun 03 01:00:10.251298 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:10.251093 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29674140-g7z6c" event={"ID":"687adba7-ca1a-4844-9713-fe9d0a50c997","Type":"ContainerDied","Data":"ff80f164b83b57e1fdee0912c2c96d0019d7e0a853bd1d786c8bbeb2ce3f18a9"} Jun 03 01:00:10.251298 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:10.251202 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff80f164b83b57e1fdee0912c2c96d0019d7e0a853bd1d786c8bbeb2ce3f18a9" Jun 03 01:00:57.286693 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:57.286657 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm"] Jun 03 01:00:57.287146 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:57.287074 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="687adba7-ca1a-4844-9713-fe9d0a50c997" containerName="cleanup" Jun 03 01:00:57.287146 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:57.287088 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="687adba7-ca1a-4844-9713-fe9d0a50c997" containerName="cleanup" Jun 03 01:00:57.287218 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:57.287171 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="687adba7-ca1a-4844-9713-fe9d0a50c997" containerName="cleanup" Jun 03 01:00:57.292902 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:57.292883 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm" Jun 03 01:00:57.296362 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:57.296327 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 01:00:57.296567 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:57.296550 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 03 01:00:57.297665 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:57.297649 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fp5s5\"" Jun 03 01:00:57.297743 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:57.297727 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 01:00:57.305677 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:57.305655 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm"] Jun 03 01:00:57.410306 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:57.410271 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/697a8f27-5e86-416d-8c24-cefbb1aa7197-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm\" (UID: \"697a8f27-5e86-416d-8c24-cefbb1aa7197\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm" Jun 03 01:00:57.410502 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:57.410323 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/697a8f27-5e86-416d-8c24-cefbb1aa7197-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm\" (UID: \"697a8f27-5e86-416d-8c24-cefbb1aa7197\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm" Jun 03 01:00:57.410502 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:57.410342 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/697a8f27-5e86-416d-8c24-cefbb1aa7197-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm\" (UID: \"697a8f27-5e86-416d-8c24-cefbb1aa7197\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm" Jun 03 01:00:57.410502 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:57.410359 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/697a8f27-5e86-416d-8c24-cefbb1aa7197-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm\" (UID: \"697a8f27-5e86-416d-8c24-cefbb1aa7197\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm" Jun 03 01:00:57.410502 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:57.410380 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/697a8f27-5e86-416d-8c24-cefbb1aa7197-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm\" (UID: \"697a8f27-5e86-416d-8c24-cefbb1aa7197\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm" Jun 03 01:00:57.410502 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:57.410414 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlv6n\" (UniqueName: \"kubernetes.io/projected/697a8f27-5e86-416d-8c24-cefbb1aa7197-kube-api-access-hlv6n\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm\" (UID: \"697a8f27-5e86-416d-8c24-cefbb1aa7197\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm" Jun 03 01:00:57.511772 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:57.511731 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/697a8f27-5e86-416d-8c24-cefbb1aa7197-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm\" (UID: \"697a8f27-5e86-416d-8c24-cefbb1aa7197\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm" Jun 03 01:00:57.511941 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:57.511794 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/697a8f27-5e86-416d-8c24-cefbb1aa7197-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm\" (UID: \"697a8f27-5e86-416d-8c24-cefbb1aa7197\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm" Jun 03 01:00:57.511941 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:57.511821 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/697a8f27-5e86-416d-8c24-cefbb1aa7197-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm\" (UID: \"697a8f27-5e86-416d-8c24-cefbb1aa7197\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm" Jun 03 01:00:57.511941 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:57.511843 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/697a8f27-5e86-416d-8c24-cefbb1aa7197-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm\" (UID: \"697a8f27-5e86-416d-8c24-cefbb1aa7197\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm" Jun 03 01:00:57.511941 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:57.511874 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/697a8f27-5e86-416d-8c24-cefbb1aa7197-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm\" (UID: \"697a8f27-5e86-416d-8c24-cefbb1aa7197\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm" Jun 03 01:00:57.512129 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:57.512029 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hlv6n\" (UniqueName: \"kubernetes.io/projected/697a8f27-5e86-416d-8c24-cefbb1aa7197-kube-api-access-hlv6n\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm\" (UID: \"697a8f27-5e86-416d-8c24-cefbb1aa7197\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm" Jun 03 01:00:57.512295 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:57.512271 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/697a8f27-5e86-416d-8c24-cefbb1aa7197-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm\" (UID: \"697a8f27-5e86-416d-8c24-cefbb1aa7197\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm" Jun 03 01:00:57.512295 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:57.512289 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/697a8f27-5e86-416d-8c24-cefbb1aa7197-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm\" (UID: \"697a8f27-5e86-416d-8c24-cefbb1aa7197\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm" Jun 03 01:00:57.512397 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:57.512327 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/697a8f27-5e86-416d-8c24-cefbb1aa7197-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm\" (UID: \"697a8f27-5e86-416d-8c24-cefbb1aa7197\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm" Jun 03 01:00:57.514219 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:57.514203 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/697a8f27-5e86-416d-8c24-cefbb1aa7197-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm\" (UID: \"697a8f27-5e86-416d-8c24-cefbb1aa7197\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm" Jun 03 01:00:57.514384 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:57.514368 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/697a8f27-5e86-416d-8c24-cefbb1aa7197-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm\" (UID: \"697a8f27-5e86-416d-8c24-cefbb1aa7197\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm" Jun 03 01:00:57.520739 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:57.520715 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlv6n\" (UniqueName: \"kubernetes.io/projected/697a8f27-5e86-416d-8c24-cefbb1aa7197-kube-api-access-hlv6n\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm\" (UID: \"697a8f27-5e86-416d-8c24-cefbb1aa7197\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm" Jun 03 01:00:57.603184 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:57.603143 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm" Jun 03 01:00:57.657101 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:57.657066 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6cl2q"] Jun 03 01:00:57.736305 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:57.736282 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm"] Jun 03 01:00:57.738473 ip-10-0-134-48 kubenswrapper[2558]: W0603 01:00:57.738437 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod697a8f27_5e86_416d_8c24_cefbb1aa7197.slice/crio-5db2ee53ed4e9854b84bcae831fdf194d3e34f0d6fc69c65c1e81e0830b8f449 WatchSource:0}: Error finding container 5db2ee53ed4e9854b84bcae831fdf194d3e34f0d6fc69c65c1e81e0830b8f449: Status 404 returned error can't find the container with id 5db2ee53ed4e9854b84bcae831fdf194d3e34f0d6fc69c65c1e81e0830b8f449 Jun 03 01:00:58.423654 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:00:58.423594 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm" event={"ID":"697a8f27-5e86-416d-8c24-cefbb1aa7197","Type":"ContainerStarted","Data":"5db2ee53ed4e9854b84bcae831fdf194d3e34f0d6fc69c65c1e81e0830b8f449"} Jun 03 01:01:02.439763 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:02.439721 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm" event={"ID":"697a8f27-5e86-416d-8c24-cefbb1aa7197","Type":"ContainerStarted","Data":"a2f31ea5f74b69f58993c943b6b5bec5ae0ddbc830737443d3bb0ed25b6497b4"} Jun 03 01:01:03.444122 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:03.444032 2558 generic.go:358] "Generic (PLEG): container finished" podID="697a8f27-5e86-416d-8c24-cefbb1aa7197" containerID="a2f31ea5f74b69f58993c943b6b5bec5ae0ddbc830737443d3bb0ed25b6497b4" exitCode=0 Jun 03 01:01:03.444547 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:03.444115 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm" event={"ID":"697a8f27-5e86-416d-8c24-cefbb1aa7197","Type":"ContainerDied","Data":"a2f31ea5f74b69f58993c943b6b5bec5ae0ddbc830737443d3bb0ed25b6497b4"} Jun 03 01:01:05.338421 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:05.338384 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6cl2q"] Jun 03 01:01:05.453612 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:05.453577 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm" event={"ID":"697a8f27-5e86-416d-8c24-cefbb1aa7197","Type":"ContainerStarted","Data":"f86f40bf414ef9fac6151e4e087778046335ee2e5018c3522cbc5dc987b372c4"} Jun 03 01:01:05.472099 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:05.472048 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm" podStartSLOduration=1.6765873980000001 podStartE2EDuration="8.472033605s" podCreationTimestamp="2026-06-03 01:00:57 +0000 UTC" firstStartedPulling="2026-06-03 01:00:57.740329335 +0000 UTC m=+728.438699806" lastFinishedPulling="2026-06-03 01:01:04.53577554 +0000 UTC m=+735.234146013" observedRunningTime="2026-06-03 01:01:05.470621193 +0000 UTC m=+736.168991685" watchObservedRunningTime="2026-06-03 01:01:05.472033605 +0000 UTC m=+736.170404130" Jun 03 01:01:07.603694 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:07.603656 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm" Jun 03 01:01:07.603694 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:07.603700 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm" Jun 03 01:01:07.616321 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:07.616296 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm" Jun 03 01:01:08.475718 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:08.475690 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm" Jun 03 01:01:16.342614 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:16.342576 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6cl2q"] Jun 03 01:01:28.145242 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:28.145203 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6cl2q"] Jun 03 01:01:36.646811 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:36.646771 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk"] Jun 03 01:01:36.650414 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:36.650392 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk" Jun 03 01:01:36.652972 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:36.652950 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 03 01:01:36.657492 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:36.657466 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk"] Jun 03 01:01:36.777253 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:36.777225 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7mtq\" (UniqueName: \"kubernetes.io/projected/b3a5e69b-1b0d-490e-a73b-c9856d7e84bd-kube-api-access-x7mtq\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk\" (UID: \"b3a5e69b-1b0d-490e-a73b-c9856d7e84bd\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk" Jun 03 01:01:36.777253 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:36.777258 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3a5e69b-1b0d-490e-a73b-c9856d7e84bd-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk\" (UID: \"b3a5e69b-1b0d-490e-a73b-c9856d7e84bd\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk" Jun 03 01:01:36.777453 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:36.777314 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3a5e69b-1b0d-490e-a73b-c9856d7e84bd-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk\" (UID: \"b3a5e69b-1b0d-490e-a73b-c9856d7e84bd\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk" Jun 03 01:01:36.777453 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:36.777350 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3a5e69b-1b0d-490e-a73b-c9856d7e84bd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk\" (UID: \"b3a5e69b-1b0d-490e-a73b-c9856d7e84bd\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk" Jun 03 01:01:36.777453 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:36.777386 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3a5e69b-1b0d-490e-a73b-c9856d7e84bd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk\" (UID: \"b3a5e69b-1b0d-490e-a73b-c9856d7e84bd\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk" Jun 03 01:01:36.777453 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:36.777446 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b3a5e69b-1b0d-490e-a73b-c9856d7e84bd-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk\" (UID: \"b3a5e69b-1b0d-490e-a73b-c9856d7e84bd\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk" Jun 03 01:01:36.877923 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:36.877887 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3a5e69b-1b0d-490e-a73b-c9856d7e84bd-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk\" (UID: \"b3a5e69b-1b0d-490e-a73b-c9856d7e84bd\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk" Jun 03 01:01:36.877923 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:36.877927 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3a5e69b-1b0d-490e-a73b-c9856d7e84bd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk\" (UID: \"b3a5e69b-1b0d-490e-a73b-c9856d7e84bd\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk" Jun 03 01:01:36.878155 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:36.878129 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3a5e69b-1b0d-490e-a73b-c9856d7e84bd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk\" (UID: \"b3a5e69b-1b0d-490e-a73b-c9856d7e84bd\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk" Jun 03 01:01:36.878332 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:36.878303 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b3a5e69b-1b0d-490e-a73b-c9856d7e84bd-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk\" (UID: \"b3a5e69b-1b0d-490e-a73b-c9856d7e84bd\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk" Jun 03 01:01:36.878553 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:36.878353 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3a5e69b-1b0d-490e-a73b-c9856d7e84bd-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk\" (UID: \"b3a5e69b-1b0d-490e-a73b-c9856d7e84bd\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk" Jun 03 01:01:36.878652 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:36.878424 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3a5e69b-1b0d-490e-a73b-c9856d7e84bd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk\" (UID: \"b3a5e69b-1b0d-490e-a73b-c9856d7e84bd\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk" Jun 03 01:01:36.878652 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:36.878577 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x7mtq\" (UniqueName: \"kubernetes.io/projected/b3a5e69b-1b0d-490e-a73b-c9856d7e84bd-kube-api-access-x7mtq\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk\" (UID: \"b3a5e69b-1b0d-490e-a73b-c9856d7e84bd\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk" Jun 03 01:01:36.878652 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:36.878594 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b3a5e69b-1b0d-490e-a73b-c9856d7e84bd-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk\" (UID: \"b3a5e69b-1b0d-490e-a73b-c9856d7e84bd\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk" Jun 03 01:01:36.878816 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:36.878664 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3a5e69b-1b0d-490e-a73b-c9856d7e84bd-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk\" (UID: \"b3a5e69b-1b0d-490e-a73b-c9856d7e84bd\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk" Jun 03 01:01:36.880718 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:36.880694 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3a5e69b-1b0d-490e-a73b-c9856d7e84bd-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk\" (UID: \"b3a5e69b-1b0d-490e-a73b-c9856d7e84bd\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk" Jun 03 01:01:36.880799 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:36.880764 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3a5e69b-1b0d-490e-a73b-c9856d7e84bd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk\" (UID: \"b3a5e69b-1b0d-490e-a73b-c9856d7e84bd\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk" Jun 03 01:01:36.886079 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:36.886057 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7mtq\" (UniqueName: \"kubernetes.io/projected/b3a5e69b-1b0d-490e-a73b-c9856d7e84bd-kube-api-access-x7mtq\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk\" (UID: \"b3a5e69b-1b0d-490e-a73b-c9856d7e84bd\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk" Jun 03 01:01:36.961630 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:36.961540 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk" Jun 03 01:01:37.089405 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:37.089376 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk"] Jun 03 01:01:37.093078 ip-10-0-134-48 kubenswrapper[2558]: W0603 01:01:37.093050 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3a5e69b_1b0d_490e_a73b_c9856d7e84bd.slice/crio-cd1c7451c1a8715e5ee6ef72e86f86c41e9d00b0f19141159745c3341a55bce4 WatchSource:0}: Error finding container cd1c7451c1a8715e5ee6ef72e86f86c41e9d00b0f19141159745c3341a55bce4: Status 404 returned error can't find the container with id cd1c7451c1a8715e5ee6ef72e86f86c41e9d00b0f19141159745c3341a55bce4 Jun 03 01:01:37.538386 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:37.538350 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6cl2q"] Jun 03 01:01:37.568014 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:37.567981 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk" event={"ID":"b3a5e69b-1b0d-490e-a73b-c9856d7e84bd","Type":"ContainerStarted","Data":"c13fc280ffbd92e02dcb4f5786394c32811dc2c151af7c10d979404a0a5e9ebb"} Jun 03 01:01:37.568014 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:37.568017 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk" event={"ID":"b3a5e69b-1b0d-490e-a73b-c9856d7e84bd","Type":"ContainerStarted","Data":"cd1c7451c1a8715e5ee6ef72e86f86c41e9d00b0f19141159745c3341a55bce4"} Jun 03 01:01:38.573069 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:38.573031 2558 generic.go:358] "Generic (PLEG): container finished" podID="b3a5e69b-1b0d-490e-a73b-c9856d7e84bd" containerID="c13fc280ffbd92e02dcb4f5786394c32811dc2c151af7c10d979404a0a5e9ebb" exitCode=0 Jun 03 01:01:38.573464 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:38.573110 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk" event={"ID":"b3a5e69b-1b0d-490e-a73b-c9856d7e84bd","Type":"ContainerDied","Data":"c13fc280ffbd92e02dcb4f5786394c32811dc2c151af7c10d979404a0a5e9ebb"} Jun 03 01:01:39.578721 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:39.578681 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk" event={"ID":"b3a5e69b-1b0d-490e-a73b-c9856d7e84bd","Type":"ContainerStarted","Data":"e83d4ffc5c602e737bd907331c443e4b1a9db7bf08bd509b2c3e13ffcea2e17a"} Jun 03 01:01:39.597256 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:39.597215 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk" podStartSLOduration=3.363738917 podStartE2EDuration="3.597201655s" podCreationTimestamp="2026-06-03 01:01:36 +0000 UTC" firstStartedPulling="2026-06-03 01:01:38.573632781 +0000 UTC m=+769.272003251" lastFinishedPulling="2026-06-03 01:01:38.807095513 +0000 UTC m=+769.505465989" observedRunningTime="2026-06-03 01:01:39.595918451 +0000 UTC m=+770.294288942" watchObservedRunningTime="2026-06-03 01:01:39.597201655 +0000 UTC m=+770.295572182" Jun 03 01:01:42.744711 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:42.744671 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6cl2q"] Jun 03 01:01:46.961787 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:46.961749 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk" Jun 03 01:01:46.961787 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:46.961793 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk" Jun 03 01:01:46.974283 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:46.974261 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk" Jun 03 01:01:47.617832 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:01:47.617801 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk" Jun 03 01:03:05.945942 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:03:05.945905 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6cl2q"] Jun 03 01:03:16.440480 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:03:16.440441 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6cl2q"] Jun 03 01:03:25.040381 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:03:25.040348 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6cl2q"] Jun 03 01:03:36.137351 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:03:36.137234 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6cl2q"] Jun 03 01:03:44.339742 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:03:44.339707 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6cl2q"] Jun 03 01:03:49.736462 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:03:49.736430 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-kmx8n_70d6f7a4-8438-4163-8f07-b108e3a30736/cluster-monitoring-operator/0.log" Jun 03 01:03:49.739027 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:03:49.739005 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-kmx8n_70d6f7a4-8438-4163-8f07-b108e3a30736/cluster-monitoring-operator/0.log" Jun 03 01:03:49.740923 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:03:49.740902 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-bqt4t_73408f89-f08e-4719-b940-5acc39134ab3/console-operator/1.log" Jun 03 01:03:49.743432 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:03:49.743414 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-bqt4t_73408f89-f08e-4719-b940-5acc39134ab3/console-operator/1.log" Jun 03 01:03:49.746093 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:03:49.746072 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8zww_c210edda-8849-4277-b258-5b40647200a9/ovn-acl-logging/0.log" Jun 03 01:03:49.748324 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:03:49.748308 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8zww_c210edda-8849-4277-b258-5b40647200a9/ovn-acl-logging/0.log" Jun 03 01:03:55.249180 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:03:55.249143 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6cl2q"] Jun 03 01:04:25.838270 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:04:25.838227 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6cl2q"] Jun 03 01:04:30.341632 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:04:30.341592 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6cl2q"] Jun 03 01:05:06.042958 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:05:06.042870 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6cl2q"] Jun 03 01:05:22.036367 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:05:22.036328 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6cl2q"] Jun 03 01:06:00.441569 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:06:00.441530 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6cl2q"] Jun 03 01:06:17.448724 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:06:17.448684 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6cl2q"] Jun 03 01:06:31.656037 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:06:31.655942 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6cl2q"] Jun 03 01:06:47.537739 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:06:47.537696 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6cl2q"] Jun 03 01:06:50.843750 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:06:50.843709 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6cl2q"] Jun 03 01:07:06.345069 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:06.345042 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29674140-g7z6c_687adba7-ca1a-4844-9713-fe9d0a50c997/cleanup/0.log" Jun 03 01:07:06.899248 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:06.899217 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c859dd94f-9jhst_ec93bfc5-f888-433e-a038-520a03617a6f/copy-manifests/0.log" Jun 03 01:07:06.911027 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:06.910999 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c859dd94f-9jhst_ec93bfc5-f888-433e-a038-520a03617a6f/manager/0.log" Jun 03 01:07:08.489320 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:08.489285 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-c96d6_95a550a0-d056-4246-bb09-ee3da9b3c321/manager/0.log" Jun 03 01:07:09.052939 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:09.052905 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-6cl2q_be56a61b-ac53-4670-b405-4ca06c734bc8/limitador/0.log" Jun 03 01:07:09.848368 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:09.848335 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-df58ddb79-tsxrt_08319995-c846-4ef5-a801-b402fb3a8d98/kube-auth-proxy/0.log" Jun 03 01:07:10.195966 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:10.195887 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7df748b4d9-d5wxd_98e106c8-50c9-405e-b182-93fa1fe82bb0/router/0.log" Jun 03 01:07:10.524836 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:10.524759 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm_697a8f27-5e86-416d-8c24-cefbb1aa7197/storage-initializer/0.log" Jun 03 01:07:10.531082 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:10.531057 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-q6sdm_697a8f27-5e86-416d-8c24-cefbb1aa7197/main/0.log" Jun 03 01:07:11.015567 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:11.015533 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk_b3a5e69b-1b0d-490e-a73b-c9856d7e84bd/storage-initializer/0.log" Jun 03 01:07:11.022733 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:11.022712 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-fpfvk_b3a5e69b-1b0d-490e-a73b-c9856d7e84bd/main/0.log" Jun 03 01:07:15.006274 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:15.006242 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wc94h/must-gather-f7w9x"] Jun 03 01:07:15.009670 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:15.009646 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wc94h/must-gather-f7w9x" Jun 03 01:07:15.012352 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:15.012328 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wc94h\"/\"kube-root-ca.crt\"" Jun 03 01:07:15.013323 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:15.013301 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wc94h\"/\"openshift-service-ca.crt\"" Jun 03 01:07:15.013431 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:15.013305 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wc94h\"/\"default-dockercfg-xxpt9\"" Jun 03 01:07:15.024965 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:15.024943 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wc94h/must-gather-f7w9x"] Jun 03 01:07:15.064951 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:15.064922 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rzbm\" (UniqueName: \"kubernetes.io/projected/9799bf59-cc4b-46d9-b3ea-9f88c11127f5-kube-api-access-2rzbm\") pod \"must-gather-f7w9x\" (UID: \"9799bf59-cc4b-46d9-b3ea-9f88c11127f5\") " pod="openshift-must-gather-wc94h/must-gather-f7w9x" Jun 03 01:07:15.065113 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:15.064981 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9799bf59-cc4b-46d9-b3ea-9f88c11127f5-must-gather-output\") pod \"must-gather-f7w9x\" (UID: \"9799bf59-cc4b-46d9-b3ea-9f88c11127f5\") " pod="openshift-must-gather-wc94h/must-gather-f7w9x" Jun 03 01:07:15.166330 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:15.166293 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2rzbm\" (UniqueName: \"kubernetes.io/projected/9799bf59-cc4b-46d9-b3ea-9f88c11127f5-kube-api-access-2rzbm\") pod \"must-gather-f7w9x\" (UID: \"9799bf59-cc4b-46d9-b3ea-9f88c11127f5\") " pod="openshift-must-gather-wc94h/must-gather-f7w9x" Jun 03 01:07:15.166545 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:15.166380 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9799bf59-cc4b-46d9-b3ea-9f88c11127f5-must-gather-output\") pod \"must-gather-f7w9x\" (UID: \"9799bf59-cc4b-46d9-b3ea-9f88c11127f5\") " pod="openshift-must-gather-wc94h/must-gather-f7w9x" Jun 03 01:07:15.166759 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:15.166741 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9799bf59-cc4b-46d9-b3ea-9f88c11127f5-must-gather-output\") pod \"must-gather-f7w9x\" (UID: \"9799bf59-cc4b-46d9-b3ea-9f88c11127f5\") " pod="openshift-must-gather-wc94h/must-gather-f7w9x" Jun 03 01:07:15.174266 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:15.174245 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rzbm\" (UniqueName: \"kubernetes.io/projected/9799bf59-cc4b-46d9-b3ea-9f88c11127f5-kube-api-access-2rzbm\") pod \"must-gather-f7w9x\" (UID: \"9799bf59-cc4b-46d9-b3ea-9f88c11127f5\") " pod="openshift-must-gather-wc94h/must-gather-f7w9x" Jun 03 01:07:15.335425 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:15.335394 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wc94h/must-gather-f7w9x" Jun 03 01:07:15.465805 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:15.465777 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wc94h/must-gather-f7w9x"] Jun 03 01:07:15.468956 ip-10-0-134-48 kubenswrapper[2558]: W0603 01:07:15.468923 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9799bf59_cc4b_46d9_b3ea_9f88c11127f5.slice/crio-c2d1e9adb4c7ee1c2b7cac66d3bc70eec9a5897014aa35049fc00335674e1162 WatchSource:0}: Error finding container c2d1e9adb4c7ee1c2b7cac66d3bc70eec9a5897014aa35049fc00335674e1162: Status 404 returned error can't find the container with id c2d1e9adb4c7ee1c2b7cac66d3bc70eec9a5897014aa35049fc00335674e1162 Jun 03 01:07:15.470554 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:15.470535 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 01:07:15.784838 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:15.784757 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wc94h/must-gather-f7w9x" event={"ID":"9799bf59-cc4b-46d9-b3ea-9f88c11127f5","Type":"ContainerStarted","Data":"c2d1e9adb4c7ee1c2b7cac66d3bc70eec9a5897014aa35049fc00335674e1162"} Jun 03 01:07:16.791350 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:16.791295 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wc94h/must-gather-f7w9x" event={"ID":"9799bf59-cc4b-46d9-b3ea-9f88c11127f5","Type":"ContainerStarted","Data":"9a6004ce5d6ff7737667839a8d17d21eb5617b75200d5375c61a5583a3589aff"} Jun 03 01:07:16.791863 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:16.791361 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wc94h/must-gather-f7w9x" event={"ID":"9799bf59-cc4b-46d9-b3ea-9f88c11127f5","Type":"ContainerStarted","Data":"b3a0e1db06cef5aa18d9e4b78ee6291354e434314b95578f402c94c16047c85e"} Jun 03 01:07:16.812963 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:16.812916 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-wc94h/must-gather-f7w9x" podStartSLOduration=2.134416362 podStartE2EDuration="2.812900993s" podCreationTimestamp="2026-06-03 01:07:14 +0000 UTC" firstStartedPulling="2026-06-03 01:07:15.470665181 +0000 UTC m=+1106.169035651" lastFinishedPulling="2026-06-03 01:07:16.149149812 +0000 UTC m=+1106.847520282" observedRunningTime="2026-06-03 01:07:16.810187831 +0000 UTC m=+1107.508558323" watchObservedRunningTime="2026-06-03 01:07:16.812900993 +0000 UTC m=+1107.511271484" Jun 03 01:07:18.033624 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:18.033590 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-f2dq6_da35388a-fef5-4cb2-865b-40d260126f3b/global-pull-secret-syncer/0.log" Jun 03 01:07:18.160307 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:18.160258 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ncjrr_b90ee857-e6a3-4a9d-b66c-9dea49751494/konnectivity-agent/0.log" Jun 03 01:07:18.213999 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:18.213964 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-48.ec2.internal_17fe47cc7cb9b1d18b8c5bc4ddf5b79c/haproxy/0.log" Jun 03 01:07:22.502924 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:22.502876 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-c96d6_95a550a0-d056-4246-bb09-ee3da9b3c321/manager/0.log" Jun 03 01:07:22.645317 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:22.645182 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-6cl2q_be56a61b-ac53-4670-b405-4ca06c734bc8/limitador/0.log" Jun 03 01:07:24.285914 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:24.285883 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f7983430-c43c-4bfd-b9d8-e417595cfd5f/alertmanager/0.log" Jun 03 01:07:24.308511 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:24.308409 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f7983430-c43c-4bfd-b9d8-e417595cfd5f/config-reloader/0.log" Jun 03 01:07:24.332630 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:24.332548 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f7983430-c43c-4bfd-b9d8-e417595cfd5f/kube-rbac-proxy-web/0.log" Jun 03 01:07:24.356640 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:24.356606 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f7983430-c43c-4bfd-b9d8-e417595cfd5f/kube-rbac-proxy/0.log" Jun 03 01:07:24.378166 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:24.378040 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f7983430-c43c-4bfd-b9d8-e417595cfd5f/kube-rbac-proxy-metric/0.log" Jun 03 01:07:24.398572 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:24.398540 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f7983430-c43c-4bfd-b9d8-e417595cfd5f/prom-label-proxy/0.log" Jun 03 01:07:24.418402 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:24.418377 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f7983430-c43c-4bfd-b9d8-e417595cfd5f/init-config-reloader/0.log" Jun 03 01:07:24.453211 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:24.453177 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-kmx8n_70d6f7a4-8438-4163-8f07-b108e3a30736/cluster-monitoring-operator/1.log" Jun 03 01:07:24.551953 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:24.551895 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-kmx8n_70d6f7a4-8438-4163-8f07-b108e3a30736/cluster-monitoring-operator/0.log" Jun 03 01:07:24.580417 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:24.580334 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-szpvm_6226e2a1-2c12-4787-9f93-a90248395773/kube-state-metrics/0.log" Jun 03 01:07:24.601986 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:24.601952 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-szpvm_6226e2a1-2c12-4787-9f93-a90248395773/kube-rbac-proxy-main/0.log" Jun 03 01:07:24.623655 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:24.623619 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-szpvm_6226e2a1-2c12-4787-9f93-a90248395773/kube-rbac-proxy-self/0.log" Jun 03 01:07:24.682652 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:24.682620 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-ddk6g_52c3e4e9-5715-4c35-9e2f-d049e962e81a/monitoring-plugin/0.log" Jun 03 01:07:24.891510 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:24.891430 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wz9wp_6b42cdfd-0b61-4313-8eb0-8c10ccca5eca/node-exporter/0.log" Jun 03 01:07:24.962791 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:24.962759 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wz9wp_6b42cdfd-0b61-4313-8eb0-8c10ccca5eca/kube-rbac-proxy/0.log" Jun 03 01:07:24.986624 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:24.986601 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wz9wp_6b42cdfd-0b61-4313-8eb0-8c10ccca5eca/init-textfile/0.log" Jun 03 01:07:25.091281 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:25.091247 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26496b35-81df-44e9-95be-da8586a86ad3/prometheus/0.log" Jun 03 01:07:25.111029 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:25.111006 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26496b35-81df-44e9-95be-da8586a86ad3/config-reloader/0.log" Jun 03 01:07:25.131462 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:25.131429 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26496b35-81df-44e9-95be-da8586a86ad3/thanos-sidecar/0.log" Jun 03 01:07:25.153668 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:25.153591 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26496b35-81df-44e9-95be-da8586a86ad3/kube-rbac-proxy-web/0.log" Jun 03 01:07:25.175674 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:25.175647 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26496b35-81df-44e9-95be-da8586a86ad3/kube-rbac-proxy/0.log" Jun 03 01:07:25.196002 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:25.195968 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26496b35-81df-44e9-95be-da8586a86ad3/kube-rbac-proxy-thanos/0.log" Jun 03 01:07:25.219889 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:25.219862 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26496b35-81df-44e9-95be-da8586a86ad3/init-config-reloader/0.log" Jun 03 01:07:25.322136 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:25.322107 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b7765564d-npmxf_332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3/telemeter-client/0.log" Jun 03 01:07:25.342533 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:25.342490 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b7765564d-npmxf_332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3/reload/0.log" Jun 03 01:07:25.365478 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:25.365442 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b7765564d-npmxf_332f3895-8cbb-4ca5-9fbc-a0b04d7a72f3/kube-rbac-proxy/0.log" Jun 03 01:07:26.590902 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:26.590869 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-vpcqx_ec8846c3-927f-4591-ab53-8ade3a5ae809/networking-console-plugin/0.log" Jun 03 01:07:26.981404 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:26.981319 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wc94h/perf-node-gather-daemonset-27d7t"] Jun 03 01:07:26.986277 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:26.986247 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-27d7t" Jun 03 01:07:26.992825 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:26.992792 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wc94h/perf-node-gather-daemonset-27d7t"] Jun 03 01:07:27.095413 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:27.095374 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f808575-a36a-4986-ba80-7f11b9481042-sys\") pod \"perf-node-gather-daemonset-27d7t\" (UID: \"8f808575-a36a-4986-ba80-7f11b9481042\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-27d7t" Jun 03 01:07:27.095630 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:27.095460 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8f808575-a36a-4986-ba80-7f11b9481042-podres\") pod \"perf-node-gather-daemonset-27d7t\" (UID: \"8f808575-a36a-4986-ba80-7f11b9481042\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-27d7t" Jun 03 01:07:27.095630 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:27.095494 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f808575-a36a-4986-ba80-7f11b9481042-lib-modules\") pod \"perf-node-gather-daemonset-27d7t\" (UID: \"8f808575-a36a-4986-ba80-7f11b9481042\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-27d7t" Jun 03 01:07:27.095630 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:27.095595 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64zg5\" (UniqueName: \"kubernetes.io/projected/8f808575-a36a-4986-ba80-7f11b9481042-kube-api-access-64zg5\") pod \"perf-node-gather-daemonset-27d7t\" (UID: \"8f808575-a36a-4986-ba80-7f11b9481042\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-27d7t" Jun 03 01:07:27.095813 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:27.095663 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8f808575-a36a-4986-ba80-7f11b9481042-proc\") pod \"perf-node-gather-daemonset-27d7t\" (UID: \"8f808575-a36a-4986-ba80-7f11b9481042\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-27d7t" Jun 03 01:07:27.135001 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:27.134966 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-bqt4t_73408f89-f08e-4719-b940-5acc39134ab3/console-operator/1.log" Jun 03 01:07:27.141350 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:27.141322 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-bqt4t_73408f89-f08e-4719-b940-5acc39134ab3/console-operator/2.log" Jun 03 01:07:27.197183 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:27.197146 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f808575-a36a-4986-ba80-7f11b9481042-sys\") pod \"perf-node-gather-daemonset-27d7t\" (UID: \"8f808575-a36a-4986-ba80-7f11b9481042\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-27d7t" Jun 03 01:07:27.197380 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:27.197223 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8f808575-a36a-4986-ba80-7f11b9481042-podres\") pod \"perf-node-gather-daemonset-27d7t\" (UID: \"8f808575-a36a-4986-ba80-7f11b9481042\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-27d7t" Jun 03 01:07:27.197380 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:27.197256 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f808575-a36a-4986-ba80-7f11b9481042-lib-modules\") pod \"perf-node-gather-daemonset-27d7t\" (UID: \"8f808575-a36a-4986-ba80-7f11b9481042\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-27d7t" Jun 03 01:07:27.197380 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:27.197259 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f808575-a36a-4986-ba80-7f11b9481042-sys\") pod \"perf-node-gather-daemonset-27d7t\" (UID: \"8f808575-a36a-4986-ba80-7f11b9481042\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-27d7t" Jun 03 01:07:27.197380 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:27.197339 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-64zg5\" (UniqueName: \"kubernetes.io/projected/8f808575-a36a-4986-ba80-7f11b9481042-kube-api-access-64zg5\") pod \"perf-node-gather-daemonset-27d7t\" (UID: \"8f808575-a36a-4986-ba80-7f11b9481042\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-27d7t" Jun 03 01:07:27.197640 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:27.197383 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8f808575-a36a-4986-ba80-7f11b9481042-proc\") pod \"perf-node-gather-daemonset-27d7t\" (UID: \"8f808575-a36a-4986-ba80-7f11b9481042\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-27d7t" Jun 03 01:07:27.197640 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:27.197398 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f808575-a36a-4986-ba80-7f11b9481042-lib-modules\") pod \"perf-node-gather-daemonset-27d7t\" (UID: \"8f808575-a36a-4986-ba80-7f11b9481042\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-27d7t" Jun 03 01:07:27.197640 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:27.197403 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8f808575-a36a-4986-ba80-7f11b9481042-podres\") pod \"perf-node-gather-daemonset-27d7t\" (UID: \"8f808575-a36a-4986-ba80-7f11b9481042\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-27d7t" Jun 03 01:07:27.197640 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:27.197465 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8f808575-a36a-4986-ba80-7f11b9481042-proc\") pod \"perf-node-gather-daemonset-27d7t\" (UID: \"8f808575-a36a-4986-ba80-7f11b9481042\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-27d7t" Jun 03 01:07:27.206578 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:27.206499 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64zg5\" (UniqueName: \"kubernetes.io/projected/8f808575-a36a-4986-ba80-7f11b9481042-kube-api-access-64zg5\") pod \"perf-node-gather-daemonset-27d7t\" (UID: \"8f808575-a36a-4986-ba80-7f11b9481042\") " pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-27d7t" Jun 03 01:07:27.305648 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:27.300999 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-27d7t" Jun 03 01:07:27.469361 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:27.469335 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wc94h/perf-node-gather-daemonset-27d7t"] Jun 03 01:07:27.471456 ip-10-0-134-48 kubenswrapper[2558]: W0603 01:07:27.471422 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8f808575_a36a_4986_ba80_7f11b9481042.slice/crio-3d9a5bf082c8642920a5bd041f76d7bf5057099d9c18e68d18756cb618d77ff3 WatchSource:0}: Error finding container 3d9a5bf082c8642920a5bd041f76d7bf5057099d9c18e68d18756cb618d77ff3: Status 404 returned error can't find the container with id 3d9a5bf082c8642920a5bd041f76d7bf5057099d9c18e68d18756cb618d77ff3 Jun 03 01:07:27.652108 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:27.652079 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-5gm52_8a550a04-4cbd-4ae6-b8d0-0c3151f86a73/download-server/0.log" Jun 03 01:07:27.849825 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:27.849733 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-27d7t" event={"ID":"8f808575-a36a-4986-ba80-7f11b9481042","Type":"ContainerStarted","Data":"97da3392573c2228c0f6e1a568e640e436b85ebbb8362cde67399758f44a2133"} Jun 03 01:07:27.849825 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:27.849771 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-27d7t" event={"ID":"8f808575-a36a-4986-ba80-7f11b9481042","Type":"ContainerStarted","Data":"3d9a5bf082c8642920a5bd041f76d7bf5057099d9c18e68d18756cb618d77ff3"} Jun 03 01:07:27.850010 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:27.849865 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-27d7t" Jun 03 01:07:27.866971 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:27.866907 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-27d7t" podStartSLOduration=1.866888697 podStartE2EDuration="1.866888697s" podCreationTimestamp="2026-06-03 01:07:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:07:27.865092984 +0000 UTC m=+1118.563463476" watchObservedRunningTime="2026-06-03 01:07:27.866888697 +0000 UTC m=+1118.565259190" Jun 03 01:07:28.148242 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:28.148154 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-6vjwc_6f02bc4d-0a22-4e33-938d-be35bdf34fd0/volume-data-source-validator/0.log" Jun 03 01:07:28.911139 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:28.911108 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xhlnm_c1b3f280-8191-43b7-8885-0e3c3943141f/dns/0.log" Jun 03 01:07:28.931001 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:28.930974 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xhlnm_c1b3f280-8191-43b7-8885-0e3c3943141f/kube-rbac-proxy/0.log" Jun 03 01:07:28.996871 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:28.996846 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2z5f7_d96991ed-c416-44f8-a04e-6f13f5d02ab8/dns-node-resolver/0.log" Jun 03 01:07:29.547486 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:29.547437 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b6chf_68e85fe7-9edc-4ae9-9869-ac61b5746afd/node-ca/0.log" Jun 03 01:07:30.467432 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:30.467405 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-df58ddb79-tsxrt_08319995-c846-4ef5-a801-b402fb3a8d98/kube-auth-proxy/0.log" Jun 03 01:07:30.555848 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:30.555813 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7df748b4d9-d5wxd_98e106c8-50c9-405e-b182-93fa1fe82bb0/router/0.log" Jun 03 01:07:31.040344 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:31.040315 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mvb7z_efc528c1-9886-493b-baae-3a407e726a91/serve-healthcheck-canary/0.log" Jun 03 01:07:31.500995 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:31.500962 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-9thxf_4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641/insights-operator/1.log" Jun 03 01:07:31.501598 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:31.501580 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-9thxf_4ef8dff0-c2f4-43e6-8ae2-ebe0c7357641/insights-operator/0.log" Jun 03 01:07:31.654131 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:31.654105 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-txrgw_18b7f7cc-985e-4434-b5fe-fe236d95cb37/kube-rbac-proxy/0.log" Jun 03 01:07:31.675658 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:31.675630 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-txrgw_18b7f7cc-985e-4434-b5fe-fe236d95cb37/exporter/0.log" Jun 03 01:07:31.695533 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:31.695488 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-txrgw_18b7f7cc-985e-4434-b5fe-fe236d95cb37/extractor/0.log" Jun 03 01:07:33.737890 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:33.737864 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29674140-g7z6c_687adba7-ca1a-4844-9713-fe9d0a50c997/cleanup/0.log" Jun 03 01:07:33.866263 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:33.866233 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wc94h/perf-node-gather-daemonset-27d7t" Jun 03 01:07:33.948442 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:33.948405 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c859dd94f-9jhst_ec93bfc5-f888-433e-a038-520a03617a6f/manager/0.log" Jun 03 01:07:33.963193 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:33.963164 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c859dd94f-9jhst_ec93bfc5-f888-433e-a038-520a03617a6f/copy-manifests/0.log" Jun 03 01:07:35.368313 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:35.368281 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8474b9f56-rn7s7_88b22c67-f52b-4e3b-b6a3-72ca9cf7539e/manager/0.log" Jun 03 01:07:40.349971 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:40.349937 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-8srzc_0ebe13d2-fdee-4751-9034-879309f00a91/kube-storage-version-migrator-operator/1.log" Jun 03 01:07:40.350814 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:40.350791 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-8srzc_0ebe13d2-fdee-4751-9034-879309f00a91/kube-storage-version-migrator-operator/0.log" Jun 03 01:07:41.746775 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:41.746721 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqkw8_4aced56a-7b13-4d13-a18f-b189410b8b07/kube-multus-additional-cni-plugins/0.log" Jun 03 01:07:41.772592 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:41.772566 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqkw8_4aced56a-7b13-4d13-a18f-b189410b8b07/egress-router-binary-copy/0.log" Jun 03 01:07:41.791334 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:41.791295 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqkw8_4aced56a-7b13-4d13-a18f-b189410b8b07/cni-plugins/0.log" Jun 03 01:07:41.811153 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:41.811130 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqkw8_4aced56a-7b13-4d13-a18f-b189410b8b07/bond-cni-plugin/0.log" Jun 03 01:07:41.830305 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:41.830273 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqkw8_4aced56a-7b13-4d13-a18f-b189410b8b07/routeoverride-cni/0.log" Jun 03 01:07:41.850293 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:41.850267 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqkw8_4aced56a-7b13-4d13-a18f-b189410b8b07/whereabouts-cni-bincopy/0.log" Jun 03 01:07:41.876314 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:41.876292 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqkw8_4aced56a-7b13-4d13-a18f-b189410b8b07/whereabouts-cni/0.log" Jun 03 01:07:41.909206 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:41.909175 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hr85v_8b247bdf-26a2-4af4-bee6-ddd65313843e/kube-multus/0.log" Jun 03 01:07:42.014621 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:42.014547 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-x67bk_905babfb-1634-4e78-a4b5-177ab08e7a3d/network-metrics-daemon/0.log" Jun 03 01:07:42.031884 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:42.031843 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-x67bk_905babfb-1634-4e78-a4b5-177ab08e7a3d/kube-rbac-proxy/0.log" Jun 03 01:07:43.326411 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:43.326343 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8zww_c210edda-8849-4277-b258-5b40647200a9/ovn-controller/0.log" Jun 03 01:07:43.343661 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:43.343636 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8zww_c210edda-8849-4277-b258-5b40647200a9/ovn-acl-logging/0.log" Jun 03 01:07:43.350844 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:43.350811 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8zww_c210edda-8849-4277-b258-5b40647200a9/ovn-acl-logging/1.log" Jun 03 01:07:43.370471 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:43.370431 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8zww_c210edda-8849-4277-b258-5b40647200a9/kube-rbac-proxy-node/0.log" Jun 03 01:07:43.392022 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:43.391988 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8zww_c210edda-8849-4277-b258-5b40647200a9/kube-rbac-proxy-ovn-metrics/0.log" Jun 03 01:07:43.412420 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:43.412383 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8zww_c210edda-8849-4277-b258-5b40647200a9/northd/0.log" Jun 03 01:07:43.434411 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:43.434383 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8zww_c210edda-8849-4277-b258-5b40647200a9/nbdb/0.log" Jun 03 01:07:43.457215 ip-10-0-134-48 kubenswrapper[2558]: I0603 01:07:43.457126 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8zww_c210edda-8849-4277-b258-5b40647200a9/sbdb/0.log"