Jul 02 00:15:43.230001 ip-10-0-130-30 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 02 00:15:43.230010 ip-10-0-130-30 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 02 00:15:43.230017 ip-10-0-130-30 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 02 00:15:43.230227 ip-10-0-130-30 systemd[1]: Failed to start Kubernetes Kubelet. Jul 02 00:15:52.610379 ip-10-0-130-30 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 02 00:15:52.610392 ip-10-0-130-30 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 4c82f26031ea43f591fd58606521fb3f -- Jul 02 00:17:26.462703 ip-10-0-130-30 systemd[1]: Starting Kubernetes Kubelet... Jul 02 00:17:26.910832 ip-10-0-130-30 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 00:17:26.910832 ip-10-0-130-30 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 00:17:26.910832 ip-10-0-130-30 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 00:17:26.910832 ip-10-0-130-30 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 00:17:26.910832 ip-10-0-130-30 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 00:17:26.913323 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.913181 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 00:17:26.919650 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919629 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 00:17:26.919650 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919646 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 00:17:26.919650 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919650 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 00:17:26.919650 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919654 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 00:17:26.919650 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919657 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 00:17:26.919839 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919661 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 00:17:26.919839 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919665 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 00:17:26.919839 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919668 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 00:17:26.919839 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919670 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 00:17:26.919839 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919673 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 00:17:26.919839 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919676 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 00:17:26.919839 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919679 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 00:17:26.919839 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919682 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 00:17:26.919839 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919685 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 00:17:26.919839 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919688 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 00:17:26.919839 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919691 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 00:17:26.919839 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919694 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 00:17:26.919839 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919696 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 00:17:26.919839 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919699 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 00:17:26.919839 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919702 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 00:17:26.919839 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919704 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 00:17:26.919839 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919707 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 00:17:26.919839 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919710 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 00:17:26.919839 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919713 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 00:17:26.919839 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919715 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 00:17:26.920343 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919726 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 00:17:26.920343 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919729 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 00:17:26.920343 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919732 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 00:17:26.920343 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919735 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 00:17:26.920343 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919737 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 00:17:26.920343 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919740 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 00:17:26.920343 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919743 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 00:17:26.920343 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919745 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 00:17:26.920343 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919750 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 00:17:26.920343 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919752 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 00:17:26.920343 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919755 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 00:17:26.920343 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919758 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 00:17:26.920343 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919760 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 00:17:26.920343 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919763 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 00:17:26.920343 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919767 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 00:17:26.920343 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919769 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 00:17:26.920343 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919772 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 00:17:26.920343 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919775 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 00:17:26.920343 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919778 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 00:17:26.920343 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919781 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 00:17:26.920867 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919784 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 00:17:26.920867 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919787 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 00:17:26.920867 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919790 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 00:17:26.920867 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919793 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 00:17:26.920867 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919795 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 00:17:26.920867 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919798 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 00:17:26.920867 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919801 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 00:17:26.920867 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919806 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 00:17:26.920867 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919810 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 00:17:26.920867 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919813 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 00:17:26.920867 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919816 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 00:17:26.920867 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919819 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 00:17:26.920867 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919822 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 00:17:26.920867 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919825 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 00:17:26.920867 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919828 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 00:17:26.920867 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919831 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 00:17:26.920867 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919834 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 00:17:26.920867 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919837 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 00:17:26.920867 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919840 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 00:17:26.921350 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919843 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 00:17:26.921350 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919846 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 00:17:26.921350 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919849 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 00:17:26.921350 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919854 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 00:17:26.921350 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919858 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 00:17:26.921350 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919861 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 00:17:26.921350 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919864 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 00:17:26.921350 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919867 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 00:17:26.921350 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919870 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 00:17:26.921350 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919873 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 00:17:26.921350 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919876 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 00:17:26.921350 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919879 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 00:17:26.921350 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919881 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 00:17:26.921350 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919884 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 00:17:26.921350 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919889 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 00:17:26.921350 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919891 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 00:17:26.921350 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919894 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 00:17:26.921350 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919897 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 00:17:26.921350 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919900 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 00:17:26.921853 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919903 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 00:17:26.921853 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919906 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 00:17:26.921853 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919909 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 00:17:26.921853 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919912 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 00:17:26.921853 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919915 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 00:17:26.921853 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919918 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 00:17:26.921853 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919921 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 00:17:26.921853 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919923 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 00:17:26.921853 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919926 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 00:17:26.921853 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919930 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 00:17:26.921853 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919934 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 00:17:26.921853 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919936 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 00:17:26.921853 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919939 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 00:17:26.921853 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919942 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 00:17:26.921853 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919945 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 02 00:17:26.921853 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.919948 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 00:17:26.921853 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921559 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 00:17:26.921853 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921569 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 00:17:26.921853 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921572 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 00:17:26.921853 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921576 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 00:17:26.922364 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921579 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 00:17:26.922364 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921583 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 00:17:26.922364 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921586 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 00:17:26.922364 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921588 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 00:17:26.922364 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921591 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 00:17:26.922364 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921594 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 00:17:26.922364 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921598 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 00:17:26.922364 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921600 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 00:17:26.922364 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921603 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 00:17:26.922364 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921606 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 00:17:26.922364 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921609 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 00:17:26.922364 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921612 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 00:17:26.922364 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921615 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 00:17:26.922364 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921619 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 00:17:26.922364 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921622 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 00:17:26.922364 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921625 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 00:17:26.922364 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921628 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 00:17:26.922364 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921631 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 00:17:26.922364 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921634 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 00:17:26.922364 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921636 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 00:17:26.922892 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921639 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 00:17:26.922892 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921642 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 00:17:26.922892 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921645 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 00:17:26.922892 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921648 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 00:17:26.922892 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921650 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 00:17:26.922892 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921653 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 00:17:26.922892 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921656 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 00:17:26.922892 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921658 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 00:17:26.922892 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921661 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 00:17:26.922892 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921664 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 00:17:26.922892 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921668 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 00:17:26.922892 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921672 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 00:17:26.922892 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921675 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 02 00:17:26.922892 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921678 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 00:17:26.922892 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921681 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 00:17:26.922892 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921684 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 00:17:26.922892 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921687 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 00:17:26.922892 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921689 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 00:17:26.922892 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921693 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 00:17:26.923381 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921695 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 00:17:26.923381 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921698 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 00:17:26.923381 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921701 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 00:17:26.923381 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921704 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 00:17:26.923381 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921707 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 00:17:26.923381 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921710 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 00:17:26.923381 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921714 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 00:17:26.923381 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921717 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 00:17:26.923381 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921720 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 00:17:26.923381 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921722 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 00:17:26.923381 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921725 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 00:17:26.923381 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921728 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 00:17:26.923381 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921731 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 00:17:26.923381 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921733 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 00:17:26.923381 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921736 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 00:17:26.923381 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921738 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 00:17:26.923381 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921741 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 00:17:26.923381 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921744 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 00:17:26.923381 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921746 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 00:17:26.923886 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921749 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 00:17:26.923886 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921752 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 00:17:26.923886 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921754 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 00:17:26.923886 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921757 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 00:17:26.923886 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921760 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 00:17:26.923886 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921762 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 00:17:26.923886 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921765 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 00:17:26.923886 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921769 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 00:17:26.923886 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921772 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 00:17:26.923886 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921774 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 00:17:26.923886 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921777 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 00:17:26.923886 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921780 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 00:17:26.923886 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921782 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 00:17:26.923886 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921785 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 00:17:26.923886 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921787 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 00:17:26.923886 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921790 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 00:17:26.923886 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921793 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 00:17:26.923886 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921796 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 00:17:26.923886 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921799 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 00:17:26.923886 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921802 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 00:17:26.924394 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921805 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 00:17:26.924394 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921809 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 00:17:26.924394 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921811 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 00:17:26.924394 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921814 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 00:17:26.924394 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921819 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 00:17:26.924394 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921822 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 00:17:26.924394 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921825 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 00:17:26.924394 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921828 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 00:17:26.924394 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921831 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 00:17:26.924394 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921834 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 00:17:26.924394 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921837 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 00:17:26.924394 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921840 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 00:17:26.924394 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921842 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 00:17:26.924394 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921845 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 00:17:26.924394 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921848 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 00:17:26.924394 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921850 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 00:17:26.924394 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.921853 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 00:17:26.924394 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922228 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 00:17:26.924394 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922233 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 00:17:26.924912 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922236 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 00:17:26.924912 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922239 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 00:17:26.924912 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922241 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 00:17:26.924912 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922245 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 00:17:26.924912 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922248 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 00:17:26.924912 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922251 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 00:17:26.924912 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922254 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 00:17:26.924912 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922257 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 00:17:26.924912 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922260 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 00:17:26.924912 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922262 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 00:17:26.924912 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922266 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 00:17:26.924912 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922269 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 00:17:26.924912 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922272 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 00:17:26.924912 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922275 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 00:17:26.924912 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922279 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 00:17:26.924912 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922282 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 00:17:26.924912 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922285 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 00:17:26.924912 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922288 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 00:17:26.924912 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922291 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 00:17:26.924912 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922294 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 00:17:26.925427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922297 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 00:17:26.925427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922299 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 00:17:26.925427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922302 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 00:17:26.925427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922305 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 00:17:26.925427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922310 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 00:17:26.925427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922314 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 02 00:17:26.925427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922317 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 00:17:26.925427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922320 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 00:17:26.925427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922323 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 00:17:26.925427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922326 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 00:17:26.925427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922329 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 00:17:26.925427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922331 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 00:17:26.925427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922334 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 00:17:26.925427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922337 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 00:17:26.925427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922340 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 00:17:26.925427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922344 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 00:17:26.925427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922348 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 00:17:26.925427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922351 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 00:17:26.925427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922354 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 00:17:26.925968 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922357 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 00:17:26.925968 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922360 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 00:17:26.925968 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922363 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 00:17:26.925968 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922366 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 00:17:26.925968 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922369 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 00:17:26.925968 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922372 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 00:17:26.925968 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922375 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 00:17:26.925968 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922378 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 00:17:26.925968 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922382 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 00:17:26.925968 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922384 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 00:17:26.925968 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922387 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 00:17:26.925968 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922390 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 00:17:26.925968 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922393 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 00:17:26.925968 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922395 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 00:17:26.925968 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922398 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 00:17:26.925968 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922401 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 00:17:26.925968 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922403 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 00:17:26.925968 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922406 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 00:17:26.925968 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922409 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 00:17:26.925968 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922411 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 00:17:26.926468 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922414 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 00:17:26.926468 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922416 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 00:17:26.926468 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922419 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 00:17:26.926468 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922422 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 00:17:26.926468 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922424 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 00:17:26.926468 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922448 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 00:17:26.926468 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922451 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 00:17:26.926468 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922454 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 00:17:26.926468 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922457 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 00:17:26.926468 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922461 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 00:17:26.926468 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922465 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 00:17:26.926468 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922471 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 00:17:26.926468 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922474 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 00:17:26.926468 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922477 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 00:17:26.926468 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922480 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 00:17:26.926468 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922482 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 00:17:26.926468 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922485 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 00:17:26.926468 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922488 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 00:17:26.926468 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922491 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 00:17:26.926976 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922494 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 00:17:26.926976 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922496 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 00:17:26.926976 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922500 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 00:17:26.926976 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922502 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 00:17:26.926976 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922505 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 00:17:26.926976 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922508 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 00:17:26.926976 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922510 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 00:17:26.926976 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922514 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 00:17:26.926976 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922516 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 00:17:26.926976 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922519 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 00:17:26.926976 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922522 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 00:17:26.926976 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922525 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 00:17:26.926976 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922527 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 00:17:26.926976 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922530 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 00:17:26.926976 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922533 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 00:17:26.926976 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922536 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 00:17:26.926976 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922538 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 00:17:26.926976 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922541 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 00:17:26.926976 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.922544 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 00:17:26.926976 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922613 2581 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 00:17:26.926976 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922620 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 00:17:26.927550 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922645 2581 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 00:17:26.927550 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922650 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 00:17:26.927550 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922654 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 00:17:26.927550 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922659 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 00:17:26.927550 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922664 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 00:17:26.927550 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922668 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 00:17:26.927550 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922671 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 00:17:26.927550 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922674 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 00:17:26.927550 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922678 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 00:17:26.927550 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922681 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 00:17:26.927550 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922684 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 00:17:26.927550 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922687 2581 flags.go:64] FLAG: --cgroup-root="" Jul 02 00:17:26.927550 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922690 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 00:17:26.927550 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922694 2581 flags.go:64] FLAG: --client-ca-file="" Jul 02 00:17:26.927550 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922697 2581 flags.go:64] FLAG: --cloud-provider="external" Jul 02 00:17:26.927550 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922701 2581 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 00:17:26.927550 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922705 2581 flags.go:64] FLAG: --cluster-domain="" Jul 02 00:17:26.927550 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922708 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 00:17:26.927550 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922711 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 00:17:26.927550 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922715 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 00:17:26.927550 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922718 2581 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 00:17:26.927550 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922722 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 00:17:26.927550 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922725 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 00:17:26.928129 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922729 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 00:17:26.928129 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922732 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 00:17:26.928129 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922735 2581 flags.go:64] FLAG: --contention-profiling="false" Jul 02 00:17:26.928129 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922739 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 00:17:26.928129 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922742 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 00:17:26.928129 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922745 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 00:17:26.928129 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922748 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 00:17:26.928129 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922752 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 00:17:26.928129 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922756 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 00:17:26.928129 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922759 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 00:17:26.928129 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922762 2581 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 00:17:26.928129 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922765 2581 flags.go:64] FLAG: --enable-server="true" Jul 02 00:17:26.928129 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922770 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 00:17:26.928129 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922774 2581 flags.go:64] FLAG: --event-burst="100" Jul 02 00:17:26.928129 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922777 2581 flags.go:64] FLAG: --event-qps="50" Jul 02 00:17:26.928129 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922780 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 00:17:26.928129 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922784 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 00:17:26.928129 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922787 2581 flags.go:64] FLAG: --eviction-hard="" Jul 02 00:17:26.928129 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922791 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 00:17:26.928129 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922794 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 00:17:26.928129 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922797 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 00:17:26.928129 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922800 2581 flags.go:64] FLAG: --eviction-soft="" Jul 02 00:17:26.928129 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922803 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 00:17:26.928129 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922807 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 00:17:26.928129 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922810 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 00:17:26.928821 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922813 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 00:17:26.928821 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922816 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 00:17:26.928821 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922819 2581 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 00:17:26.928821 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922823 2581 flags.go:64] FLAG: --feature-gates="" Jul 02 00:17:26.928821 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922826 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 00:17:26.928821 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922830 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 00:17:26.928821 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922833 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 00:17:26.928821 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922836 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 00:17:26.928821 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922839 2581 flags.go:64] FLAG: --healthz-port="10248" Jul 02 00:17:26.928821 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922842 2581 flags.go:64] FLAG: --help="false" Jul 02 00:17:26.928821 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922845 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-130-30.ec2.internal" Jul 02 00:17:26.928821 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922849 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 00:17:26.928821 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922852 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 00:17:26.928821 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922855 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 00:17:26.928821 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922859 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 00:17:26.928821 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922862 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 00:17:26.928821 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922868 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 00:17:26.928821 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922871 2581 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 00:17:26.928821 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922874 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 00:17:26.928821 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922879 2581 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 00:17:26.928821 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922882 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 00:17:26.928821 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922885 2581 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 00:17:26.928821 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922888 2581 flags.go:64] FLAG: --kube-reserved="" Jul 02 00:17:26.928821 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922891 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 00:17:26.929446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922894 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 00:17:26.929446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922898 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 00:17:26.929446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922901 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 00:17:26.929446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922904 2581 flags.go:64] FLAG: --lock-file="" Jul 02 00:17:26.929446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922907 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 00:17:26.929446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922911 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 00:17:26.929446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922914 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 00:17:26.929446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922919 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 00:17:26.929446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922923 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 00:17:26.929446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922926 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 00:17:26.929446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922930 2581 flags.go:64] FLAG: --logging-format="text" Jul 02 00:17:26.929446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922933 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 00:17:26.929446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922936 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 00:17:26.929446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922939 2581 flags.go:64] FLAG: --manifest-url="" Jul 02 00:17:26.929446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922942 2581 flags.go:64] FLAG: --manifest-url-header="" Jul 02 00:17:26.929446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922946 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 00:17:26.929446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922949 2581 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 00:17:26.929446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922953 2581 flags.go:64] FLAG: --max-pods="110" Jul 02 00:17:26.929446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922957 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 00:17:26.929446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922960 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 00:17:26.929446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922963 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 00:17:26.929446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922966 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 00:17:26.929446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922969 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 00:17:26.929446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922972 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 00:17:26.929446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922977 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 00:17:26.930145 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922984 2581 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 00:17:26.930145 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922988 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 00:17:26.930145 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922992 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 00:17:26.930145 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922995 2581 flags.go:64] FLAG: --pod-cidr="" Jul 02 00:17:26.930145 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.922998 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 02 00:17:26.930145 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923004 2581 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 00:17:26.930145 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923007 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 00:17:26.930145 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923010 2581 flags.go:64] FLAG: --pods-per-core="0" Jul 02 00:17:26.930145 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923013 2581 flags.go:64] FLAG: --port="10250" Jul 02 00:17:26.930145 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923016 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 00:17:26.930145 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923020 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0abb443871e84fd87" Jul 02 00:17:26.930145 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923023 2581 flags.go:64] FLAG: --qos-reserved="" Jul 02 00:17:26.930145 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923026 2581 flags.go:64] FLAG: --read-only-port="10255" Jul 02 00:17:26.930145 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923029 2581 flags.go:64] FLAG: --register-node="true" Jul 02 00:17:26.930145 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923032 2581 flags.go:64] FLAG: --register-with-taints="" Jul 02 00:17:26.930145 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923039 2581 flags.go:64] FLAG: --registry-burst="10" Jul 02 00:17:26.930145 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923042 2581 flags.go:64] FLAG: --registry-qps="5" Jul 02 00:17:26.930145 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923046 2581 flags.go:64] FLAG: --reserved-cpus="" Jul 02 00:17:26.930145 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923048 2581 flags.go:64] FLAG: --reserved-memory="" Jul 02 00:17:26.930145 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923052 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 00:17:26.930145 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923055 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 00:17:26.930145 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923058 2581 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 00:17:26.930145 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923061 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 00:17:26.930145 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923064 2581 flags.go:64] FLAG: --runonce="false" Jul 02 00:17:26.930145 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923067 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 00:17:26.930812 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923070 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 00:17:26.930812 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923073 2581 flags.go:64] FLAG: --seccomp-default="false" Jul 02 00:17:26.930812 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923076 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 00:17:26.930812 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923079 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 00:17:26.930812 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923082 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 00:17:26.930812 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923086 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 00:17:26.930812 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923090 2581 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 00:17:26.930812 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923093 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 00:17:26.930812 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923096 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 00:17:26.930812 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923099 2581 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 00:17:26.930812 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923103 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 00:17:26.930812 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923107 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 00:17:26.930812 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923110 2581 flags.go:64] FLAG: --system-cgroups="" Jul 02 00:17:26.930812 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923113 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 00:17:26.930812 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923119 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 00:17:26.930812 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923122 2581 flags.go:64] FLAG: --tls-cert-file="" Jul 02 00:17:26.930812 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923125 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 00:17:26.930812 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923130 2581 flags.go:64] FLAG: --tls-min-version="" Jul 02 00:17:26.930812 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923132 2581 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 00:17:26.930812 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923135 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 00:17:26.930812 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923138 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 00:17:26.930812 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923142 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 00:17:26.930812 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923145 2581 flags.go:64] FLAG: --v="2" Jul 02 00:17:26.930812 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923149 2581 flags.go:64] FLAG: --version="false" Jul 02 00:17:26.930812 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923153 2581 flags.go:64] FLAG: --vmodule="" Jul 02 00:17:26.931475 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923157 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 00:17:26.931475 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.923161 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 00:17:26.931475 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923276 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 00:17:26.931475 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923280 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 00:17:26.931475 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923283 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 00:17:26.931475 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923286 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 00:17:26.931475 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923289 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 00:17:26.931475 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923292 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 00:17:26.931475 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923295 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 00:17:26.931475 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923298 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 00:17:26.931475 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923301 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 00:17:26.931475 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923303 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 00:17:26.931475 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923306 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 00:17:26.931475 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923311 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 00:17:26.931475 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923314 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 00:17:26.931475 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923317 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 00:17:26.931475 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923320 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 00:17:26.931475 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923324 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 00:17:26.931475 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923327 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 00:17:26.931475 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923330 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 00:17:26.931996 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923332 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 00:17:26.931996 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923335 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 00:17:26.931996 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923339 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 00:17:26.931996 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923342 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 00:17:26.931996 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923344 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 00:17:26.931996 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923347 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 00:17:26.931996 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923351 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 00:17:26.931996 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923354 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 00:17:26.931996 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923357 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 00:17:26.931996 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923360 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 00:17:26.931996 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923363 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 00:17:26.931996 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923366 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 00:17:26.931996 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923369 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 00:17:26.931996 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923372 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 00:17:26.931996 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923375 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 00:17:26.931996 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923378 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 00:17:26.931996 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923380 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 00:17:26.931996 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923384 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 00:17:26.931996 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923387 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 00:17:26.932473 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923390 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 00:17:26.932473 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923393 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 00:17:26.932473 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923396 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 00:17:26.932473 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923399 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 00:17:26.932473 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923401 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 00:17:26.932473 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923404 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 00:17:26.932473 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923408 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 00:17:26.932473 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923411 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 00:17:26.932473 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923414 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 00:17:26.932473 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923417 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 00:17:26.932473 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923421 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 00:17:26.932473 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923424 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 00:17:26.932473 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923427 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 00:17:26.932473 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923430 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 00:17:26.932473 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923433 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 00:17:26.932473 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923436 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 00:17:26.932473 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923439 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 00:17:26.932473 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923441 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 00:17:26.932473 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923444 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 00:17:26.932473 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923447 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 00:17:26.933014 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923450 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 00:17:26.933014 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923453 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 00:17:26.933014 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923456 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 00:17:26.933014 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923458 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 00:17:26.933014 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923461 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 00:17:26.933014 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923464 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 00:17:26.933014 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923467 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 00:17:26.933014 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923472 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 00:17:26.933014 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923475 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 00:17:26.933014 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923479 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 00:17:26.933014 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923482 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 00:17:26.933014 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923486 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 00:17:26.933014 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923489 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 00:17:26.933014 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923492 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 00:17:26.933014 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923508 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 00:17:26.933014 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923511 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 00:17:26.933014 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923514 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 00:17:26.933014 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923516 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 00:17:26.933014 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923520 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 00:17:26.933508 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923523 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 00:17:26.933508 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923526 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 00:17:26.933508 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923530 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 00:17:26.933508 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923534 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 00:17:26.933508 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923537 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 00:17:26.933508 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923539 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 00:17:26.933508 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923542 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 00:17:26.933508 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923545 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 02 00:17:26.933508 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923548 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 00:17:26.933508 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923551 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 00:17:26.933508 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923554 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 00:17:26.933508 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923556 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 00:17:26.933508 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923559 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 00:17:26.933508 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923562 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 00:17:26.933508 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923565 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 00:17:26.933508 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923567 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 00:17:26.933508 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923570 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 00:17:26.933508 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923573 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 00:17:26.933508 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923575 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 00:17:26.933508 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923578 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 00:17:26.934025 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923588 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 00:17:26.934025 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923591 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 00:17:26.934025 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.923595 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 00:17:26.934025 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.924356 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 00:17:26.934025 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.931156 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 00:17:26.934025 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.931170 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 00:17:26.934025 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.931190 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 00:17:26.934025 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.931196 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 00:17:26.934025 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931266 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 00:17:26.934025 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931271 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 00:17:26.934025 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931274 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 00:17:26.934025 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931278 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 00:17:26.934025 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931281 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 00:17:26.934025 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931284 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 00:17:26.934409 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931288 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 00:17:26.934409 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931291 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 00:17:26.934409 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931293 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 00:17:26.934409 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931296 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 00:17:26.934409 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931299 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 00:17:26.934409 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931302 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 00:17:26.934409 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931305 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 00:17:26.934409 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931308 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 00:17:26.934409 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931311 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 00:17:26.934409 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931314 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 00:17:26.934409 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931316 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 00:17:26.934409 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931320 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 00:17:26.934409 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931322 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 00:17:26.934409 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931326 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 00:17:26.934409 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931328 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 00:17:26.934409 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931331 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 00:17:26.934409 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931334 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 00:17:26.934409 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931336 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 00:17:26.934409 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931339 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 00:17:26.934409 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931342 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 00:17:26.934929 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931345 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 00:17:26.934929 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931347 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 00:17:26.934929 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931350 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 00:17:26.934929 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931355 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 00:17:26.934929 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931358 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 00:17:26.934929 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931361 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 00:17:26.934929 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931364 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 00:17:26.934929 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931366 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 00:17:26.934929 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931369 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 00:17:26.934929 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931372 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 00:17:26.934929 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931375 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 00:17:26.934929 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931378 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 00:17:26.934929 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931381 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 00:17:26.934929 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931384 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 00:17:26.934929 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931387 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 00:17:26.934929 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931390 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 00:17:26.934929 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931392 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 00:17:26.934929 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931397 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 00:17:26.934929 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931401 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 00:17:26.935427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931404 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 00:17:26.935427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931407 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 00:17:26.935427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931409 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 00:17:26.935427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931412 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 00:17:26.935427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931415 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 00:17:26.935427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931417 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 00:17:26.935427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931420 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 00:17:26.935427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931423 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 00:17:26.935427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931425 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 00:17:26.935427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931428 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 00:17:26.935427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931431 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 00:17:26.935427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931434 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 00:17:26.935427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931437 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 00:17:26.935427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931439 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 00:17:26.935427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931442 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 00:17:26.935427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931445 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 00:17:26.935427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931448 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 00:17:26.935427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931451 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 00:17:26.935427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931454 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 00:17:26.935427 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931457 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 00:17:26.936000 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931459 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 00:17:26.936000 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931463 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 00:17:26.936000 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931466 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 00:17:26.936000 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931468 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 00:17:26.936000 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931471 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 02 00:17:26.936000 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931474 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 00:17:26.936000 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931477 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 00:17:26.936000 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931480 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 00:17:26.936000 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931482 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 00:17:26.936000 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931486 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 00:17:26.936000 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931502 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 00:17:26.936000 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931505 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 00:17:26.936000 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931508 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 00:17:26.936000 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931511 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 00:17:26.936000 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931515 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 00:17:26.936000 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931518 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 00:17:26.936000 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931521 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 00:17:26.936000 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931524 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 00:17:26.936000 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931527 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 00:17:26.936000 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931529 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 00:17:26.936529 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931532 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 00:17:26.936529 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931535 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 00:17:26.936529 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931538 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 00:17:26.936529 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931541 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 00:17:26.936529 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931545 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 00:17:26.936529 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931549 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 00:17:26.936529 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931552 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 00:17:26.936529 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931555 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 00:17:26.936529 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931559 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 00:17:26.936529 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931562 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 00:17:26.936529 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931565 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 00:17:26.936529 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931568 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 00:17:26.936529 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931571 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 00:17:26.936529 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931574 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 00:17:26.936529 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.931580 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 00:17:26.936915 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931717 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 00:17:26.936915 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931722 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 00:17:26.936915 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931726 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 00:17:26.936915 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931729 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 00:17:26.936915 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931732 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 00:17:26.936915 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931734 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 00:17:26.936915 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931737 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 00:17:26.936915 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931740 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 00:17:26.936915 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931742 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 00:17:26.936915 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931745 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 00:17:26.936915 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931748 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 00:17:26.936915 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931750 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 00:17:26.936915 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931755 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 00:17:26.936915 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931758 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 00:17:26.936915 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931761 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 00:17:26.936915 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931764 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 00:17:26.936915 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931768 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 02 00:17:26.936915 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931771 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 00:17:26.936915 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931775 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 00:17:26.937407 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931778 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 00:17:26.937407 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931781 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 00:17:26.937407 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931784 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 00:17:26.937407 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931787 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 00:17:26.937407 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931790 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 00:17:26.937407 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931793 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 00:17:26.937407 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931796 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 00:17:26.937407 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931799 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 00:17:26.937407 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931802 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 00:17:26.937407 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931806 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 00:17:26.937407 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931809 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 00:17:26.937407 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931812 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 00:17:26.937407 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931814 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 00:17:26.937407 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931818 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 00:17:26.937407 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931821 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 00:17:26.937407 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931824 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 00:17:26.937407 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931827 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 00:17:26.937407 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931829 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 00:17:26.937407 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931832 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 00:17:26.937407 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931835 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 00:17:26.938003 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931837 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 00:17:26.938003 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931840 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 00:17:26.938003 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931843 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 00:17:26.938003 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931845 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 00:17:26.938003 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931850 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 00:17:26.938003 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931853 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 00:17:26.938003 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931856 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 00:17:26.938003 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931859 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 00:17:26.938003 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931862 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 00:17:26.938003 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931866 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 00:17:26.938003 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931868 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 00:17:26.938003 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931871 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 00:17:26.938003 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931874 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 00:17:26.938003 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931876 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 00:17:26.938003 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931879 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 00:17:26.938003 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931882 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 00:17:26.938003 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931885 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 00:17:26.938003 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931887 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 00:17:26.938003 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931890 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 00:17:26.938486 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931893 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 00:17:26.938486 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931896 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 00:17:26.938486 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931898 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 00:17:26.938486 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931907 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 00:17:26.938486 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931910 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 00:17:26.938486 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931913 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 00:17:26.938486 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931916 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 00:17:26.938486 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931918 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 00:17:26.938486 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931921 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 00:17:26.938486 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931924 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 00:17:26.938486 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931927 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 00:17:26.938486 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931929 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 00:17:26.938486 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931932 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 00:17:26.938486 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931935 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 00:17:26.938486 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931937 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 00:17:26.938486 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931940 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 00:17:26.938486 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931943 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 00:17:26.938486 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931945 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 00:17:26.938486 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931948 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 00:17:26.938983 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931951 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 00:17:26.938983 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931953 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 00:17:26.938983 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931956 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 00:17:26.938983 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931959 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 00:17:26.938983 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931962 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 00:17:26.938983 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931964 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 00:17:26.938983 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931967 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 00:17:26.938983 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931969 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 00:17:26.938983 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931972 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 00:17:26.938983 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931975 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 00:17:26.938983 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931977 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 00:17:26.938983 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931980 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 00:17:26.938983 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931982 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 00:17:26.938983 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931985 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 00:17:26.938983 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931987 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 00:17:26.938983 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931990 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 00:17:26.938983 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.931993 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 00:17:26.938983 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.932001 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 00:17:26.938983 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.932004 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 00:17:26.938983 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.932007 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 00:17:26.939501 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.932010 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 00:17:26.939501 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:26.932013 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 00:17:26.939501 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.932018 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 00:17:26.939501 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.932139 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 00:17:26.939501 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.934777 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 00:17:26.939501 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.935956 2581 server.go:1019] "Starting client certificate rotation" Jul 02 00:17:26.939501 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.936075 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 00:17:26.939501 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.936114 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 00:17:26.939501 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.939056 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 00:17:26.943279 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.943264 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 00:17:26.954259 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.954236 2581 log.go:25] "Validated CRI v1 runtime API" Jul 02 00:17:26.958590 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.958575 2581 log.go:25] "Validated CRI v1 image API" Jul 02 00:17:26.959425 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.959402 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 00:17:26.963526 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.963503 2581 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 904c5e6c-3365-4850-91f8-b5372ca2b032:/dev/nvme0n1p4 a507a7fe-1c44-4c63-8d35-a53220129ac8:/dev/nvme0n1p3] Jul 02 00:17:26.963604 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.963524 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 00:17:26.968577 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.968559 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 00:17:26.968860 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.968739 2581 manager.go:216] Machine: {Timestamp:2026-07-02 00:17:26.967675203 +0000 UTC m=+0.383112865 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100039 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ac9c1c4d622abef963a7829d17f50 SystemUUID:ec2ac9c1-c4d6-22ab-ef96-3a7829d17f50 BootID:4c82f260-31ea-43f5-91fd-58606521fb3f Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b1:0e:a7:74:b5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b1:0e:a7:74:b5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:f2:74:0f:06:a6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 00:17:26.968860 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.968859 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 00:17:26.968980 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.968968 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 00:17:26.972404 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.972377 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 00:17:26.972586 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.972408 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-30.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 00:17:26.973631 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.973611 2581 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 00:17:26.973631 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.973633 2581 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 00:17:26.973702 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.973641 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 00:17:26.975204 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.975193 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 00:17:26.975988 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.975978 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 00:17:26.978646 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.978634 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 02 00:17:26.978768 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.978758 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 00:17:26.978803 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.978793 2581 kubelet.go:486] "Attempting to sync node with API server" Jul 02 00:17:26.978832 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.978807 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 00:17:26.978832 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.978819 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 00:17:26.978832 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.978828 2581 kubelet.go:398] "Adding apiserver pod source" Jul 02 00:17:26.978929 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.978837 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 00:17:26.979179 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.979167 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 00:17:26.979243 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.979187 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 00:17:26.981142 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.981124 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 00:17:26.983093 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.983075 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 00:17:26.983189 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.983116 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 00:17:26.983713 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.983699 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 00:17:26.983786 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.983719 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 00:17:26.983786 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.983729 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 00:17:26.983786 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.983737 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 00:17:26.983786 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.983750 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 00:17:26.983786 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.983760 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 00:17:26.983986 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.983839 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 00:17:26.983986 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.983849 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 00:17:26.983986 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.983860 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 00:17:26.983986 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.983869 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 00:17:26.983986 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.983883 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 00:17:26.983986 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.983896 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 00:17:26.984585 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.984568 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 00:17:26.984585 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.984587 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 00:17:26.988092 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.988073 2581 server.go:1268] "Started kubelet" Jul 02 00:17:26.988271 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.988245 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 00:17:26.988555 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.988525 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 00:17:26.988693 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.988680 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 00:17:26.988947 ip-10-0-130-30 systemd[1]: Started Kubernetes Kubelet. Jul 02 00:17:26.989990 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.989941 2581 server.go:310] "Adding debug handlers to kubelet server" Jul 02 00:17:26.990341 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.990327 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 00:17:26.990989 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.990965 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-30.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 00:17:26.992137 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:26.992109 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-30.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 00:17:26.993748 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:26.993730 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 00:17:26.994947 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.994933 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 00:17:26.995247 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.995010 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 00:17:26.995247 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:26.995039 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-30.ec2.internal\" not found" Jul 02 00:17:26.996064 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.995888 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 00:17:26.996064 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.996066 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 00:17:26.996322 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.996308 2581 reconstruct.go:97] "Volume reconstruction finished" Jul 02 00:17:26.996322 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.996322 2581 reconciler.go:29] "Reconciler: start to sync state" Jul 02 00:17:26.996422 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.996335 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 00:17:26.997167 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.997142 2581 factory.go:153] Registering CRI-O factory Jul 02 00:17:26.997277 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.997169 2581 factory.go:223] Registration of the crio container factory successfully Jul 02 00:17:26.997277 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.997227 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 00:17:26.997277 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.997242 2581 factory.go:55] Registering systemd factory Jul 02 00:17:26.997277 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.997252 2581 factory.go:223] Registration of the systemd container factory successfully Jul 02 00:17:26.997277 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.997277 2581 factory.go:103] Registering Raw factory Jul 02 00:17:26.997527 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.997302 2581 manager.go:1196] Started watching for new ooms in manager Jul 02 00:17:26.997778 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:26.997730 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 00:17:26.997929 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:26.997907 2581 manager.go:349] Starting recovery of all containers Jul 02 00:17:26.999000 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:26.997890 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-30.ec2.internal.18be50e5017d9ca4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-30.ec2.internal,UID:ip-10-0-130-30.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-30.ec2.internal,},FirstTimestamp:2026-07-02 00:17:26.988037284 +0000 UTC m=+0.403474947,LastTimestamp:2026-07-02 00:17:26.988037284 +0000 UTC m=+0.403474947,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-30.ec2.internal,}" Jul 02 00:17:27.003950 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:27.003924 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-30.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 02 00:17:27.004054 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:27.003990 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 02 00:17:27.010619 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.010593 2581 manager.go:354] Recovery completed Jul 02 00:17:27.015774 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.015755 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 00:17:27.017487 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.017469 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6x478" Jul 02 00:17:27.017758 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.017745 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-30.ec2.internal" event="NodeHasSufficientMemory" Jul 02 00:17:27.017812 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.017774 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-30.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 00:17:27.017812 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.017784 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-30.ec2.internal" event="NodeHasSufficientPID" Jul 02 00:17:27.018320 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.018306 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 00:17:27.018320 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.018314 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 00:17:27.018320 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.018318 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 00:17:27.018443 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.018335 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 02 00:17:27.019024 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.019010 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-30.ec2.internal" event="NodeHasSufficientMemory" Jul 02 00:17:27.019084 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.019036 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-30.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 00:17:27.019084 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.019054 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-30.ec2.internal" event="NodeHasSufficientPID" Jul 02 00:17:27.019542 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.019528 2581 policy_none.go:49] "None policy: Start" Jul 02 00:17:27.019636 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.019548 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 00:17:27.019636 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.019564 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 00:17:27.019940 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:27.019879 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-30.ec2.internal.18be50e50343235d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-30.ec2.internal,UID:ip-10-0-130-30.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-30.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-30.ec2.internal,},FirstTimestamp:2026-07-02 00:17:27.017759581 +0000 UTC m=+0.433197241,LastTimestamp:2026-07-02 00:17:27.017759581 +0000 UTC m=+0.433197241,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-30.ec2.internal,}" Jul 02 00:17:27.020526 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.020514 2581 policy_none.go:47] "Start" Jul 02 00:17:27.025628 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.025607 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6x478" Jul 02 00:17:27.029989 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:27.029927 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-30.ec2.internal.18be50e503436e16 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-30.ec2.internal,UID:ip-10-0-130-30.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-30.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-30.ec2.internal,},FirstTimestamp:2026-07-02 00:17:27.01777871 +0000 UTC m=+0.433216371,LastTimestamp:2026-07-02 00:17:27.01777871 +0000 UTC m=+0.433216371,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-30.ec2.internal,}" Jul 02 00:17:27.051124 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.051109 2581 manager.go:337] "Starting Device Plugin manager" Jul 02 00:17:27.064339 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:27.051138 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 00:17:27.064339 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.051149 2581 server.go:87] "Starting device plugin registration server" Jul 02 00:17:27.064339 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.051376 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 00:17:27.064339 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.051390 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 00:17:27.064339 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.051478 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 00:17:27.064339 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.051564 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 00:17:27.064339 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.051571 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 00:17:27.064339 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:27.052603 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 00:17:27.064339 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:27.052658 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-30.ec2.internal\" not found" Jul 02 00:17:27.064339 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.058915 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 00:17:27.064339 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.060100 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 00:17:27.064339 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.060132 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 00:17:27.064339 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.060192 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 00:17:27.064339 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:27.060229 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 00:17:27.064339 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.062076 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 00:17:27.155410 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.155385 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 00:17:27.156193 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.156177 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-30.ec2.internal" event="NodeHasSufficientMemory" Jul 02 00:17:27.156269 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.156209 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-30.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 00:17:27.156269 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.156219 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-30.ec2.internal" event="NodeHasSufficientPID" Jul 02 00:17:27.156269 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.156248 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-30.ec2.internal" Jul 02 00:17:27.160347 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.160326 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-30.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-30.ec2.internal"] Jul 02 00:17:27.160397 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.160385 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 00:17:27.161154 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.161105 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-30.ec2.internal" event="NodeHasSufficientMemory" Jul 02 00:17:27.161154 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.161136 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-30.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 00:17:27.161154 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.161150 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-30.ec2.internal" event="NodeHasSufficientPID" Jul 02 00:17:27.163391 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.163378 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 00:17:27.163553 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.163538 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-30.ec2.internal" Jul 02 00:17:27.163608 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.163566 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 00:17:27.164126 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.164112 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-30.ec2.internal" event="NodeHasSufficientMemory" Jul 02 00:17:27.164187 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.164143 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-30.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 00:17:27.164187 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.164158 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-30.ec2.internal" event="NodeHasSufficientPID" Jul 02 00:17:27.164257 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.164113 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-30.ec2.internal" event="NodeHasSufficientMemory" Jul 02 00:17:27.164257 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.164245 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-30.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 00:17:27.164326 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.164264 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-30.ec2.internal" event="NodeHasSufficientPID" Jul 02 00:17:27.165180 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.165163 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-30.ec2.internal" Jul 02 00:17:27.165231 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:27.165192 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-30.ec2.internal\": node \"ip-10-0-130-30.ec2.internal\" not found" Jul 02 00:17:27.166667 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.166652 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-30.ec2.internal" Jul 02 00:17:27.166724 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.166686 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 00:17:27.168149 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.168129 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-30.ec2.internal" event="NodeHasSufficientMemory" Jul 02 00:17:27.168241 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.168185 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-30.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 00:17:27.168241 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.168206 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-30.ec2.internal" event="NodeHasSufficientPID" Jul 02 00:17:27.189156 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:27.189138 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-30.ec2.internal\" not found" node="ip-10-0-130-30.ec2.internal" Jul 02 00:17:27.191039 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:27.191021 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-30.ec2.internal\" not found" Jul 02 00:17:27.193759 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:27.193742 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-30.ec2.internal\" not found" node="ip-10-0-130-30.ec2.internal" Jul 02 00:17:27.291310 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:27.291283 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-30.ec2.internal\" not found" Jul 02 00:17:27.297973 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.297957 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/557f70546d4dabad259953de7405c2f1-config\") pod \"kube-apiserver-proxy-ip-10-0-130-30.ec2.internal\" (UID: \"557f70546d4dabad259953de7405c2f1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-30.ec2.internal" Jul 02 00:17:27.298057 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.297980 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a5117abb60e1ead4ad096e86b336729c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-30.ec2.internal\" (UID: \"a5117abb60e1ead4ad096e86b336729c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-30.ec2.internal" Jul 02 00:17:27.298057 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.298000 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5117abb60e1ead4ad096e86b336729c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-30.ec2.internal\" (UID: \"a5117abb60e1ead4ad096e86b336729c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-30.ec2.internal" Jul 02 00:17:27.398862 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:27.398817 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-30.ec2.internal\" not found" Jul 02 00:17:27.398862 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.398860 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/557f70546d4dabad259953de7405c2f1-config\") pod \"kube-apiserver-proxy-ip-10-0-130-30.ec2.internal\" (UID: \"557f70546d4dabad259953de7405c2f1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-30.ec2.internal" Jul 02 00:17:27.399012 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.398884 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/557f70546d4dabad259953de7405c2f1-config\") pod \"kube-apiserver-proxy-ip-10-0-130-30.ec2.internal\" (UID: \"557f70546d4dabad259953de7405c2f1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-30.ec2.internal" Jul 02 00:17:27.399012 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.398912 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a5117abb60e1ead4ad096e86b336729c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-30.ec2.internal\" (UID: \"a5117abb60e1ead4ad096e86b336729c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-30.ec2.internal" Jul 02 00:17:27.399012 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.398940 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5117abb60e1ead4ad096e86b336729c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-30.ec2.internal\" (UID: \"a5117abb60e1ead4ad096e86b336729c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-30.ec2.internal" Jul 02 00:17:27.399012 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.398936 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a5117abb60e1ead4ad096e86b336729c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-30.ec2.internal\" (UID: \"a5117abb60e1ead4ad096e86b336729c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-30.ec2.internal" Jul 02 00:17:27.399012 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.398994 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5117abb60e1ead4ad096e86b336729c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-30.ec2.internal\" (UID: \"a5117abb60e1ead4ad096e86b336729c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-30.ec2.internal" Jul 02 00:17:27.491237 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.491186 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-30.ec2.internal" Jul 02 00:17:27.497397 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.497382 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-30.ec2.internal" Jul 02 00:17:27.499622 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:27.499599 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-30.ec2.internal\" not found" Jul 02 00:17:27.599689 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:27.599651 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-30.ec2.internal\" not found" Jul 02 00:17:27.700324 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:27.700292 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-30.ec2.internal\" not found" Jul 02 00:17:27.801252 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:27.801173 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-30.ec2.internal\" not found" Jul 02 00:17:27.803913 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.803893 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 00:17:27.877154 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.877129 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 00:17:27.895482 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.895458 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-30.ec2.internal" Jul 02 00:17:27.909739 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.909717 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 00:17:27.910615 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.910602 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-30.ec2.internal" Jul 02 00:17:27.917522 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.917509 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 00:17:27.935679 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.935661 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 00:17:27.935812 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.935790 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 00:17:27.935870 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.935826 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 00:17:27.935870 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.935829 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 00:17:27.979557 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.979533 2581 apiserver.go:52] "Watching apiserver" Jul 02 00:17:27.994927 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.994907 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 00:17:27.995826 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.995806 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 00:17:27.998666 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:27.998643 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-kcpxt","openshift-image-registry/node-ca-swljq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-30.ec2.internal","openshift-multus/network-metrics-daemon-7tkzk","openshift-network-diagnostics/network-check-target-jvbq7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w9hs","openshift-cluster-node-tuning-operator/tuned-k4tlg","openshift-multus/multus-5vxng","openshift-multus/multus-additional-cni-plugins-r76sc","openshift-network-operator/iptables-alerter-8q2sg","openshift-ovn-kubernetes/ovnkube-node-55kgg","kube-system/global-pull-secret-syncer-9rkkw","kube-system/konnectivity-agent-hkqlf","kube-system/kube-apiserver-proxy-ip-10-0-130-30.ec2.internal"] Jul 02 00:17:28.001140 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.001120 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.003375 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.003351 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hkqlf" Jul 02 00:17:28.003868 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.003837 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qxj4h\"" Jul 02 00:17:28.004021 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.004002 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 00:17:28.004236 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.004221 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 00:17:28.005729 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.005695 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.006226 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.006207 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 00:17:28.006226 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.006217 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 00:17:28.006358 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.006211 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4nr4h\"" Jul 02 00:17:28.007983 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.007963 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 00:17:28.008086 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.008070 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:17:28.008168 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:28.008140 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tkzk" podUID="3c33c8e2-8b03-4815-8cd7-d72d4eb01015" Jul 02 00:17:28.008676 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.008186 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 00:17:28.008777 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.008706 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 00:17:28.008839 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.008802 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 00:17:28.009193 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.009161 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 00:17:28.009306 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.009263 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z4mth\"" Jul 02 00:17:28.012823 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.012709 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:17:28.012823 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:28.012786 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jvbq7" podUID="fbf366bb-ccd3-4b51-93c2-9949baa79462" Jul 02 00:17:28.015292 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.015275 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w9hs" Jul 02 00:17:28.017777 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.017750 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-26lls\"" Jul 02 00:17:28.017878 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.017848 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r76sc" Jul 02 00:17:28.017959 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.017938 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 00:17:28.018021 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.018010 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 00:17:28.019535 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.019516 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 00:17:28.020190 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.020165 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tsht9\"" Jul 02 00:17:28.020314 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.020297 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 00:17:28.020382 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.020333 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kcpxt" Jul 02 00:17:28.020619 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.020597 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 00:17:28.022535 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.022518 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gvvll\"" Jul 02 00:17:28.022803 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.022785 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-swljq" Jul 02 00:17:28.022896 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.022826 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 00:17:28.022896 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.022849 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 00:17:28.024982 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.024965 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 00:17:28.025387 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.025372 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8q2sg" Jul 02 00:17:28.025501 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.025413 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 00:17:28.025501 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.025488 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-p8llm\"" Jul 02 00:17:28.025612 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.025491 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 00:17:28.027863 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.027845 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 00:17:28.027982 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.027965 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 00:17:28.028118 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.028100 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.028209 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.028192 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 00:17:28.028306 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.028283 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-88qpn\"" Jul 02 00:17:28.029466 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.029388 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 00:12:27 +0000 UTC" deadline="2028-01-18 16:18:58.293469582 +0000 UTC" Jul 02 00:17:28.029466 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.029453 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13576h1m30.264020421s" Jul 02 00:17:28.030314 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.030295 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 00:17:28.030463 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.030445 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:17:28.030560 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:28.030509 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rkkw" podUID="9ca43bb6-818e-4157-a77e-cbe116cdb95e" Jul 02 00:17:28.030713 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.030656 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 00:17:28.030795 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.030739 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7f2s4\"" Jul 02 00:17:28.030928 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.030882 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 00:17:28.030928 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.030882 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 00:17:28.033652 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.033634 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 00:17:28.033759 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.033669 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-j4qqh" Jul 02 00:17:28.033827 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.033768 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 00:17:28.042594 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.042572 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-j4qqh" Jul 02 00:17:28.097764 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.097746 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 00:17:28.102339 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.102321 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-multus-socket-dir-parent\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.102422 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.102345 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqh55\" (UniqueName: \"kubernetes.io/projected/3f0e46ab-9141-42bb-a494-e96fa6d99107-kube-api-access-nqh55\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.102422 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.102364 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/76a7261f-7633-419a-859b-a54d132b6bc0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5w9hs\" (UID: \"76a7261f-7633-419a-859b-a54d132b6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w9hs" Jul 02 00:17:28.102422 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.102379 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d32c2993-ca5d-4b91-9051-53784803a737-tmp-dir\") pod \"node-resolver-kcpxt\" (UID: \"d32c2993-ca5d-4b91-9051-53784803a737\") " pod="openshift-dns/node-resolver-kcpxt" Jul 02 00:17:28.102422 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.102396 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-run-systemd\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.102422 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.102410 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-node-log\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.102636 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.102425 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-945h8\" (UniqueName: \"kubernetes.io/projected/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-kube-api-access-945h8\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.102636 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.102452 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-system-cni-dir\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.102636 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.102510 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-os-release\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.102636 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.102533 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f0e46ab-9141-42bb-a494-e96fa6d99107-cni-binary-copy\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.102636 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.102555 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/76a7261f-7633-419a-859b-a54d132b6bc0-registration-dir\") pod \"aws-ebs-csi-driver-node-5w9hs\" (UID: \"76a7261f-7633-419a-859b-a54d132b6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w9hs" Jul 02 00:17:28.102636 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.102571 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-host-cni-netd\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.102636 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.102586 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-etc-sysctl-d\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.102636 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.102608 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-sys\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.102636 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.102630 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3af39740-2e0a-41fd-ace2-f375968ce30d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r76sc\" (UID: \"3af39740-2e0a-41fd-ace2-f375968ce30d\") " pod="openshift-multus/multus-additional-cni-plugins-r76sc" Jul 02 00:17:28.102901 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.102663 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-cnibin\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.102901 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.102688 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-host-var-lib-cni-bin\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.102901 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.102703 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-host-kubelet\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.102901 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.102717 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-etc-sysctl-conf\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.102901 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.102736 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-host\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.102901 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.102751 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3af39740-2e0a-41fd-ace2-f375968ce30d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r76sc\" (UID: \"3af39740-2e0a-41fd-ace2-f375968ce30d\") " pod="openshift-multus/multus-additional-cni-plugins-r76sc" Jul 02 00:17:28.102901 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.102783 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-host-var-lib-kubelet\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.102901 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.102797 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/76a7261f-7633-419a-859b-a54d132b6bc0-etc-selinux\") pod \"aws-ebs-csi-driver-node-5w9hs\" (UID: \"76a7261f-7633-419a-859b-a54d132b6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w9hs" Jul 02 00:17:28.102901 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.102810 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3ea67bc7-0faa-4fa0-904c-adfea68a4992-ovnkube-config\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.102901 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.102829 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-etc-systemd\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.102901 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.102869 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a8c9b7b-235d-45e2-a810-d0db55313f20-host\") pod \"node-ca-swljq\" (UID: \"8a8c9b7b-235d-45e2-a810-d0db55313f20\") " pod="openshift-image-registry/node-ca-swljq" Jul 02 00:17:28.102901 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.102898 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jkrr\" (UniqueName: \"kubernetes.io/projected/76a7261f-7633-419a-859b-a54d132b6bc0-kube-api-access-6jkrr\") pod \"aws-ebs-csi-driver-node-5w9hs\" (UID: \"76a7261f-7633-419a-859b-a54d132b6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w9hs" Jul 02 00:17:28.103276 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.102941 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d32c2993-ca5d-4b91-9051-53784803a737-hosts-file\") pod \"node-resolver-kcpxt\" (UID: \"d32c2993-ca5d-4b91-9051-53784803a737\") " pod="openshift-dns/node-resolver-kcpxt" Jul 02 00:17:28.103276 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.102967 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-run-openvswitch\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.103276 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.102988 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-var-lib-kubelet\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.103276 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103004 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsptp\" (UniqueName: \"kubernetes.io/projected/8a8c9b7b-235d-45e2-a810-d0db55313f20-kube-api-access-jsptp\") pod \"node-ca-swljq\" (UID: \"8a8c9b7b-235d-45e2-a810-d0db55313f20\") " pod="openshift-image-registry/node-ca-swljq" Jul 02 00:17:28.103276 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103025 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-multus-cni-dir\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.103276 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103066 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/76a7261f-7633-419a-859b-a54d132b6bc0-socket-dir\") pod \"aws-ebs-csi-driver-node-5w9hs\" (UID: \"76a7261f-7633-419a-859b-a54d132b6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w9hs" Jul 02 00:17:28.103276 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103090 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-host-slash\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.103276 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103105 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-host-run-netns\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.103276 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103151 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.103276 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103175 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-lib-modules\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.103276 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103191 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ceab2e5e-48e7-4018-823a-80838215a715-iptables-alerter-script\") pod \"iptables-alerter-8q2sg\" (UID: \"ceab2e5e-48e7-4018-823a-80838215a715\") " pod="openshift-network-operator/iptables-alerter-8q2sg" Jul 02 00:17:28.103276 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103217 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-hostroot\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.103276 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103242 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5jmm\" (UniqueName: \"kubernetes.io/projected/d32c2993-ca5d-4b91-9051-53784803a737-kube-api-access-c5jmm\") pod \"node-resolver-kcpxt\" (UID: \"d32c2993-ca5d-4b91-9051-53784803a737\") " pod="openshift-dns/node-resolver-kcpxt" Jul 02 00:17:28.103276 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103265 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9ca43bb6-818e-4157-a77e-cbe116cdb95e-dbus\") pod \"global-pull-secret-syncer-9rkkw\" (UID: \"9ca43bb6-818e-4157-a77e-cbe116cdb95e\") " pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:17:28.103934 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103292 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ca43bb6-818e-4157-a77e-cbe116cdb95e-original-pull-secret\") pod \"global-pull-secret-syncer-9rkkw\" (UID: \"9ca43bb6-818e-4157-a77e-cbe116cdb95e\") " pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:17:28.103934 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103320 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-run\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.103934 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103338 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/96851348-608f-48dd-b01d-a88a53cf0ece-agent-certs\") pod \"konnectivity-agent-hkqlf\" (UID: \"96851348-608f-48dd-b01d-a88a53cf0ece\") " pod="kube-system/konnectivity-agent-hkqlf" Jul 02 00:17:28.103934 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103367 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kg4s\" (UniqueName: \"kubernetes.io/projected/ceab2e5e-48e7-4018-823a-80838215a715-kube-api-access-5kg4s\") pod \"iptables-alerter-8q2sg\" (UID: \"ceab2e5e-48e7-4018-823a-80838215a715\") " pod="openshift-network-operator/iptables-alerter-8q2sg" Jul 02 00:17:28.103934 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103402 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-etc-kubernetes\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.103934 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103497 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-systemd-units\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.103934 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103531 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-multus-conf-dir\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.103934 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103566 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/76a7261f-7633-419a-859b-a54d132b6bc0-device-dir\") pod \"aws-ebs-csi-driver-node-5w9hs\" (UID: \"76a7261f-7633-419a-859b-a54d132b6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w9hs" Jul 02 00:17:28.103934 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103595 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-host-run-ovn-kubernetes\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.103934 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103617 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3ea67bc7-0faa-4fa0-904c-adfea68a4992-ovnkube-script-lib\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.103934 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103636 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9ca43bb6-818e-4157-a77e-cbe116cdb95e-kubelet-config\") pod \"global-pull-secret-syncer-9rkkw\" (UID: \"9ca43bb6-818e-4157-a77e-cbe116cdb95e\") " pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:17:28.103934 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103675 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzxph\" (UniqueName: \"kubernetes.io/projected/3af39740-2e0a-41fd-ace2-f375968ce30d-kube-api-access-rzxph\") pod \"multus-additional-cni-plugins-r76sc\" (UID: \"3af39740-2e0a-41fd-ace2-f375968ce30d\") " pod="openshift-multus/multus-additional-cni-plugins-r76sc" Jul 02 00:17:28.103934 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103705 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3af39740-2e0a-41fd-ace2-f375968ce30d-cni-binary-copy\") pod \"multus-additional-cni-plugins-r76sc\" (UID: \"3af39740-2e0a-41fd-ace2-f375968ce30d\") " pod="openshift-multus/multus-additional-cni-plugins-r76sc" Jul 02 00:17:28.103934 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103764 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ceab2e5e-48e7-4018-823a-80838215a715-host-slash\") pod \"iptables-alerter-8q2sg\" (UID: \"ceab2e5e-48e7-4018-823a-80838215a715\") " pod="openshift-network-operator/iptables-alerter-8q2sg" Jul 02 00:17:28.103934 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103781 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3f0e46ab-9141-42bb-a494-e96fa6d99107-multus-daemon-config\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.103934 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103813 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/76a7261f-7633-419a-859b-a54d132b6bc0-sys-fs\") pod \"aws-ebs-csi-driver-node-5w9hs\" (UID: \"76a7261f-7633-419a-859b-a54d132b6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w9hs" Jul 02 00:17:28.104734 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103849 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-var-lib-openvswitch\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.104734 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103876 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-host-cni-bin\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.104734 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103896 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgf8p\" (UniqueName: \"kubernetes.io/projected/fbf366bb-ccd3-4b51-93c2-9949baa79462-kube-api-access-xgf8p\") pod \"network-check-target-jvbq7\" (UID: \"fbf366bb-ccd3-4b51-93c2-9949baa79462\") " pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:17:28.104734 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103921 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-etc-openvswitch\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.104734 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.103967 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbzlc\" (UniqueName: \"kubernetes.io/projected/3ea67bc7-0faa-4fa0-904c-adfea68a4992-kube-api-access-dbzlc\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.104734 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.104002 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-etc-kubernetes\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.104734 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.104017 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-tmp\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.104734 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.104032 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8a8c9b7b-235d-45e2-a810-d0db55313f20-serviceca\") pod \"node-ca-swljq\" (UID: \"8a8c9b7b-235d-45e2-a810-d0db55313f20\") " pod="openshift-image-registry/node-ca-swljq" Jul 02 00:17:28.104734 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.104048 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-run-ovn\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.104734 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.104079 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ea67bc7-0faa-4fa0-904c-adfea68a4992-ovn-node-metrics-cert\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.104734 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.104105 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-etc-modprobe-d\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.104734 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.104158 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3af39740-2e0a-41fd-ace2-f375968ce30d-os-release\") pod \"multus-additional-cni-plugins-r76sc\" (UID: \"3af39740-2e0a-41fd-ace2-f375968ce30d\") " pod="openshift-multus/multus-additional-cni-plugins-r76sc" Jul 02 00:17:28.104734 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.104248 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3af39740-2e0a-41fd-ace2-f375968ce30d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r76sc\" (UID: \"3af39740-2e0a-41fd-ace2-f375968ce30d\") " pod="openshift-multus/multus-additional-cni-plugins-r76sc" Jul 02 00:17:28.104734 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.104305 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs\") pod \"network-metrics-daemon-7tkzk\" (UID: \"3c33c8e2-8b03-4815-8cd7-d72d4eb01015\") " pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:17:28.104734 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.104376 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-log-socket\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.104734 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.104443 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3ea67bc7-0faa-4fa0-904c-adfea68a4992-env-overrides\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.105424 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.104492 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-etc-tuned\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.105424 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.104521 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/96851348-608f-48dd-b01d-a88a53cf0ece-konnectivity-ca\") pod \"konnectivity-agent-hkqlf\" (UID: \"96851348-608f-48dd-b01d-a88a53cf0ece\") " pod="kube-system/konnectivity-agent-hkqlf" Jul 02 00:17:28.105424 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.104560 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-host-run-k8s-cni-cncf-io\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.105424 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.104585 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-host-run-multus-certs\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.105424 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.104613 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7plp\" (UniqueName: \"kubernetes.io/projected/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-kube-api-access-d7plp\") pod \"network-metrics-daemon-7tkzk\" (UID: \"3c33c8e2-8b03-4815-8cd7-d72d4eb01015\") " pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:17:28.105424 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.104637 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-etc-sysconfig\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.105424 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.104697 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3af39740-2e0a-41fd-ace2-f375968ce30d-system-cni-dir\") pod \"multus-additional-cni-plugins-r76sc\" (UID: \"3af39740-2e0a-41fd-ace2-f375968ce30d\") " pod="openshift-multus/multus-additional-cni-plugins-r76sc" Jul 02 00:17:28.105424 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.104721 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3af39740-2e0a-41fd-ace2-f375968ce30d-cnibin\") pod \"multus-additional-cni-plugins-r76sc\" (UID: \"3af39740-2e0a-41fd-ace2-f375968ce30d\") " pod="openshift-multus/multus-additional-cni-plugins-r76sc" Jul 02 00:17:28.105424 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.104744 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-host-run-netns\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.105424 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.104779 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-host-var-lib-cni-multus\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.125906 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:28.125875 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod557f70546d4dabad259953de7405c2f1.slice/crio-367bb42bd0cf529808fcf2a1a506fdb611461e5d8af186abd037551e66d5a1c3 WatchSource:0}: Error finding container 367bb42bd0cf529808fcf2a1a506fdb611461e5d8af186abd037551e66d5a1c3: Status 404 returned error can't find the container with id 367bb42bd0cf529808fcf2a1a506fdb611461e5d8af186abd037551e66d5a1c3 Jul 02 00:17:28.126207 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:28.126182 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5117abb60e1ead4ad096e86b336729c.slice/crio-e0c356cddfa1a075509e31ed2fbf78ab77dafa51fa660527c6ef0431e59295c4 WatchSource:0}: Error finding container e0c356cddfa1a075509e31ed2fbf78ab77dafa51fa660527c6ef0431e59295c4: Status 404 returned error can't find the container with id e0c356cddfa1a075509e31ed2fbf78ab77dafa51fa660527c6ef0431e59295c4 Jul 02 00:17:28.131032 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.131015 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 00:17:28.205274 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205246 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-host-run-multus-certs\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.205383 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205280 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7plp\" (UniqueName: \"kubernetes.io/projected/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-kube-api-access-d7plp\") pod \"network-metrics-daemon-7tkzk\" (UID: \"3c33c8e2-8b03-4815-8cd7-d72d4eb01015\") " pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:17:28.205383 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205307 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-etc-sysconfig\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.205383 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205333 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3af39740-2e0a-41fd-ace2-f375968ce30d-system-cni-dir\") pod \"multus-additional-cni-plugins-r76sc\" (UID: \"3af39740-2e0a-41fd-ace2-f375968ce30d\") " pod="openshift-multus/multus-additional-cni-plugins-r76sc" Jul 02 00:17:28.205383 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205359 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3af39740-2e0a-41fd-ace2-f375968ce30d-cnibin\") pod \"multus-additional-cni-plugins-r76sc\" (UID: \"3af39740-2e0a-41fd-ace2-f375968ce30d\") " pod="openshift-multus/multus-additional-cni-plugins-r76sc" Jul 02 00:17:28.205383 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205369 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-host-run-multus-certs\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.205684 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205382 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-host-run-netns\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.205684 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205409 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-host-var-lib-cni-multus\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.205684 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205436 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-etc-sysconfig\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.205684 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205434 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-multus-socket-dir-parent\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.205684 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205441 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3af39740-2e0a-41fd-ace2-f375968ce30d-system-cni-dir\") pod \"multus-additional-cni-plugins-r76sc\" (UID: \"3af39740-2e0a-41fd-ace2-f375968ce30d\") " pod="openshift-multus/multus-additional-cni-plugins-r76sc" Jul 02 00:17:28.205684 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205454 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-host-run-netns\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.205684 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205494 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-host-var-lib-cni-multus\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.205684 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205495 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqh55\" (UniqueName: \"kubernetes.io/projected/3f0e46ab-9141-42bb-a494-e96fa6d99107-kube-api-access-nqh55\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.205684 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205517 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3af39740-2e0a-41fd-ace2-f375968ce30d-cnibin\") pod \"multus-additional-cni-plugins-r76sc\" (UID: \"3af39740-2e0a-41fd-ace2-f375968ce30d\") " pod="openshift-multus/multus-additional-cni-plugins-r76sc" Jul 02 00:17:28.205684 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205584 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/76a7261f-7633-419a-859b-a54d132b6bc0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5w9hs\" (UID: \"76a7261f-7633-419a-859b-a54d132b6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w9hs" Jul 02 00:17:28.205684 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205610 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-multus-socket-dir-parent\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.205684 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205632 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d32c2993-ca5d-4b91-9051-53784803a737-tmp-dir\") pod \"node-resolver-kcpxt\" (UID: \"d32c2993-ca5d-4b91-9051-53784803a737\") " pod="openshift-dns/node-resolver-kcpxt" Jul 02 00:17:28.205684 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205659 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-run-systemd\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.205684 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205683 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-node-log\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.206324 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205697 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/76a7261f-7633-419a-859b-a54d132b6bc0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5w9hs\" (UID: \"76a7261f-7633-419a-859b-a54d132b6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w9hs" Jul 02 00:17:28.206324 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205706 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-945h8\" (UniqueName: \"kubernetes.io/projected/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-kube-api-access-945h8\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.206324 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205745 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-node-log\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.206324 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205746 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-run-systemd\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.206324 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205773 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-system-cni-dir\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.206324 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205806 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-os-release\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.206324 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205826 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-system-cni-dir\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.206324 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205832 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f0e46ab-9141-42bb-a494-e96fa6d99107-cni-binary-copy\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.206324 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205902 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/76a7261f-7633-419a-859b-a54d132b6bc0-registration-dir\") pod \"aws-ebs-csi-driver-node-5w9hs\" (UID: \"76a7261f-7633-419a-859b-a54d132b6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w9hs" Jul 02 00:17:28.206324 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205904 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d32c2993-ca5d-4b91-9051-53784803a737-tmp-dir\") pod \"node-resolver-kcpxt\" (UID: \"d32c2993-ca5d-4b91-9051-53784803a737\") " pod="openshift-dns/node-resolver-kcpxt" Jul 02 00:17:28.206324 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205908 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-os-release\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.206324 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205924 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-host-cni-netd\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.206324 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205950 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-etc-sysctl-d\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.206324 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205956 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/76a7261f-7633-419a-859b-a54d132b6bc0-registration-dir\") pod \"aws-ebs-csi-driver-node-5w9hs\" (UID: \"76a7261f-7633-419a-859b-a54d132b6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w9hs" Jul 02 00:17:28.206324 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205971 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-sys\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.206324 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205993 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3af39740-2e0a-41fd-ace2-f375968ce30d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r76sc\" (UID: \"3af39740-2e0a-41fd-ace2-f375968ce30d\") " pod="openshift-multus/multus-additional-cni-plugins-r76sc" Jul 02 00:17:28.206324 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.205994 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-host-cni-netd\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.206324 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206034 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-cnibin\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.207100 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206060 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-sys\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.207100 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206063 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-host-var-lib-cni-bin\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.207100 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206110 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-host-kubelet\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.207100 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206109 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-etc-sysctl-d\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.207100 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206142 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-etc-sysctl-conf\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.207100 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206148 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-host-var-lib-cni-bin\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.207100 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206115 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-cnibin\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.207100 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206168 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-host\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.207100 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206171 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-host-kubelet\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.207100 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206198 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3af39740-2e0a-41fd-ace2-f375968ce30d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r76sc\" (UID: \"3af39740-2e0a-41fd-ace2-f375968ce30d\") " pod="openshift-multus/multus-additional-cni-plugins-r76sc" Jul 02 00:17:28.207100 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206219 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-host\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.207100 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206224 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-host-var-lib-kubelet\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.207100 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206254 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-host-var-lib-kubelet\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.207100 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206258 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/76a7261f-7633-419a-859b-a54d132b6bc0-etc-selinux\") pod \"aws-ebs-csi-driver-node-5w9hs\" (UID: \"76a7261f-7633-419a-859b-a54d132b6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w9hs" Jul 02 00:17:28.207100 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206283 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-etc-sysctl-conf\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.207100 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206288 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3ea67bc7-0faa-4fa0-904c-adfea68a4992-ovnkube-config\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.207100 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206314 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-etc-systemd\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.207100 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206337 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a8c9b7b-235d-45e2-a810-d0db55313f20-host\") pod \"node-ca-swljq\" (UID: \"8a8c9b7b-235d-45e2-a810-d0db55313f20\") " pod="openshift-image-registry/node-ca-swljq" Jul 02 00:17:28.208019 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206339 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/76a7261f-7633-419a-859b-a54d132b6bc0-etc-selinux\") pod \"aws-ebs-csi-driver-node-5w9hs\" (UID: \"76a7261f-7633-419a-859b-a54d132b6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w9hs" Jul 02 00:17:28.208019 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206362 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jkrr\" (UniqueName: \"kubernetes.io/projected/76a7261f-7633-419a-859b-a54d132b6bc0-kube-api-access-6jkrr\") pod \"aws-ebs-csi-driver-node-5w9hs\" (UID: \"76a7261f-7633-419a-859b-a54d132b6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w9hs" Jul 02 00:17:28.208019 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206387 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d32c2993-ca5d-4b91-9051-53784803a737-hosts-file\") pod \"node-resolver-kcpxt\" (UID: \"d32c2993-ca5d-4b91-9051-53784803a737\") " pod="openshift-dns/node-resolver-kcpxt" Jul 02 00:17:28.208019 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206411 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-run-openvswitch\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.208019 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206477 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-var-lib-kubelet\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.208019 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206502 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsptp\" (UniqueName: \"kubernetes.io/projected/8a8c9b7b-235d-45e2-a810-d0db55313f20-kube-api-access-jsptp\") pod \"node-ca-swljq\" (UID: \"8a8c9b7b-235d-45e2-a810-d0db55313f20\") " pod="openshift-image-registry/node-ca-swljq" Jul 02 00:17:28.208019 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206526 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-multus-cni-dir\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.208019 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206548 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/76a7261f-7633-419a-859b-a54d132b6bc0-socket-dir\") pod \"aws-ebs-csi-driver-node-5w9hs\" (UID: \"76a7261f-7633-419a-859b-a54d132b6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w9hs" Jul 02 00:17:28.208019 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206572 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f0e46ab-9141-42bb-a494-e96fa6d99107-cni-binary-copy\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.208019 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206609 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-host-slash\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.208019 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206631 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-etc-systemd\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.208019 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206647 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-run-openvswitch\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.208019 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206574 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-host-slash\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.208019 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206673 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a8c9b7b-235d-45e2-a810-d0db55313f20-host\") pod \"node-ca-swljq\" (UID: \"8a8c9b7b-235d-45e2-a810-d0db55313f20\") " pod="openshift-image-registry/node-ca-swljq" Jul 02 00:17:28.208019 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206678 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-var-lib-kubelet\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.208019 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206682 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3af39740-2e0a-41fd-ace2-f375968ce30d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r76sc\" (UID: \"3af39740-2e0a-41fd-ace2-f375968ce30d\") " pod="openshift-multus/multus-additional-cni-plugins-r76sc" Jul 02 00:17:28.208019 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206692 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-host-run-netns\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.208875 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206739 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-host-run-netns\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.208875 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206845 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-multus-cni-dir\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.208875 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206935 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d32c2993-ca5d-4b91-9051-53784803a737-hosts-file\") pod \"node-resolver-kcpxt\" (UID: \"d32c2993-ca5d-4b91-9051-53784803a737\") " pod="openshift-dns/node-resolver-kcpxt" Jul 02 00:17:28.208875 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206956 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/76a7261f-7633-419a-859b-a54d132b6bc0-socket-dir\") pod \"aws-ebs-csi-driver-node-5w9hs\" (UID: \"76a7261f-7633-419a-859b-a54d132b6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w9hs" Jul 02 00:17:28.208875 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206979 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3ea67bc7-0faa-4fa0-904c-adfea68a4992-ovnkube-config\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.208875 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.206978 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.208875 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207010 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3af39740-2e0a-41fd-ace2-f375968ce30d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r76sc\" (UID: \"3af39740-2e0a-41fd-ace2-f375968ce30d\") " pod="openshift-multus/multus-additional-cni-plugins-r76sc" Jul 02 00:17:28.208875 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207078 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-lib-modules\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.208875 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207078 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.208875 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207144 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ceab2e5e-48e7-4018-823a-80838215a715-iptables-alerter-script\") pod \"iptables-alerter-8q2sg\" (UID: \"ceab2e5e-48e7-4018-823a-80838215a715\") " pod="openshift-network-operator/iptables-alerter-8q2sg" Jul 02 00:17:28.208875 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207165 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-lib-modules\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.208875 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207172 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-hostroot\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.208875 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207188 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5jmm\" (UniqueName: \"kubernetes.io/projected/d32c2993-ca5d-4b91-9051-53784803a737-kube-api-access-c5jmm\") pod \"node-resolver-kcpxt\" (UID: \"d32c2993-ca5d-4b91-9051-53784803a737\") " pod="openshift-dns/node-resolver-kcpxt" Jul 02 00:17:28.208875 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207206 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-hostroot\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.208875 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207203 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9ca43bb6-818e-4157-a77e-cbe116cdb95e-dbus\") pod \"global-pull-secret-syncer-9rkkw\" (UID: \"9ca43bb6-818e-4157-a77e-cbe116cdb95e\") " pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:17:28.208875 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207241 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ca43bb6-818e-4157-a77e-cbe116cdb95e-original-pull-secret\") pod \"global-pull-secret-syncer-9rkkw\" (UID: \"9ca43bb6-818e-4157-a77e-cbe116cdb95e\") " pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:17:28.208875 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207262 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-run\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.209567 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207287 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9ca43bb6-818e-4157-a77e-cbe116cdb95e-dbus\") pod \"global-pull-secret-syncer-9rkkw\" (UID: \"9ca43bb6-818e-4157-a77e-cbe116cdb95e\") " pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:17:28.209567 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207289 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/96851348-608f-48dd-b01d-a88a53cf0ece-agent-certs\") pod \"konnectivity-agent-hkqlf\" (UID: \"96851348-608f-48dd-b01d-a88a53cf0ece\") " pod="kube-system/konnectivity-agent-hkqlf" Jul 02 00:17:28.209567 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207323 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kg4s\" (UniqueName: \"kubernetes.io/projected/ceab2e5e-48e7-4018-823a-80838215a715-kube-api-access-5kg4s\") pod \"iptables-alerter-8q2sg\" (UID: \"ceab2e5e-48e7-4018-823a-80838215a715\") " pod="openshift-network-operator/iptables-alerter-8q2sg" Jul 02 00:17:28.209567 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207347 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-etc-kubernetes\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.209567 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:28.207351 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 00:17:28.209567 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207374 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-systemd-units\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.209567 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207391 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-multus-conf-dir\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.209567 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207410 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/76a7261f-7633-419a-859b-a54d132b6bc0-device-dir\") pod \"aws-ebs-csi-driver-node-5w9hs\" (UID: \"76a7261f-7633-419a-859b-a54d132b6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w9hs" Jul 02 00:17:28.209567 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207417 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-run\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.209567 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:28.207438 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ca43bb6-818e-4157-a77e-cbe116cdb95e-original-pull-secret podName:9ca43bb6-818e-4157-a77e-cbe116cdb95e nodeName:}" failed. No retries permitted until 2026-07-02 00:17:28.707416901 +0000 UTC m=+2.122854563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ca43bb6-818e-4157-a77e-cbe116cdb95e-original-pull-secret") pod "global-pull-secret-syncer-9rkkw" (UID: "9ca43bb6-818e-4157-a77e-cbe116cdb95e") : object "kube-system"/"original-pull-secret" not registered Jul 02 00:17:28.209567 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207474 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/76a7261f-7633-419a-859b-a54d132b6bc0-device-dir\") pod \"aws-ebs-csi-driver-node-5w9hs\" (UID: \"76a7261f-7633-419a-859b-a54d132b6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w9hs" Jul 02 00:17:28.209567 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207478 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-multus-conf-dir\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.209567 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207474 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-systemd-units\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.209567 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207490 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-host-run-ovn-kubernetes\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.209567 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207527 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3ea67bc7-0faa-4fa0-904c-adfea68a4992-ovnkube-script-lib\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.209567 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207536 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-etc-kubernetes\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.209567 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207550 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-host-run-ovn-kubernetes\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.210121 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207553 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9ca43bb6-818e-4157-a77e-cbe116cdb95e-kubelet-config\") pod \"global-pull-secret-syncer-9rkkw\" (UID: \"9ca43bb6-818e-4157-a77e-cbe116cdb95e\") " pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:17:28.210121 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207599 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzxph\" (UniqueName: \"kubernetes.io/projected/3af39740-2e0a-41fd-ace2-f375968ce30d-kube-api-access-rzxph\") pod \"multus-additional-cni-plugins-r76sc\" (UID: \"3af39740-2e0a-41fd-ace2-f375968ce30d\") " pod="openshift-multus/multus-additional-cni-plugins-r76sc" Jul 02 00:17:28.210121 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207629 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3af39740-2e0a-41fd-ace2-f375968ce30d-cni-binary-copy\") pod \"multus-additional-cni-plugins-r76sc\" (UID: \"3af39740-2e0a-41fd-ace2-f375968ce30d\") " pod="openshift-multus/multus-additional-cni-plugins-r76sc" Jul 02 00:17:28.210121 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207600 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9ca43bb6-818e-4157-a77e-cbe116cdb95e-kubelet-config\") pod \"global-pull-secret-syncer-9rkkw\" (UID: \"9ca43bb6-818e-4157-a77e-cbe116cdb95e\") " pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:17:28.210121 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207686 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ceab2e5e-48e7-4018-823a-80838215a715-host-slash\") pod \"iptables-alerter-8q2sg\" (UID: \"ceab2e5e-48e7-4018-823a-80838215a715\") " pod="openshift-network-operator/iptables-alerter-8q2sg" Jul 02 00:17:28.210121 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207710 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3f0e46ab-9141-42bb-a494-e96fa6d99107-multus-daemon-config\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.210121 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207715 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 00:17:28.210121 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207727 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/76a7261f-7633-419a-859b-a54d132b6bc0-sys-fs\") pod \"aws-ebs-csi-driver-node-5w9hs\" (UID: \"76a7261f-7633-419a-859b-a54d132b6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w9hs" Jul 02 00:17:28.210121 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207767 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ceab2e5e-48e7-4018-823a-80838215a715-host-slash\") pod \"iptables-alerter-8q2sg\" (UID: \"ceab2e5e-48e7-4018-823a-80838215a715\") " pod="openshift-network-operator/iptables-alerter-8q2sg" Jul 02 00:17:28.210121 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207780 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/76a7261f-7633-419a-859b-a54d132b6bc0-sys-fs\") pod \"aws-ebs-csi-driver-node-5w9hs\" (UID: \"76a7261f-7633-419a-859b-a54d132b6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w9hs" Jul 02 00:17:28.210121 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207789 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ceab2e5e-48e7-4018-823a-80838215a715-iptables-alerter-script\") pod \"iptables-alerter-8q2sg\" (UID: \"ceab2e5e-48e7-4018-823a-80838215a715\") " pod="openshift-network-operator/iptables-alerter-8q2sg" Jul 02 00:17:28.210121 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207800 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-var-lib-openvswitch\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.210121 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207851 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-host-cni-bin\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.210121 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207877 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgf8p\" (UniqueName: \"kubernetes.io/projected/fbf366bb-ccd3-4b51-93c2-9949baa79462-kube-api-access-xgf8p\") pod \"network-check-target-jvbq7\" (UID: \"fbf366bb-ccd3-4b51-93c2-9949baa79462\") " pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:17:28.210121 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207901 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-etc-openvswitch\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.210121 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207928 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbzlc\" (UniqueName: \"kubernetes.io/projected/3ea67bc7-0faa-4fa0-904c-adfea68a4992-kube-api-access-dbzlc\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.210121 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207934 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-var-lib-openvswitch\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.210721 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207934 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-host-cni-bin\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.210721 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207953 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-etc-kubernetes\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.210721 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.207993 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-etc-kubernetes\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.210721 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.208002 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-tmp\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.210721 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.208038 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-etc-openvswitch\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.210721 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.208033 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8a8c9b7b-235d-45e2-a810-d0db55313f20-serviceca\") pod \"node-ca-swljq\" (UID: \"8a8c9b7b-235d-45e2-a810-d0db55313f20\") " pod="openshift-image-registry/node-ca-swljq" Jul 02 00:17:28.210721 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.208129 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3af39740-2e0a-41fd-ace2-f375968ce30d-cni-binary-copy\") pod \"multus-additional-cni-plugins-r76sc\" (UID: \"3af39740-2e0a-41fd-ace2-f375968ce30d\") " pod="openshift-multus/multus-additional-cni-plugins-r76sc" Jul 02 00:17:28.210721 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.208136 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3ea67bc7-0faa-4fa0-904c-adfea68a4992-ovnkube-script-lib\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.210721 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.208174 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-run-ovn\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.210721 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.208208 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ea67bc7-0faa-4fa0-904c-adfea68a4992-ovn-node-metrics-cert\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.210721 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.208239 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-etc-modprobe-d\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.210721 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.208265 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3af39740-2e0a-41fd-ace2-f375968ce30d-os-release\") pod \"multus-additional-cni-plugins-r76sc\" (UID: \"3af39740-2e0a-41fd-ace2-f375968ce30d\") " pod="openshift-multus/multus-additional-cni-plugins-r76sc" Jul 02 00:17:28.210721 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.208269 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-run-ovn\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.210721 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.208292 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3af39740-2e0a-41fd-ace2-f375968ce30d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r76sc\" (UID: \"3af39740-2e0a-41fd-ace2-f375968ce30d\") " pod="openshift-multus/multus-additional-cni-plugins-r76sc" Jul 02 00:17:28.210721 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.208319 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs\") pod \"network-metrics-daemon-7tkzk\" (UID: \"3c33c8e2-8b03-4815-8cd7-d72d4eb01015\") " pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:17:28.210721 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.208346 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-log-socket\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.210721 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.208353 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3f0e46ab-9141-42bb-a494-e96fa6d99107-multus-daemon-config\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.211320 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.208368 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-etc-modprobe-d\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.211320 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.208373 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3ea67bc7-0faa-4fa0-904c-adfea68a4992-env-overrides\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.211320 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.208353 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3af39740-2e0a-41fd-ace2-f375968ce30d-os-release\") pod \"multus-additional-cni-plugins-r76sc\" (UID: \"3af39740-2e0a-41fd-ace2-f375968ce30d\") " pod="openshift-multus/multus-additional-cni-plugins-r76sc" Jul 02 00:17:28.211320 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.208409 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-etc-tuned\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.211320 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.208458 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/96851348-608f-48dd-b01d-a88a53cf0ece-konnectivity-ca\") pod \"konnectivity-agent-hkqlf\" (UID: \"96851348-608f-48dd-b01d-a88a53cf0ece\") " pod="kube-system/konnectivity-agent-hkqlf" Jul 02 00:17:28.211320 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:28.208477 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 00:17:28.211320 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.208533 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-host-run-k8s-cni-cncf-io\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.211320 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:28.208551 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs podName:3c33c8e2-8b03-4815-8cd7-d72d4eb01015 nodeName:}" failed. No retries permitted until 2026-07-02 00:17:28.70853002 +0000 UTC m=+2.123967669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs") pod "network-metrics-daemon-7tkzk" (UID: "3c33c8e2-8b03-4815-8cd7-d72d4eb01015") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 00:17:28.211320 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.208491 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3f0e46ab-9141-42bb-a494-e96fa6d99107-host-run-k8s-cni-cncf-io\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.211320 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.208577 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3af39740-2e0a-41fd-ace2-f375968ce30d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r76sc\" (UID: \"3af39740-2e0a-41fd-ace2-f375968ce30d\") " pod="openshift-multus/multus-additional-cni-plugins-r76sc" Jul 02 00:17:28.211320 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.208675 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3ea67bc7-0faa-4fa0-904c-adfea68a4992-log-socket\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.211320 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.208914 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3ea67bc7-0faa-4fa0-904c-adfea68a4992-env-overrides\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.211320 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.208928 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8a8c9b7b-235d-45e2-a810-d0db55313f20-serviceca\") pod \"node-ca-swljq\" (UID: \"8a8c9b7b-235d-45e2-a810-d0db55313f20\") " pod="openshift-image-registry/node-ca-swljq" Jul 02 00:17:28.211320 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.209235 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/96851348-608f-48dd-b01d-a88a53cf0ece-konnectivity-ca\") pod \"konnectivity-agent-hkqlf\" (UID: \"96851348-608f-48dd-b01d-a88a53cf0ece\") " pod="kube-system/konnectivity-agent-hkqlf" Jul 02 00:17:28.211320 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.211269 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-etc-tuned\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.211788 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.211346 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-tmp\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.211788 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.211369 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ea67bc7-0faa-4fa0-904c-adfea68a4992-ovn-node-metrics-cert\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.211788 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.211550 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/96851348-608f-48dd-b01d-a88a53cf0ece-agent-certs\") pod \"konnectivity-agent-hkqlf\" (UID: \"96851348-608f-48dd-b01d-a88a53cf0ece\") " pod="kube-system/konnectivity-agent-hkqlf" Jul 02 00:17:28.216378 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:28.216356 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 00:17:28.216569 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:28.216387 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 00:17:28.216569 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:28.216402 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xgf8p for pod openshift-network-diagnostics/network-check-target-jvbq7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 00:17:28.216569 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:28.216562 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbf366bb-ccd3-4b51-93c2-9949baa79462-kube-api-access-xgf8p podName:fbf366bb-ccd3-4b51-93c2-9949baa79462 nodeName:}" failed. No retries permitted until 2026-07-02 00:17:28.716542434 +0000 UTC m=+2.131980107 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xgf8p" (UniqueName: "kubernetes.io/projected/fbf366bb-ccd3-4b51-93c2-9949baa79462-kube-api-access-xgf8p") pod "network-check-target-jvbq7" (UID: "fbf366bb-ccd3-4b51-93c2-9949baa79462") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 00:17:28.218085 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.217825 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7plp\" (UniqueName: \"kubernetes.io/projected/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-kube-api-access-d7plp\") pod \"network-metrics-daemon-7tkzk\" (UID: \"3c33c8e2-8b03-4815-8cd7-d72d4eb01015\") " pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:17:28.218085 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.217976 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqh55\" (UniqueName: \"kubernetes.io/projected/3f0e46ab-9141-42bb-a494-e96fa6d99107-kube-api-access-nqh55\") pod \"multus-5vxng\" (UID: \"3f0e46ab-9141-42bb-a494-e96fa6d99107\") " pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.218422 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.218396 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-945h8\" (UniqueName: \"kubernetes.io/projected/d71a5cf1-8fe1-48fd-893e-45c15d50f1b6-kube-api-access-945h8\") pod \"tuned-k4tlg\" (UID: \"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6\") " pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.218690 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.218667 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzxph\" (UniqueName: \"kubernetes.io/projected/3af39740-2e0a-41fd-ace2-f375968ce30d-kube-api-access-rzxph\") pod \"multus-additional-cni-plugins-r76sc\" (UID: \"3af39740-2e0a-41fd-ace2-f375968ce30d\") " pod="openshift-multus/multus-additional-cni-plugins-r76sc" Jul 02 00:17:28.219291 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.219265 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kg4s\" (UniqueName: \"kubernetes.io/projected/ceab2e5e-48e7-4018-823a-80838215a715-kube-api-access-5kg4s\") pod \"iptables-alerter-8q2sg\" (UID: \"ceab2e5e-48e7-4018-823a-80838215a715\") " pod="openshift-network-operator/iptables-alerter-8q2sg" Jul 02 00:17:28.219377 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.219258 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsptp\" (UniqueName: \"kubernetes.io/projected/8a8c9b7b-235d-45e2-a810-d0db55313f20-kube-api-access-jsptp\") pod \"node-ca-swljq\" (UID: \"8a8c9b7b-235d-45e2-a810-d0db55313f20\") " pod="openshift-image-registry/node-ca-swljq" Jul 02 00:17:28.219760 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.219743 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5jmm\" (UniqueName: \"kubernetes.io/projected/d32c2993-ca5d-4b91-9051-53784803a737-kube-api-access-c5jmm\") pod \"node-resolver-kcpxt\" (UID: \"d32c2993-ca5d-4b91-9051-53784803a737\") " pod="openshift-dns/node-resolver-kcpxt" Jul 02 00:17:28.220342 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.220324 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbzlc\" (UniqueName: \"kubernetes.io/projected/3ea67bc7-0faa-4fa0-904c-adfea68a4992-kube-api-access-dbzlc\") pod \"ovnkube-node-55kgg\" (UID: \"3ea67bc7-0faa-4fa0-904c-adfea68a4992\") " pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.220423 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.220375 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jkrr\" (UniqueName: \"kubernetes.io/projected/76a7261f-7633-419a-859b-a54d132b6bc0-kube-api-access-6jkrr\") pod \"aws-ebs-csi-driver-node-5w9hs\" (UID: \"76a7261f-7633-419a-859b-a54d132b6bc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w9hs" Jul 02 00:17:28.324716 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.324657 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" Jul 02 00:17:28.332455 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.332438 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hkqlf" Jul 02 00:17:28.334887 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:28.334865 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd71a5cf1_8fe1_48fd_893e_45c15d50f1b6.slice/crio-41785cf975c1a0bc9654bada2fbd5c902a4051f3c505eef3a60a281bd5e70366 WatchSource:0}: Error finding container 41785cf975c1a0bc9654bada2fbd5c902a4051f3c505eef3a60a281bd5e70366: Status 404 returned error can't find the container with id 41785cf975c1a0bc9654bada2fbd5c902a4051f3c505eef3a60a281bd5e70366 Jul 02 00:17:28.340671 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:28.340642 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96851348_608f_48dd_b01d_a88a53cf0ece.slice/crio-165d1447e4abec06a12f78e83da683efe262c2615566e3a3a559aecf16bc32c8 WatchSource:0}: Error finding container 165d1447e4abec06a12f78e83da683efe262c2615566e3a3a559aecf16bc32c8: Status 404 returned error can't find the container with id 165d1447e4abec06a12f78e83da683efe262c2615566e3a3a559aecf16bc32c8 Jul 02 00:17:28.347604 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.347585 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5vxng" Jul 02 00:17:28.352653 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.352637 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 00:17:28.356348 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:28.356320 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f0e46ab_9141_42bb_a494_e96fa6d99107.slice/crio-53a433f4e2ad614f412a06e955de7927a378477ae432d2308a9e70f80d1904ff WatchSource:0}: Error finding container 53a433f4e2ad614f412a06e955de7927a378477ae432d2308a9e70f80d1904ff: Status 404 returned error can't find the container with id 53a433f4e2ad614f412a06e955de7927a378477ae432d2308a9e70f80d1904ff Jul 02 00:17:28.366926 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.366908 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w9hs" Jul 02 00:17:28.374840 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:28.374821 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76a7261f_7633_419a_859b_a54d132b6bc0.slice/crio-215616585d7f6016f216a1c4513b95c11b9f0af3838b58d8d16edcf4cb0da3cf WatchSource:0}: Error finding container 215616585d7f6016f216a1c4513b95c11b9f0af3838b58d8d16edcf4cb0da3cf: Status 404 returned error can't find the container with id 215616585d7f6016f216a1c4513b95c11b9f0af3838b58d8d16edcf4cb0da3cf Jul 02 00:17:28.381093 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.381075 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r76sc" Jul 02 00:17:28.389494 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:28.389470 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3af39740_2e0a_41fd_ace2_f375968ce30d.slice/crio-78a27ac51e101d80381f838af39ecda04c3164405e57a749c7f3b4cf682102a1 WatchSource:0}: Error finding container 78a27ac51e101d80381f838af39ecda04c3164405e57a749c7f3b4cf682102a1: Status 404 returned error can't find the container with id 78a27ac51e101d80381f838af39ecda04c3164405e57a749c7f3b4cf682102a1 Jul 02 00:17:28.394575 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.394557 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kcpxt" Jul 02 00:17:28.402338 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:28.402317 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd32c2993_ca5d_4b91_9051_53784803a737.slice/crio-b9c3c07428faaba14cc67f7d130e5ce5f398807bf778cd2e5e7b0c3bc21537e2 WatchSource:0}: Error finding container b9c3c07428faaba14cc67f7d130e5ce5f398807bf778cd2e5e7b0c3bc21537e2: Status 404 returned error can't find the container with id b9c3c07428faaba14cc67f7d130e5ce5f398807bf778cd2e5e7b0c3bc21537e2 Jul 02 00:17:28.415563 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.415546 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-swljq" Jul 02 00:17:28.423345 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:28.423327 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a8c9b7b_235d_45e2_a810_d0db55313f20.slice/crio-81a2a70e8b9f3a0e0574a11caf8ea3de490740659a710a7a4ecae6b0019a658c WatchSource:0}: Error finding container 81a2a70e8b9f3a0e0574a11caf8ea3de490740659a710a7a4ecae6b0019a658c: Status 404 returned error can't find the container with id 81a2a70e8b9f3a0e0574a11caf8ea3de490740659a710a7a4ecae6b0019a658c Jul 02 00:17:28.431512 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.431494 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8q2sg" Jul 02 00:17:28.436308 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.436289 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:28.440858 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:28.440837 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceab2e5e_48e7_4018_823a_80838215a715.slice/crio-d95a5f19d4bd76c9d809f3929342ffdeaf52d3cded9fddd3d35052508cb989a8 WatchSource:0}: Error finding container d95a5f19d4bd76c9d809f3929342ffdeaf52d3cded9fddd3d35052508cb989a8: Status 404 returned error can't find the container with id d95a5f19d4bd76c9d809f3929342ffdeaf52d3cded9fddd3d35052508cb989a8 Jul 02 00:17:28.445866 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:17:28.445847 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ea67bc7_0faa_4fa0_904c_adfea68a4992.slice/crio-48314c406d3e6c1c232e0c565c8faf6d1547385aeee097aa8fccfc27abb79e46 WatchSource:0}: Error finding container 48314c406d3e6c1c232e0c565c8faf6d1547385aeee097aa8fccfc27abb79e46: Status 404 returned error can't find the container with id 48314c406d3e6c1c232e0c565c8faf6d1547385aeee097aa8fccfc27abb79e46 Jul 02 00:17:28.712527 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.712445 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ca43bb6-818e-4157-a77e-cbe116cdb95e-original-pull-secret\") pod \"global-pull-secret-syncer-9rkkw\" (UID: \"9ca43bb6-818e-4157-a77e-cbe116cdb95e\") " pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:17:28.712659 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.712531 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs\") pod \"network-metrics-daemon-7tkzk\" (UID: \"3c33c8e2-8b03-4815-8cd7-d72d4eb01015\") " pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:17:28.712659 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:28.712582 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 00:17:28.712659 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:28.712639 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 00:17:28.712828 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:28.712669 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ca43bb6-818e-4157-a77e-cbe116cdb95e-original-pull-secret podName:9ca43bb6-818e-4157-a77e-cbe116cdb95e nodeName:}" failed. No retries permitted until 2026-07-02 00:17:29.71264532 +0000 UTC m=+3.128082971 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ca43bb6-818e-4157-a77e-cbe116cdb95e-original-pull-secret") pod "global-pull-secret-syncer-9rkkw" (UID: "9ca43bb6-818e-4157-a77e-cbe116cdb95e") : object "kube-system"/"original-pull-secret" not registered Jul 02 00:17:28.712828 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:28.712694 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs podName:3c33c8e2-8b03-4815-8cd7-d72d4eb01015 nodeName:}" failed. No retries permitted until 2026-07-02 00:17:29.712677272 +0000 UTC m=+3.128114921 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs") pod "network-metrics-daemon-7tkzk" (UID: "3c33c8e2-8b03-4815-8cd7-d72d4eb01015") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 00:17:28.813442 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.813341 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgf8p\" (UniqueName: \"kubernetes.io/projected/fbf366bb-ccd3-4b51-93c2-9949baa79462-kube-api-access-xgf8p\") pod \"network-check-target-jvbq7\" (UID: \"fbf366bb-ccd3-4b51-93c2-9949baa79462\") " pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:17:28.813630 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:28.813563 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 00:17:28.813630 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:28.813587 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 00:17:28.813630 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:28.813600 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xgf8p for pod openshift-network-diagnostics/network-check-target-jvbq7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 00:17:28.813816 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:28.813671 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbf366bb-ccd3-4b51-93c2-9949baa79462-kube-api-access-xgf8p podName:fbf366bb-ccd3-4b51-93c2-9949baa79462 nodeName:}" failed. No retries permitted until 2026-07-02 00:17:29.813650658 +0000 UTC m=+3.229088320 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xgf8p" (UniqueName: "kubernetes.io/projected/fbf366bb-ccd3-4b51-93c2-9949baa79462-kube-api-access-xgf8p") pod "network-check-target-jvbq7" (UID: "fbf366bb-ccd3-4b51-93c2-9949baa79462") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 00:17:28.967517 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:28.967425 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 00:17:29.047234 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:29.046862 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 00:12:28 +0000 UTC" deadline="2028-02-20 06:46:22.831237785 +0000 UTC" Jul 02 00:17:29.047234 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:29.046923 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14358h28m53.784319122s" Jul 02 00:17:29.087913 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:29.087849 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" event={"ID":"3ea67bc7-0faa-4fa0-904c-adfea68a4992","Type":"ContainerStarted","Data":"48314c406d3e6c1c232e0c565c8faf6d1547385aeee097aa8fccfc27abb79e46"} Jul 02 00:17:29.093605 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:29.093509 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8q2sg" event={"ID":"ceab2e5e-48e7-4018-823a-80838215a715","Type":"ContainerStarted","Data":"d95a5f19d4bd76c9d809f3929342ffdeaf52d3cded9fddd3d35052508cb989a8"} Jul 02 00:17:29.107347 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:29.107316 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-swljq" event={"ID":"8a8c9b7b-235d-45e2-a810-d0db55313f20","Type":"ContainerStarted","Data":"81a2a70e8b9f3a0e0574a11caf8ea3de490740659a710a7a4ecae6b0019a658c"} Jul 02 00:17:29.122262 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:29.122234 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w9hs" event={"ID":"76a7261f-7633-419a-859b-a54d132b6bc0","Type":"ContainerStarted","Data":"215616585d7f6016f216a1c4513b95c11b9f0af3838b58d8d16edcf4cb0da3cf"} Jul 02 00:17:29.133229 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:29.133200 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5vxng" event={"ID":"3f0e46ab-9141-42bb-a494-e96fa6d99107","Type":"ContainerStarted","Data":"53a433f4e2ad614f412a06e955de7927a378477ae432d2308a9e70f80d1904ff"} Jul 02 00:17:29.152407 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:29.152305 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hkqlf" event={"ID":"96851348-608f-48dd-b01d-a88a53cf0ece","Type":"ContainerStarted","Data":"165d1447e4abec06a12f78e83da683efe262c2615566e3a3a559aecf16bc32c8"} Jul 02 00:17:29.179956 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:29.179920 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" event={"ID":"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6","Type":"ContainerStarted","Data":"41785cf975c1a0bc9654bada2fbd5c902a4051f3c505eef3a60a281bd5e70366"} Jul 02 00:17:29.193952 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:29.193825 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-30.ec2.internal" event={"ID":"a5117abb60e1ead4ad096e86b336729c","Type":"ContainerStarted","Data":"e0c356cddfa1a075509e31ed2fbf78ab77dafa51fa660527c6ef0431e59295c4"} Jul 02 00:17:29.216221 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:29.216185 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kcpxt" event={"ID":"d32c2993-ca5d-4b91-9051-53784803a737","Type":"ContainerStarted","Data":"b9c3c07428faaba14cc67f7d130e5ce5f398807bf778cd2e5e7b0c3bc21537e2"} Jul 02 00:17:29.235999 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:29.235877 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r76sc" event={"ID":"3af39740-2e0a-41fd-ace2-f375968ce30d","Type":"ContainerStarted","Data":"78a27ac51e101d80381f838af39ecda04c3164405e57a749c7f3b4cf682102a1"} Jul 02 00:17:29.257289 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:29.257253 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-30.ec2.internal" event={"ID":"557f70546d4dabad259953de7405c2f1","Type":"ContainerStarted","Data":"367bb42bd0cf529808fcf2a1a506fdb611461e5d8af186abd037551e66d5a1c3"} Jul 02 00:17:29.694934 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:29.694850 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 00:17:29.724722 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:29.724660 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs\") pod \"network-metrics-daemon-7tkzk\" (UID: \"3c33c8e2-8b03-4815-8cd7-d72d4eb01015\") " pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:17:29.724905 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:29.724729 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ca43bb6-818e-4157-a77e-cbe116cdb95e-original-pull-secret\") pod \"global-pull-secret-syncer-9rkkw\" (UID: \"9ca43bb6-818e-4157-a77e-cbe116cdb95e\") " pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:17:29.724979 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:29.724959 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 00:17:29.725050 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:29.725025 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ca43bb6-818e-4157-a77e-cbe116cdb95e-original-pull-secret podName:9ca43bb6-818e-4157-a77e-cbe116cdb95e nodeName:}" failed. No retries permitted until 2026-07-02 00:17:31.725005439 +0000 UTC m=+5.140443088 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ca43bb6-818e-4157-a77e-cbe116cdb95e-original-pull-secret") pod "global-pull-secret-syncer-9rkkw" (UID: "9ca43bb6-818e-4157-a77e-cbe116cdb95e") : object "kube-system"/"original-pull-secret" not registered Jul 02 00:17:29.725524 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:29.725432 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 00:17:29.725524 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:29.725490 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs podName:3c33c8e2-8b03-4815-8cd7-d72d4eb01015 nodeName:}" failed. No retries permitted until 2026-07-02 00:17:31.725472203 +0000 UTC m=+5.140909853 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs") pod "network-metrics-daemon-7tkzk" (UID: "3c33c8e2-8b03-4815-8cd7-d72d4eb01015") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 00:17:29.825153 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:29.825115 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgf8p\" (UniqueName: \"kubernetes.io/projected/fbf366bb-ccd3-4b51-93c2-9949baa79462-kube-api-access-xgf8p\") pod \"network-check-target-jvbq7\" (UID: \"fbf366bb-ccd3-4b51-93c2-9949baa79462\") " pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:17:29.825345 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:29.825296 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 00:17:29.825345 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:29.825319 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 00:17:29.825345 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:29.825332 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xgf8p for pod openshift-network-diagnostics/network-check-target-jvbq7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 00:17:29.825545 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:29.825390 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbf366bb-ccd3-4b51-93c2-9949baa79462-kube-api-access-xgf8p podName:fbf366bb-ccd3-4b51-93c2-9949baa79462 nodeName:}" failed. No retries permitted until 2026-07-02 00:17:31.82537153 +0000 UTC m=+5.240809180 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xgf8p" (UniqueName: "kubernetes.io/projected/fbf366bb-ccd3-4b51-93c2-9949baa79462-kube-api-access-xgf8p") pod "network-check-target-jvbq7" (UID: "fbf366bb-ccd3-4b51-93c2-9949baa79462") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 00:17:30.047402 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:30.047304 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 00:12:28 +0000 UTC" deadline="2027-12-21 22:27:28.189932912 +0000 UTC" Jul 02 00:17:30.047402 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:30.047348 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12910h9m58.142591412s" Jul 02 00:17:30.061009 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:30.060967 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:17:30.061138 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:30.061091 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rkkw" podUID="9ca43bb6-818e-4157-a77e-cbe116cdb95e" Jul 02 00:17:30.061545 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:30.061521 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:17:30.061673 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:30.061648 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jvbq7" podUID="fbf366bb-ccd3-4b51-93c2-9949baa79462" Jul 02 00:17:30.061737 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:30.061696 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:17:30.061805 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:30.061783 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tkzk" podUID="3c33c8e2-8b03-4815-8cd7-d72d4eb01015" Jul 02 00:17:30.765358 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:30.765326 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 00:17:31.742723 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:31.742684 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ca43bb6-818e-4157-a77e-cbe116cdb95e-original-pull-secret\") pod \"global-pull-secret-syncer-9rkkw\" (UID: \"9ca43bb6-818e-4157-a77e-cbe116cdb95e\") " pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:17:31.743213 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:31.742762 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs\") pod \"network-metrics-daemon-7tkzk\" (UID: \"3c33c8e2-8b03-4815-8cd7-d72d4eb01015\") " pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:17:31.743213 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:31.742917 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 00:17:31.743213 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:31.743006 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs podName:3c33c8e2-8b03-4815-8cd7-d72d4eb01015 nodeName:}" failed. No retries permitted until 2026-07-02 00:17:35.742972001 +0000 UTC m=+9.158409672 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs") pod "network-metrics-daemon-7tkzk" (UID: "3c33c8e2-8b03-4815-8cd7-d72d4eb01015") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 00:17:31.743457 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:31.743422 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 00:17:31.743571 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:31.743515 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ca43bb6-818e-4157-a77e-cbe116cdb95e-original-pull-secret podName:9ca43bb6-818e-4157-a77e-cbe116cdb95e nodeName:}" failed. No retries permitted until 2026-07-02 00:17:35.743483901 +0000 UTC m=+9.158921568 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ca43bb6-818e-4157-a77e-cbe116cdb95e-original-pull-secret") pod "global-pull-secret-syncer-9rkkw" (UID: "9ca43bb6-818e-4157-a77e-cbe116cdb95e") : object "kube-system"/"original-pull-secret" not registered Jul 02 00:17:31.844366 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:31.844318 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgf8p\" (UniqueName: \"kubernetes.io/projected/fbf366bb-ccd3-4b51-93c2-9949baa79462-kube-api-access-xgf8p\") pod \"network-check-target-jvbq7\" (UID: \"fbf366bb-ccd3-4b51-93c2-9949baa79462\") " pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:17:31.853484 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:31.853200 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 00:17:31.853484 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:31.853235 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 00:17:31.853484 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:31.853250 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xgf8p for pod openshift-network-diagnostics/network-check-target-jvbq7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 00:17:31.853484 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:31.853337 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbf366bb-ccd3-4b51-93c2-9949baa79462-kube-api-access-xgf8p podName:fbf366bb-ccd3-4b51-93c2-9949baa79462 nodeName:}" failed. No retries permitted until 2026-07-02 00:17:35.853315238 +0000 UTC m=+9.268752902 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xgf8p" (UniqueName: "kubernetes.io/projected/fbf366bb-ccd3-4b51-93c2-9949baa79462-kube-api-access-xgf8p") pod "network-check-target-jvbq7" (UID: "fbf366bb-ccd3-4b51-93c2-9949baa79462") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 00:17:32.061080 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:32.060998 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:17:32.061243 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:32.061144 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tkzk" podUID="3c33c8e2-8b03-4815-8cd7-d72d4eb01015" Jul 02 00:17:32.061642 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:32.061617 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:17:32.061772 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:32.061728 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rkkw" podUID="9ca43bb6-818e-4157-a77e-cbe116cdb95e" Jul 02 00:17:32.061871 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:32.061794 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:17:32.061926 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:32.061902 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jvbq7" podUID="fbf366bb-ccd3-4b51-93c2-9949baa79462" Jul 02 00:17:34.060998 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:34.060826 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:17:34.060998 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:34.060964 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rkkw" podUID="9ca43bb6-818e-4157-a77e-cbe116cdb95e" Jul 02 00:17:34.061553 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:34.061060 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:17:34.061553 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:34.061174 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jvbq7" podUID="fbf366bb-ccd3-4b51-93c2-9949baa79462" Jul 02 00:17:34.061553 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:34.061226 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:17:34.061553 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:34.061313 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tkzk" podUID="3c33c8e2-8b03-4815-8cd7-d72d4eb01015" Jul 02 00:17:35.776059 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:35.776022 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ca43bb6-818e-4157-a77e-cbe116cdb95e-original-pull-secret\") pod \"global-pull-secret-syncer-9rkkw\" (UID: \"9ca43bb6-818e-4157-a77e-cbe116cdb95e\") " pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:17:35.776471 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:35.776079 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs\") pod \"network-metrics-daemon-7tkzk\" (UID: \"3c33c8e2-8b03-4815-8cd7-d72d4eb01015\") " pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:17:35.776471 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:35.776166 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 00:17:35.776471 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:35.776173 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 00:17:35.776471 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:35.776230 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs podName:3c33c8e2-8b03-4815-8cd7-d72d4eb01015 nodeName:}" failed. No retries permitted until 2026-07-02 00:17:43.77621097 +0000 UTC m=+17.191648617 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs") pod "network-metrics-daemon-7tkzk" (UID: "3c33c8e2-8b03-4815-8cd7-d72d4eb01015") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 00:17:35.776471 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:35.776250 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ca43bb6-818e-4157-a77e-cbe116cdb95e-original-pull-secret podName:9ca43bb6-818e-4157-a77e-cbe116cdb95e nodeName:}" failed. No retries permitted until 2026-07-02 00:17:43.776240169 +0000 UTC m=+17.191677821 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ca43bb6-818e-4157-a77e-cbe116cdb95e-original-pull-secret") pod "global-pull-secret-syncer-9rkkw" (UID: "9ca43bb6-818e-4157-a77e-cbe116cdb95e") : object "kube-system"/"original-pull-secret" not registered Jul 02 00:17:35.877294 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:35.877258 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgf8p\" (UniqueName: \"kubernetes.io/projected/fbf366bb-ccd3-4b51-93c2-9949baa79462-kube-api-access-xgf8p\") pod \"network-check-target-jvbq7\" (UID: \"fbf366bb-ccd3-4b51-93c2-9949baa79462\") " pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:17:35.877500 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:35.877451 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 00:17:35.877500 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:35.877474 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 00:17:35.877500 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:35.877487 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xgf8p for pod openshift-network-diagnostics/network-check-target-jvbq7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 00:17:35.877668 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:35.877553 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbf366bb-ccd3-4b51-93c2-9949baa79462-kube-api-access-xgf8p podName:fbf366bb-ccd3-4b51-93c2-9949baa79462 nodeName:}" failed. No retries permitted until 2026-07-02 00:17:43.87753393 +0000 UTC m=+17.292971588 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xgf8p" (UniqueName: "kubernetes.io/projected/fbf366bb-ccd3-4b51-93c2-9949baa79462-kube-api-access-xgf8p") pod "network-check-target-jvbq7" (UID: "fbf366bb-ccd3-4b51-93c2-9949baa79462") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 00:17:36.061487 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:36.061243 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:17:36.061487 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:36.061282 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:17:36.061487 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:36.061284 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:17:36.061487 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:36.061386 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tkzk" podUID="3c33c8e2-8b03-4815-8cd7-d72d4eb01015" Jul 02 00:17:36.061799 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:36.061474 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rkkw" podUID="9ca43bb6-818e-4157-a77e-cbe116cdb95e" Jul 02 00:17:36.061799 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:36.061537 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jvbq7" podUID="fbf366bb-ccd3-4b51-93c2-9949baa79462" Jul 02 00:17:38.060963 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:38.060923 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:17:38.060963 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:38.060956 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:17:38.061552 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:38.061065 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jvbq7" podUID="fbf366bb-ccd3-4b51-93c2-9949baa79462" Jul 02 00:17:38.061552 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:38.061144 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tkzk" podUID="3c33c8e2-8b03-4815-8cd7-d72d4eb01015" Jul 02 00:17:38.061552 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:38.061209 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:17:38.061552 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:38.061296 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rkkw" podUID="9ca43bb6-818e-4157-a77e-cbe116cdb95e" Jul 02 00:17:40.060777 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:40.060747 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:17:40.060777 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:40.060771 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:17:40.061240 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:40.060875 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:17:40.061240 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:40.060889 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tkzk" podUID="3c33c8e2-8b03-4815-8cd7-d72d4eb01015" Jul 02 00:17:40.061240 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:40.060997 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rkkw" podUID="9ca43bb6-818e-4157-a77e-cbe116cdb95e" Jul 02 00:17:40.061240 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:40.061079 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jvbq7" podUID="fbf366bb-ccd3-4b51-93c2-9949baa79462" Jul 02 00:17:42.061382 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:42.061347 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:17:42.061866 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:42.061347 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:17:42.061866 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:42.061452 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jvbq7" podUID="fbf366bb-ccd3-4b51-93c2-9949baa79462" Jul 02 00:17:42.061866 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:42.061567 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tkzk" podUID="3c33c8e2-8b03-4815-8cd7-d72d4eb01015" Jul 02 00:17:42.061866 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:42.061351 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:17:42.061866 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:42.061679 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rkkw" podUID="9ca43bb6-818e-4157-a77e-cbe116cdb95e" Jul 02 00:17:43.837279 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:43.837245 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ca43bb6-818e-4157-a77e-cbe116cdb95e-original-pull-secret\") pod \"global-pull-secret-syncer-9rkkw\" (UID: \"9ca43bb6-818e-4157-a77e-cbe116cdb95e\") " pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:17:43.837739 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:43.837309 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs\") pod \"network-metrics-daemon-7tkzk\" (UID: \"3c33c8e2-8b03-4815-8cd7-d72d4eb01015\") " pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:17:43.837739 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:43.837396 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 00:17:43.837739 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:43.837439 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 00:17:43.837739 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:43.837475 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ca43bb6-818e-4157-a77e-cbe116cdb95e-original-pull-secret podName:9ca43bb6-818e-4157-a77e-cbe116cdb95e nodeName:}" failed. No retries permitted until 2026-07-02 00:17:59.837458015 +0000 UTC m=+33.252895665 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ca43bb6-818e-4157-a77e-cbe116cdb95e-original-pull-secret") pod "global-pull-secret-syncer-9rkkw" (UID: "9ca43bb6-818e-4157-a77e-cbe116cdb95e") : object "kube-system"/"original-pull-secret" not registered Jul 02 00:17:43.837739 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:43.837496 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs podName:3c33c8e2-8b03-4815-8cd7-d72d4eb01015 nodeName:}" failed. No retries permitted until 2026-07-02 00:17:59.837487083 +0000 UTC m=+33.252924736 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs") pod "network-metrics-daemon-7tkzk" (UID: "3c33c8e2-8b03-4815-8cd7-d72d4eb01015") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 00:17:43.938566 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:43.938535 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgf8p\" (UniqueName: \"kubernetes.io/projected/fbf366bb-ccd3-4b51-93c2-9949baa79462-kube-api-access-xgf8p\") pod \"network-check-target-jvbq7\" (UID: \"fbf366bb-ccd3-4b51-93c2-9949baa79462\") " pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:17:43.938737 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:43.938663 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 00:17:43.938737 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:43.938682 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 00:17:43.938737 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:43.938691 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xgf8p for pod openshift-network-diagnostics/network-check-target-jvbq7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 00:17:43.938737 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:43.938737 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbf366bb-ccd3-4b51-93c2-9949baa79462-kube-api-access-xgf8p podName:fbf366bb-ccd3-4b51-93c2-9949baa79462 nodeName:}" failed. No retries permitted until 2026-07-02 00:17:59.938725695 +0000 UTC m=+33.354163341 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xgf8p" (UniqueName: "kubernetes.io/projected/fbf366bb-ccd3-4b51-93c2-9949baa79462-kube-api-access-xgf8p") pod "network-check-target-jvbq7" (UID: "fbf366bb-ccd3-4b51-93c2-9949baa79462") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 00:17:44.060538 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:44.060499 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:17:44.060708 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:44.060499 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:17:44.060708 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:44.060619 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jvbq7" podUID="fbf366bb-ccd3-4b51-93c2-9949baa79462" Jul 02 00:17:44.060708 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:44.060692 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tkzk" podUID="3c33c8e2-8b03-4815-8cd7-d72d4eb01015" Jul 02 00:17:44.060846 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:44.060499 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:17:44.060846 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:44.060780 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rkkw" podUID="9ca43bb6-818e-4157-a77e-cbe116cdb95e" Jul 02 00:17:46.061176 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:46.060963 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:17:46.061681 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:46.061022 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:17:46.061681 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:46.061277 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jvbq7" podUID="fbf366bb-ccd3-4b51-93c2-9949baa79462" Jul 02 00:17:46.061681 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:46.061374 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tkzk" podUID="3c33c8e2-8b03-4815-8cd7-d72d4eb01015" Jul 02 00:17:46.061681 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:46.061027 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:17:46.061681 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:46.061520 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rkkw" podUID="9ca43bb6-818e-4157-a77e-cbe116cdb95e" Jul 02 00:17:48.060578 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:48.060544 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:17:48.060929 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:48.060641 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:17:48.060929 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:48.060649 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rkkw" podUID="9ca43bb6-818e-4157-a77e-cbe116cdb95e" Jul 02 00:17:48.060929 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:48.060664 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:17:48.060929 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:48.060727 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jvbq7" podUID="fbf366bb-ccd3-4b51-93c2-9949baa79462" Jul 02 00:17:48.060929 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:48.060789 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tkzk" podUID="3c33c8e2-8b03-4815-8cd7-d72d4eb01015" Jul 02 00:17:49.308744 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:49.308535 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55kgg_3ea67bc7-0faa-4fa0-904c-adfea68a4992/ovn-acl-logging/0.log" Jul 02 00:17:49.309529 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:49.309053 2581 generic.go:356] "Generic (PLEG): container finished" podID="3ea67bc7-0faa-4fa0-904c-adfea68a4992" containerID="fd3af67efad4f21d724d2feadcee559648946bece0c6b2f68869a7665486a361" exitCode=1 Jul 02 00:17:49.309529 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:49.309090 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" event={"ID":"3ea67bc7-0faa-4fa0-904c-adfea68a4992","Type":"ContainerStarted","Data":"94b75d80f2b7949a059f80de6c37613d32421ed0b4e65d122cdf8114c0cca0fb"} Jul 02 00:17:49.309529 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:49.309159 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" event={"ID":"3ea67bc7-0faa-4fa0-904c-adfea68a4992","Type":"ContainerStarted","Data":"59057e66336c6bcd2640fa3ab3f24530a5b1dfb1d6e8c1f03cec96c6570bbdb8"} Jul 02 00:17:49.309529 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:49.309208 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" event={"ID":"3ea67bc7-0faa-4fa0-904c-adfea68a4992","Type":"ContainerStarted","Data":"0675f4000a62958db084f19cb4766ce7a7fd3bb517be4f23a1eb17d074458d22"} Jul 02 00:17:49.309529 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:49.309255 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" event={"ID":"3ea67bc7-0faa-4fa0-904c-adfea68a4992","Type":"ContainerStarted","Data":"ffde7ed03ad46168894180e755407e6359b30c0320d1b5cac67f71ec68268ee9"} Jul 02 00:17:49.309529 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:49.309286 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" event={"ID":"3ea67bc7-0faa-4fa0-904c-adfea68a4992","Type":"ContainerDied","Data":"fd3af67efad4f21d724d2feadcee559648946bece0c6b2f68869a7665486a361"} Jul 02 00:17:49.309529 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:49.309334 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" event={"ID":"3ea67bc7-0faa-4fa0-904c-adfea68a4992","Type":"ContainerStarted","Data":"5b51740b332afebb15e16288b347bbe69c99bcac7b3333b62ad0aab590e4560b"} Jul 02 00:17:49.310769 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:49.310739 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-swljq" event={"ID":"8a8c9b7b-235d-45e2-a810-d0db55313f20","Type":"ContainerStarted","Data":"27a02d307d44026885cc414769c6d80a846efb29cd3a291d555c5f7e8d6c94ec"} Jul 02 00:17:49.312371 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:49.312344 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w9hs" event={"ID":"76a7261f-7633-419a-859b-a54d132b6bc0","Type":"ContainerStarted","Data":"3d636a1f1ff3e29dc16159b02880c408ee5a588f19154b7dda4105e5c2408cb5"} Jul 02 00:17:49.313937 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:49.313915 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5vxng" event={"ID":"3f0e46ab-9141-42bb-a494-e96fa6d99107","Type":"ContainerStarted","Data":"269125da84555ede1ffde189fea889267ab1d523bb0e6a511f07747b099546b8"} Jul 02 00:17:49.315573 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:49.315549 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hkqlf" event={"ID":"96851348-608f-48dd-b01d-a88a53cf0ece","Type":"ContainerStarted","Data":"74c8e6b2d902a36e30b78d42d63081b9ff7dc06a8b912654791e10be17f25dcc"} Jul 02 00:17:49.317013 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:49.316991 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" event={"ID":"d71a5cf1-8fe1-48fd-893e-45c15d50f1b6","Type":"ContainerStarted","Data":"0691971ac76aef496f77feab9646a404d037a4d5e04b7cde92b1a10704a99e98"} Jul 02 00:17:49.318514 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:49.318492 2581 generic.go:356] "Generic (PLEG): container finished" podID="a5117abb60e1ead4ad096e86b336729c" containerID="bd1cd590ff014270954e256af0e7b0ce8ebde6626887ef6d85da0c1505114aab" exitCode=0 Jul 02 00:17:49.318610 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:49.318556 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-30.ec2.internal" event={"ID":"a5117abb60e1ead4ad096e86b336729c","Type":"ContainerDied","Data":"bd1cd590ff014270954e256af0e7b0ce8ebde6626887ef6d85da0c1505114aab"} Jul 02 00:17:49.320091 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:49.320048 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kcpxt" event={"ID":"d32c2993-ca5d-4b91-9051-53784803a737","Type":"ContainerStarted","Data":"52ea12c063120eaf029e2dbf1a93d586a21355d1c1a6c90191942a3778497664"} Jul 02 00:17:49.321854 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:49.321809 2581 generic.go:356] "Generic (PLEG): container finished" podID="3af39740-2e0a-41fd-ace2-f375968ce30d" containerID="2a21c339c3f5cd38a7f437ae485e2fe4bee254af96af76460af3aaae26cf228e" exitCode=0 Jul 02 00:17:49.321854 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:49.321838 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r76sc" event={"ID":"3af39740-2e0a-41fd-ace2-f375968ce30d","Type":"ContainerDied","Data":"2a21c339c3f5cd38a7f437ae485e2fe4bee254af96af76460af3aaae26cf228e"} Jul 02 00:17:49.323600 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:49.323570 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-30.ec2.internal" event={"ID":"557f70546d4dabad259953de7405c2f1","Type":"ContainerStarted","Data":"9ee4ade6bf6c42aab11e44274c23408d92b5748bf40372d61fb40a937e1b919c"} Jul 02 00:17:49.327892 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:49.327851 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-swljq" podStartSLOduration=2.385784126 podStartE2EDuration="22.327840507s" totalImagesPullingTime="19.942056381s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 00:17:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:17:49.327677527 +0000 UTC m=+22.743115195" watchObservedRunningTime="2026-07-02 00:17:49.327840507 +0000 UTC m=+22.743278175" Jul 02 00:17:49.359353 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:49.359319 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-k4tlg" podStartSLOduration=2.273311809 podStartE2EDuration="22.359306948s" totalImagesPullingTime="20.085995139s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 00:17:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:17:49.359025073 +0000 UTC m=+22.774462740" watchObservedRunningTime="2026-07-02 00:17:49.359306948 +0000 UTC m=+22.774744612" Jul 02 00:17:49.378564 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:49.378037 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5vxng" podStartSLOduration=2.258088386 podStartE2EDuration="22.378021206s" totalImagesPullingTime="20.11993282s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 00:17:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:17:49.377347764 +0000 UTC m=+22.792785433" watchObservedRunningTime="2026-07-02 00:17:49.378021206 +0000 UTC m=+22.793458874" Jul 02 00:17:49.405688 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:49.403616 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kcpxt" podStartSLOduration=2.3866493970000002 podStartE2EDuration="22.403598313s" totalImagesPullingTime="20.016948916s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 00:17:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:17:49.402910785 +0000 UTC m=+22.818348463" watchObservedRunningTime="2026-07-02 00:17:49.403598313 +0000 UTC m=+22.819035980" Jul 02 00:17:49.419380 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:49.419342 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-30.ec2.internal" podStartSLOduration=21.419328806 podStartE2EDuration="21.419328806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 00:17:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:17:49.419013866 +0000 UTC m=+22.834451535" watchObservedRunningTime="2026-07-02 00:17:49.419328806 +0000 UTC m=+22.834766472" Jul 02 00:17:49.435925 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:49.435890 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hkqlf" podStartSLOduration=6.469192287 podStartE2EDuration="22.435876397s" totalImagesPullingTime="15.96668411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:17:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:17:49.435821964 +0000 UTC m=+22.851259633" watchObservedRunningTime="2026-07-02 00:17:49.435876397 +0000 UTC m=+22.851314055" Jul 02 00:17:50.060808 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:50.060781 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:17:50.060939 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:50.060825 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:17:50.060939 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:50.060880 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:17:50.060939 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:50.060896 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rkkw" podUID="9ca43bb6-818e-4157-a77e-cbe116cdb95e" Jul 02 00:17:50.061103 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:50.060990 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tkzk" podUID="3c33c8e2-8b03-4815-8cd7-d72d4eb01015" Jul 02 00:17:50.061103 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:50.061075 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jvbq7" podUID="fbf366bb-ccd3-4b51-93c2-9949baa79462" Jul 02 00:17:50.085828 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:50.085804 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 00:17:50.328223 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:50.328134 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w9hs" event={"ID":"76a7261f-7633-419a-859b-a54d132b6bc0","Type":"ContainerStarted","Data":"190413a10773fef8385f761dd617a1065fc5d9dd34b399f3c32552cf3d68f502"} Jul 02 00:17:50.330026 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:50.329993 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-30.ec2.internal" event={"ID":"a5117abb60e1ead4ad096e86b336729c","Type":"ContainerStarted","Data":"0bda71b6b59e9f200463b14a228043bceae43374c1421a93de336b361016e262"} Jul 02 00:17:50.331800 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:50.331645 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8q2sg" event={"ID":"ceab2e5e-48e7-4018-823a-80838215a715","Type":"ContainerStarted","Data":"7be640fd8c815e996f84a6348005d28dc9b64706e17d08a15fd0341812811dbf"} Jul 02 00:17:50.357154 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:50.357115 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8q2sg" podStartSLOduration=3.497135419 podStartE2EDuration="23.357100781s" totalImagesPullingTime="19.859965362s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 00:17:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:17:50.35696734 +0000 UTC m=+23.772405010" watchObservedRunningTime="2026-07-02 00:17:50.357100781 +0000 UTC m=+23.772538447" Jul 02 00:17:50.357443 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:50.357406 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-30.ec2.internal" podStartSLOduration=22.357401609 podStartE2EDuration="22.357401609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 00:17:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:17:50.344142553 +0000 UTC m=+23.759580223" watchObservedRunningTime="2026-07-02 00:17:50.357401609 +0000 UTC m=+23.772839276" Jul 02 00:17:51.064968 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:51.064880 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T00:17:50.085824793Z","UUID":"1b17c9c5-16a5-4df9-96b8-a91742512e94","Handler":null,"Name":"","Endpoint":""} Jul 02 00:17:51.066528 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:51.066508 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 00:17:51.066651 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:51.066548 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 00:17:51.805844 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:51.805760 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hkqlf" Jul 02 00:17:51.806403 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:51.806382 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hkqlf" Jul 02 00:17:52.061349 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:52.061268 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:17:52.061349 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:52.061303 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:17:52.061349 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:52.061309 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:17:52.061637 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:52.061387 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rkkw" podUID="9ca43bb6-818e-4157-a77e-cbe116cdb95e" Jul 02 00:17:52.061637 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:52.061496 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jvbq7" podUID="fbf366bb-ccd3-4b51-93c2-9949baa79462" Jul 02 00:17:52.061637 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:52.061583 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tkzk" podUID="3c33c8e2-8b03-4815-8cd7-d72d4eb01015" Jul 02 00:17:52.338817 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:52.338751 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55kgg_3ea67bc7-0faa-4fa0-904c-adfea68a4992/ovn-acl-logging/0.log" Jul 02 00:17:52.339125 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:52.339093 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" event={"ID":"3ea67bc7-0faa-4fa0-904c-adfea68a4992","Type":"ContainerStarted","Data":"cc82d99ea172f8838e1d6af4250b3940394afa6de7f4b1afc9995b2cea1c45cf"} Jul 02 00:17:52.340906 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:52.340876 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w9hs" event={"ID":"76a7261f-7633-419a-859b-a54d132b6bc0","Type":"ContainerStarted","Data":"0f37c16358f4f109f63ed216a7dceed81ad87fdf550fda9b6207d0157f5f042f"} Jul 02 00:17:52.341178 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:52.341159 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hkqlf" Jul 02 00:17:52.341466 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:52.341450 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hkqlf" Jul 02 00:17:52.370641 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:52.370606 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w9hs" podStartSLOduration=3.06306492 podStartE2EDuration="25.370594304s" totalImagesPullingTime="22.307529384s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 00:17:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:17:52.356951656 +0000 UTC m=+25.772389322" watchObservedRunningTime="2026-07-02 00:17:52.370594304 +0000 UTC m=+25.786032010" Jul 02 00:17:54.061013 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:54.060905 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:17:54.061521 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:54.060957 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:17:54.061521 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:54.061085 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jvbq7" podUID="fbf366bb-ccd3-4b51-93c2-9949baa79462" Jul 02 00:17:54.061521 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:54.061158 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rkkw" podUID="9ca43bb6-818e-4157-a77e-cbe116cdb95e" Jul 02 00:17:54.061521 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:54.060958 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:17:54.061521 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:54.061235 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tkzk" podUID="3c33c8e2-8b03-4815-8cd7-d72d4eb01015" Jul 02 00:17:54.348358 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:54.348337 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55kgg_3ea67bc7-0faa-4fa0-904c-adfea68a4992/ovn-acl-logging/0.log" Jul 02 00:17:54.348776 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:54.348754 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" event={"ID":"3ea67bc7-0faa-4fa0-904c-adfea68a4992","Type":"ContainerStarted","Data":"efc948b7b1fc04d7555fe5820bac3a6b4460842d7600452c16a09bb85facc93a"} Jul 02 00:17:54.348993 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:54.348973 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:54.349184 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:54.349169 2581 scope.go:117] "RemoveContainer" containerID="fd3af67efad4f21d724d2feadcee559648946bece0c6b2f68869a7665486a361" Jul 02 00:17:54.350810 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:54.350789 2581 generic.go:356] "Generic (PLEG): container finished" podID="3af39740-2e0a-41fd-ace2-f375968ce30d" containerID="a57731d19bfdd127f0e76bfd2b0a49d26716c353f578f1e77d0aeeafa8bcda28" exitCode=0 Jul 02 00:17:54.350901 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:54.350864 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r76sc" event={"ID":"3af39740-2e0a-41fd-ace2-f375968ce30d","Type":"ContainerDied","Data":"a57731d19bfdd127f0e76bfd2b0a49d26716c353f578f1e77d0aeeafa8bcda28"} Jul 02 00:17:54.365795 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:54.365776 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:55.356202 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:55.356178 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55kgg_3ea67bc7-0faa-4fa0-904c-adfea68a4992/ovn-acl-logging/0.log" Jul 02 00:17:55.356780 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:55.356542 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" event={"ID":"3ea67bc7-0faa-4fa0-904c-adfea68a4992","Type":"ContainerStarted","Data":"1b63bb4483a659972093953eecb3cffa9cc05888c37e5a7c5061829493c290ec"} Jul 02 00:17:55.356852 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:55.356838 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:55.356923 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:55.356909 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:55.371296 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:55.371271 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:17:55.384315 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:55.384279 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" podStartSLOduration=7.391999562 podStartE2EDuration="27.384267075s" totalImagesPullingTime="19.992267513s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 00:17:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:17:55.382485033 +0000 UTC m=+28.797922699" watchObservedRunningTime="2026-07-02 00:17:55.384267075 +0000 UTC m=+28.799704748" Jul 02 00:17:56.061314 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:56.061239 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:17:56.061314 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:56.061273 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:17:56.061532 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:56.061348 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:17:56.061532 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:56.061350 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rkkw" podUID="9ca43bb6-818e-4157-a77e-cbe116cdb95e" Jul 02 00:17:56.061532 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:56.061431 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jvbq7" podUID="fbf366bb-ccd3-4b51-93c2-9949baa79462" Jul 02 00:17:56.061532 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:56.061493 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tkzk" podUID="3c33c8e2-8b03-4815-8cd7-d72d4eb01015" Jul 02 00:17:56.144626 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:56.144591 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9rkkw"] Jul 02 00:17:56.148808 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:56.148769 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7tkzk"] Jul 02 00:17:56.149450 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:56.149403 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jvbq7"] Jul 02 00:17:56.361310 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:56.361203 2581 generic.go:356] "Generic (PLEG): container finished" podID="3af39740-2e0a-41fd-ace2-f375968ce30d" containerID="d796fe00fad1c3cde7ade9e2270d42c055dc58a5c4eacced85672ac7bfef3b99" exitCode=0 Jul 02 00:17:56.361709 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:56.361326 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r76sc" event={"ID":"3af39740-2e0a-41fd-ace2-f375968ce30d","Type":"ContainerDied","Data":"d796fe00fad1c3cde7ade9e2270d42c055dc58a5c4eacced85672ac7bfef3b99"} Jul 02 00:17:56.361709 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:56.361353 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:17:56.361709 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:56.361334 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:17:56.361709 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:56.361370 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:17:56.361709 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:56.361474 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rkkw" podUID="9ca43bb6-818e-4157-a77e-cbe116cdb95e" Jul 02 00:17:56.361709 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:56.361597 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jvbq7" podUID="fbf366bb-ccd3-4b51-93c2-9949baa79462" Jul 02 00:17:56.362114 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:56.362019 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tkzk" podUID="3c33c8e2-8b03-4815-8cd7-d72d4eb01015" Jul 02 00:17:58.060451 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:58.060405 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:17:58.060871 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:58.060537 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:17:58.060871 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:58.060545 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rkkw" podUID="9ca43bb6-818e-4157-a77e-cbe116cdb95e" Jul 02 00:17:58.060871 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:58.060580 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:17:58.060871 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:58.060755 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tkzk" podUID="3c33c8e2-8b03-4815-8cd7-d72d4eb01015" Jul 02 00:17:58.060871 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:58.060855 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jvbq7" podUID="fbf366bb-ccd3-4b51-93c2-9949baa79462" Jul 02 00:17:58.368051 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:58.367974 2581 generic.go:356] "Generic (PLEG): container finished" podID="3af39740-2e0a-41fd-ace2-f375968ce30d" containerID="8fc5a1645b890122b66a4461ae547d77650a7c5497265517f26304f4075b4553" exitCode=0 Jul 02 00:17:58.368051 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:58.368043 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r76sc" event={"ID":"3af39740-2e0a-41fd-ace2-f375968ce30d","Type":"ContainerDied","Data":"8fc5a1645b890122b66a4461ae547d77650a7c5497265517f26304f4075b4553"} Jul 02 00:17:59.866985 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:59.866774 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs\") pod \"network-metrics-daemon-7tkzk\" (UID: \"3c33c8e2-8b03-4815-8cd7-d72d4eb01015\") " pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:17:59.867395 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:59.867029 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ca43bb6-818e-4157-a77e-cbe116cdb95e-original-pull-secret\") pod \"global-pull-secret-syncer-9rkkw\" (UID: \"9ca43bb6-818e-4157-a77e-cbe116cdb95e\") " pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:17:59.867395 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:59.866927 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 00:17:59.867395 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:59.867110 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs podName:3c33c8e2-8b03-4815-8cd7-d72d4eb01015 nodeName:}" failed. No retries permitted until 2026-07-02 00:18:31.867093173 +0000 UTC m=+65.282530819 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs") pod "network-metrics-daemon-7tkzk" (UID: "3c33c8e2-8b03-4815-8cd7-d72d4eb01015") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 00:17:59.867395 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:59.867135 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 00:17:59.867395 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:59.867174 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ca43bb6-818e-4157-a77e-cbe116cdb95e-original-pull-secret podName:9ca43bb6-818e-4157-a77e-cbe116cdb95e nodeName:}" failed. No retries permitted until 2026-07-02 00:18:31.867162781 +0000 UTC m=+65.282600443 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ca43bb6-818e-4157-a77e-cbe116cdb95e-original-pull-secret") pod "global-pull-secret-syncer-9rkkw" (UID: "9ca43bb6-818e-4157-a77e-cbe116cdb95e") : object "kube-system"/"original-pull-secret" not registered Jul 02 00:17:59.968192 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:17:59.968162 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgf8p\" (UniqueName: \"kubernetes.io/projected/fbf366bb-ccd3-4b51-93c2-9949baa79462-kube-api-access-xgf8p\") pod \"network-check-target-jvbq7\" (UID: \"fbf366bb-ccd3-4b51-93c2-9949baa79462\") " pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:17:59.968369 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:59.968337 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 00:17:59.968369 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:59.968355 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 00:17:59.968369 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:59.968368 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xgf8p for pod openshift-network-diagnostics/network-check-target-jvbq7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 00:17:59.968535 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:17:59.968440 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbf366bb-ccd3-4b51-93c2-9949baa79462-kube-api-access-xgf8p podName:fbf366bb-ccd3-4b51-93c2-9949baa79462 nodeName:}" failed. No retries permitted until 2026-07-02 00:18:31.968409695 +0000 UTC m=+65.383847343 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xgf8p" (UniqueName: "kubernetes.io/projected/fbf366bb-ccd3-4b51-93c2-9949baa79462-kube-api-access-xgf8p") pod "network-check-target-jvbq7" (UID: "fbf366bb-ccd3-4b51-93c2-9949baa79462") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 00:18:00.060654 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:00.060628 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:18:00.060826 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:00.060760 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:18:00.060826 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:00.060771 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:18:00.060826 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:00.060764 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rkkw" podUID="9ca43bb6-818e-4157-a77e-cbe116cdb95e" Jul 02 00:18:00.061050 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:00.060858 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jvbq7" podUID="fbf366bb-ccd3-4b51-93c2-9949baa79462" Jul 02 00:18:00.061050 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:00.060938 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tkzk" podUID="3c33c8e2-8b03-4815-8cd7-d72d4eb01015" Jul 02 00:18:01.127891 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.127862 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-30.ec2.internal" event="NodeReady" Jul 02 00:18:01.128326 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.128024 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 00:18:01.163554 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.163528 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-8jnpt"] Jul 02 00:18:01.166947 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.166932 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-8jnpt" Jul 02 00:18:01.169080 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.169060 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c4d86f8c4-jlszr"] Jul 02 00:18:01.169574 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.169536 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 02 00:18:01.169672 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.169643 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-w6rdh\"" Jul 02 00:18:01.169733 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.169691 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 02 00:18:01.172031 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.172012 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:18:01.178537 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.178515 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 02 00:18:01.178677 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.178621 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 02 00:18:01.179260 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.179205 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 02 00:18:01.179350 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.179319 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6xp6s\"" Jul 02 00:18:01.181625 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.181603 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-8jnpt"] Jul 02 00:18:01.183495 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.183451 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 02 00:18:01.188533 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.188512 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8gm58"] Jul 02 00:18:01.195173 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.195156 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c4d86f8c4-jlszr"] Jul 02 00:18:01.195249 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.195183 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zn9z5"] Jul 02 00:18:01.195293 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.195263 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8gm58" Jul 02 00:18:01.197513 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.197498 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zn9z5" Jul 02 00:18:01.197807 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.197700 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 00:18:01.197807 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.197707 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 00:18:01.197995 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.197973 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 00:18:01.198460 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.198447 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vvglb\"" Jul 02 00:18:01.200659 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.200641 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t7ssp\"" Jul 02 00:18:01.200930 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.200912 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 00:18:01.201034 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.200919 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 00:18:01.202798 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.202782 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8gm58"] Jul 02 00:18:01.206690 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.206671 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zn9z5"] Jul 02 00:18:01.279556 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.279483 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:18:01.279556 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.279519 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-ca-trust-extracted\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:18:01.279556 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.279538 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-installation-pull-secrets\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:18:01.279835 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.279613 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-8jnpt\" (UID: \"2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-8jnpt" Jul 02 00:18:01.279835 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.279651 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-8jnpt\" (UID: \"2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-8jnpt" Jul 02 00:18:01.279835 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.279718 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-certificates\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:18:01.279835 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.279771 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2gcs\" (UniqueName: \"kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-kube-api-access-l2gcs\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:18:01.279835 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.279805 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-trusted-ca\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:18:01.279835 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.279831 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-image-registry-private-configuration\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:18:01.280132 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.279908 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-bound-sa-token\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:18:01.380538 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.380511 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-trusted-ca\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:18:01.380538 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.380543 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trpbd\" (UniqueName: \"kubernetes.io/projected/ab4130b0-b250-4476-8c49-5c45b2d82f25-kube-api-access-trpbd\") pod \"ingress-canary-8gm58\" (UID: \"ab4130b0-b250-4476-8c49-5c45b2d82f25\") " pod="openshift-ingress-canary/ingress-canary-8gm58" Jul 02 00:18:01.380781 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.380564 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-image-registry-private-configuration\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:18:01.380781 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.380592 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-metrics-tls\") pod \"dns-default-zn9z5\" (UID: \"2a6a9ab0-db65-483f-8eb1-ad0220bb56a3\") " pod="openshift-dns/dns-default-zn9z5" Jul 02 00:18:01.380781 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.380621 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-bound-sa-token\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:18:01.381060 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.381036 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-tmp-dir\") pod \"dns-default-zn9z5\" (UID: \"2a6a9ab0-db65-483f-8eb1-ad0220bb56a3\") " pod="openshift-dns/dns-default-zn9z5" Jul 02 00:18:01.381143 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.381073 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8ldp\" (UniqueName: \"kubernetes.io/projected/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-kube-api-access-f8ldp\") pod \"dns-default-zn9z5\" (UID: \"2a6a9ab0-db65-483f-8eb1-ad0220bb56a3\") " pod="openshift-dns/dns-default-zn9z5" Jul 02 00:18:01.381143 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.381132 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:18:01.381242 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.381166 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-ca-trust-extracted\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:18:01.381242 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.381183 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-installation-pull-secrets\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:18:01.381347 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.381280 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-8jnpt\" (UID: \"2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-8jnpt" Jul 02 00:18:01.381347 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:01.381301 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 00:18:01.381347 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.381307 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-8jnpt\" (UID: \"2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-8jnpt" Jul 02 00:18:01.381347 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:01.381317 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c4d86f8c4-jlszr: secret "image-registry-tls" not found Jul 02 00:18:01.381347 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.381341 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-certificates\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:18:01.381347 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:01.381370 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls podName:3c528ee8-34d5-41d5-ac52-1ce87a4a240f nodeName:}" failed. No retries permitted until 2026-07-02 00:18:01.881351537 +0000 UTC m=+35.296789201 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls") pod "image-registry-c4d86f8c4-jlszr" (UID: "3c528ee8-34d5-41d5-ac52-1ce87a4a240f") : secret "image-registry-tls" not found Jul 02 00:18:01.381672 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:01.381468 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 00:18:01.381672 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.381478 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab4130b0-b250-4476-8c49-5c45b2d82f25-cert\") pod \"ingress-canary-8gm58\" (UID: \"ab4130b0-b250-4476-8c49-5c45b2d82f25\") " pod="openshift-ingress-canary/ingress-canary-8gm58" Jul 02 00:18:01.381672 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.381552 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2gcs\" (UniqueName: \"kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-kube-api-access-l2gcs\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:18:01.381672 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:01.381571 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert podName:2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2 nodeName:}" failed. No retries permitted until 2026-07-02 00:18:01.881553388 +0000 UTC m=+35.296991051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-8jnpt" (UID: "2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2") : secret "networking-console-plugin-cert" not found Jul 02 00:18:01.381672 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.381612 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-config-volume\") pod \"dns-default-zn9z5\" (UID: \"2a6a9ab0-db65-483f-8eb1-ad0220bb56a3\") " pod="openshift-dns/dns-default-zn9z5" Jul 02 00:18:01.381969 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.381937 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-trusted-ca\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:18:01.382022 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.381991 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-ca-trust-extracted\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:18:01.382068 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.382034 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-8jnpt\" (UID: \"2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-8jnpt" Jul 02 00:18:01.382158 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.382135 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-certificates\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:18:01.385314 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.385295 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-installation-pull-secrets\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:18:01.385406 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.385354 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-image-registry-private-configuration\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:18:01.392670 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.392649 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-bound-sa-token\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:18:01.392775 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.392709 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2gcs\" (UniqueName: \"kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-kube-api-access-l2gcs\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:18:01.482721 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.482697 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab4130b0-b250-4476-8c49-5c45b2d82f25-cert\") pod \"ingress-canary-8gm58\" (UID: \"ab4130b0-b250-4476-8c49-5c45b2d82f25\") " pod="openshift-ingress-canary/ingress-canary-8gm58" Jul 02 00:18:01.482858 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.482727 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-config-volume\") pod \"dns-default-zn9z5\" (UID: \"2a6a9ab0-db65-483f-8eb1-ad0220bb56a3\") " pod="openshift-dns/dns-default-zn9z5" Jul 02 00:18:01.482858 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.482766 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trpbd\" (UniqueName: \"kubernetes.io/projected/ab4130b0-b250-4476-8c49-5c45b2d82f25-kube-api-access-trpbd\") pod \"ingress-canary-8gm58\" (UID: \"ab4130b0-b250-4476-8c49-5c45b2d82f25\") " pod="openshift-ingress-canary/ingress-canary-8gm58" Jul 02 00:18:01.482858 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.482796 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-metrics-tls\") pod \"dns-default-zn9z5\" (UID: \"2a6a9ab0-db65-483f-8eb1-ad0220bb56a3\") " pod="openshift-dns/dns-default-zn9z5" Jul 02 00:18:01.482858 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.482832 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-tmp-dir\") pod \"dns-default-zn9z5\" (UID: \"2a6a9ab0-db65-483f-8eb1-ad0220bb56a3\") " pod="openshift-dns/dns-default-zn9z5" Jul 02 00:18:01.482858 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.482857 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8ldp\" (UniqueName: \"kubernetes.io/projected/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-kube-api-access-f8ldp\") pod \"dns-default-zn9z5\" (UID: \"2a6a9ab0-db65-483f-8eb1-ad0220bb56a3\") " pod="openshift-dns/dns-default-zn9z5" Jul 02 00:18:01.483119 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:01.483097 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 00:18:01.483178 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:01.483161 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-metrics-tls podName:2a6a9ab0-db65-483f-8eb1-ad0220bb56a3 nodeName:}" failed. No retries permitted until 2026-07-02 00:18:01.983142664 +0000 UTC m=+35.398580326 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-metrics-tls") pod "dns-default-zn9z5" (UID: "2a6a9ab0-db65-483f-8eb1-ad0220bb56a3") : secret "dns-default-metrics-tls" not found Jul 02 00:18:01.483244 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.483181 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-tmp-dir\") pod \"dns-default-zn9z5\" (UID: \"2a6a9ab0-db65-483f-8eb1-ad0220bb56a3\") " pod="openshift-dns/dns-default-zn9z5" Jul 02 00:18:01.483460 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.483436 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-config-volume\") pod \"dns-default-zn9z5\" (UID: \"2a6a9ab0-db65-483f-8eb1-ad0220bb56a3\") " pod="openshift-dns/dns-default-zn9z5" Jul 02 00:18:01.485279 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.485260 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab4130b0-b250-4476-8c49-5c45b2d82f25-cert\") pod \"ingress-canary-8gm58\" (UID: \"ab4130b0-b250-4476-8c49-5c45b2d82f25\") " pod="openshift-ingress-canary/ingress-canary-8gm58" Jul 02 00:18:01.491586 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.491564 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8ldp\" (UniqueName: \"kubernetes.io/projected/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-kube-api-access-f8ldp\") pod \"dns-default-zn9z5\" (UID: \"2a6a9ab0-db65-483f-8eb1-ad0220bb56a3\") " pod="openshift-dns/dns-default-zn9z5" Jul 02 00:18:01.491928 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.491912 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trpbd\" (UniqueName: \"kubernetes.io/projected/ab4130b0-b250-4476-8c49-5c45b2d82f25-kube-api-access-trpbd\") pod \"ingress-canary-8gm58\" (UID: \"ab4130b0-b250-4476-8c49-5c45b2d82f25\") " pod="openshift-ingress-canary/ingress-canary-8gm58" Jul 02 00:18:01.504838 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.504816 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8gm58" Jul 02 00:18:01.636696 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.636658 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8gm58"] Jul 02 00:18:01.641454 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:18:01.641408 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab4130b0_b250_4476_8c49_5c45b2d82f25.slice/crio-dabe9b342f1e3b75435dd04c37fa18ea8525e8d1192b22fcfc33dcb6c5bbe9b8 WatchSource:0}: Error finding container dabe9b342f1e3b75435dd04c37fa18ea8525e8d1192b22fcfc33dcb6c5bbe9b8: Status 404 returned error can't find the container with id dabe9b342f1e3b75435dd04c37fa18ea8525e8d1192b22fcfc33dcb6c5bbe9b8 Jul 02 00:18:01.887401 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.887322 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-8jnpt\" (UID: \"2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-8jnpt" Jul 02 00:18:01.887576 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.887431 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:18:01.887576 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:01.887491 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 00:18:01.887576 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:01.887519 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 00:18:01.887576 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:01.887532 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c4d86f8c4-jlszr: secret "image-registry-tls" not found Jul 02 00:18:01.887576 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:01.887570 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert podName:2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2 nodeName:}" failed. No retries permitted until 2026-07-02 00:18:02.887549743 +0000 UTC m=+36.302987401 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-8jnpt" (UID: "2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2") : secret "networking-console-plugin-cert" not found Jul 02 00:18:01.887774 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:01.887590 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls podName:3c528ee8-34d5-41d5-ac52-1ce87a4a240f nodeName:}" failed. No retries permitted until 2026-07-02 00:18:02.887580403 +0000 UTC m=+36.303018054 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls") pod "image-registry-c4d86f8c4-jlszr" (UID: "3c528ee8-34d5-41d5-ac52-1ce87a4a240f") : secret "image-registry-tls" not found Jul 02 00:18:01.988769 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:01.988737 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-metrics-tls\") pod \"dns-default-zn9z5\" (UID: \"2a6a9ab0-db65-483f-8eb1-ad0220bb56a3\") " pod="openshift-dns/dns-default-zn9z5" Jul 02 00:18:01.988917 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:01.988855 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 00:18:01.988917 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:01.988907 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-metrics-tls podName:2a6a9ab0-db65-483f-8eb1-ad0220bb56a3 nodeName:}" failed. No retries permitted until 2026-07-02 00:18:02.9888943 +0000 UTC m=+36.404331946 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-metrics-tls") pod "dns-default-zn9z5" (UID: "2a6a9ab0-db65-483f-8eb1-ad0220bb56a3") : secret "dns-default-metrics-tls" not found Jul 02 00:18:02.060942 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:02.060911 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:18:02.061102 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:02.061020 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:18:02.061102 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:02.061052 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:18:02.063651 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:02.063628 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 00:18:02.063781 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:02.063634 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 00:18:02.063781 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:02.063689 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 00:18:02.063781 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:02.063695 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 00:18:02.063781 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:02.063773 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sw8l9\"" Jul 02 00:18:02.063951 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:02.063795 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wtrrm\"" Jul 02 00:18:02.378383 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:02.378345 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8gm58" event={"ID":"ab4130b0-b250-4476-8c49-5c45b2d82f25","Type":"ContainerStarted","Data":"dabe9b342f1e3b75435dd04c37fa18ea8525e8d1192b22fcfc33dcb6c5bbe9b8"} Jul 02 00:18:02.897157 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:02.897117 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:18:02.897342 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:02.897173 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-8jnpt\" (UID: \"2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-8jnpt" Jul 02 00:18:02.897342 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:02.897277 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 00:18:02.897342 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:02.897287 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 00:18:02.897342 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:02.897297 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c4d86f8c4-jlszr: secret "image-registry-tls" not found Jul 02 00:18:02.897569 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:02.897366 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert podName:2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2 nodeName:}" failed. No retries permitted until 2026-07-02 00:18:04.897347814 +0000 UTC m=+38.312785469 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-8jnpt" (UID: "2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2") : secret "networking-console-plugin-cert" not found Jul 02 00:18:02.897569 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:02.897382 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls podName:3c528ee8-34d5-41d5-ac52-1ce87a4a240f nodeName:}" failed. No retries permitted until 2026-07-02 00:18:04.897374656 +0000 UTC m=+38.312812300 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls") pod "image-registry-c4d86f8c4-jlszr" (UID: "3c528ee8-34d5-41d5-ac52-1ce87a4a240f") : secret "image-registry-tls" not found Jul 02 00:18:02.998520 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:02.998479 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-metrics-tls\") pod \"dns-default-zn9z5\" (UID: \"2a6a9ab0-db65-483f-8eb1-ad0220bb56a3\") " pod="openshift-dns/dns-default-zn9z5" Jul 02 00:18:02.998702 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:02.998661 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 00:18:02.998769 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:02.998742 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-metrics-tls podName:2a6a9ab0-db65-483f-8eb1-ad0220bb56a3 nodeName:}" failed. No retries permitted until 2026-07-02 00:18:04.998718241 +0000 UTC m=+38.414155891 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-metrics-tls") pod "dns-default-zn9z5" (UID: "2a6a9ab0-db65-483f-8eb1-ad0220bb56a3") : secret "dns-default-metrics-tls" not found Jul 02 00:18:04.913159 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:04.913068 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:18:04.913159 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:04.913123 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-8jnpt\" (UID: \"2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-8jnpt" Jul 02 00:18:04.913648 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:04.913243 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 00:18:04.913648 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:04.913321 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert podName:2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2 nodeName:}" failed. No retries permitted until 2026-07-02 00:18:08.913300933 +0000 UTC m=+42.328738597 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-8jnpt" (UID: "2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2") : secret "networking-console-plugin-cert" not found Jul 02 00:18:04.913648 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:04.913248 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 00:18:04.913648 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:04.913341 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c4d86f8c4-jlszr: secret "image-registry-tls" not found Jul 02 00:18:04.913648 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:04.913378 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls podName:3c528ee8-34d5-41d5-ac52-1ce87a4a240f nodeName:}" failed. No retries permitted until 2026-07-02 00:18:08.913366435 +0000 UTC m=+42.328804094 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls") pod "image-registry-c4d86f8c4-jlszr" (UID: "3c528ee8-34d5-41d5-ac52-1ce87a4a240f") : secret "image-registry-tls" not found Jul 02 00:18:05.014037 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:05.014003 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-metrics-tls\") pod \"dns-default-zn9z5\" (UID: \"2a6a9ab0-db65-483f-8eb1-ad0220bb56a3\") " pod="openshift-dns/dns-default-zn9z5" Jul 02 00:18:05.014189 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:05.014163 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 00:18:05.014245 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:05.014230 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-metrics-tls podName:2a6a9ab0-db65-483f-8eb1-ad0220bb56a3 nodeName:}" failed. No retries permitted until 2026-07-02 00:18:09.014211787 +0000 UTC m=+42.429649445 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-metrics-tls") pod "dns-default-zn9z5" (UID: "2a6a9ab0-db65-483f-8eb1-ad0220bb56a3") : secret "dns-default-metrics-tls" not found Jul 02 00:18:05.388011 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:05.387975 2581 generic.go:356] "Generic (PLEG): container finished" podID="3af39740-2e0a-41fd-ace2-f375968ce30d" containerID="6608dc8053739b68dae420b2a4457c31dd6d215967352945dd4815bafcb882cc" exitCode=0 Jul 02 00:18:05.388179 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:05.388035 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r76sc" event={"ID":"3af39740-2e0a-41fd-ace2-f375968ce30d","Type":"ContainerDied","Data":"6608dc8053739b68dae420b2a4457c31dd6d215967352945dd4815bafcb882cc"} Jul 02 00:18:06.039438 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:06.039393 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:06.115549 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:06.115514 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:06.393859 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:06.393772 2581 generic.go:356] "Generic (PLEG): container finished" podID="3af39740-2e0a-41fd-ace2-f375968ce30d" containerID="236a14ae75d981d415be03e2a7ba132003d944677cdb12a0a588a6236ecb3e51" exitCode=0 Jul 02 00:18:06.393859 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:06.393836 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r76sc" event={"ID":"3af39740-2e0a-41fd-ace2-f375968ce30d","Type":"ContainerDied","Data":"236a14ae75d981d415be03e2a7ba132003d944677cdb12a0a588a6236ecb3e51"} Jul 02 00:18:06.395284 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:06.395262 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8gm58" event={"ID":"ab4130b0-b250-4476-8c49-5c45b2d82f25","Type":"ContainerStarted","Data":"a0e88955e0753035b0f9bc191287958ece4843435b48fd997c3c95333586a4ea"} Jul 02 00:18:06.434213 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:06.434160 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8gm58" podStartSLOduration=1.51015707 podStartE2EDuration="5.434142679s" totalImagesPullingTime="3.923985609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:18:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:18:06.433507506 +0000 UTC m=+39.848945174" watchObservedRunningTime="2026-07-02 00:18:06.434142679 +0000 UTC m=+39.849580346" Jul 02 00:18:07.401253 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:07.401215 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r76sc" event={"ID":"3af39740-2e0a-41fd-ace2-f375968ce30d","Type":"ContainerStarted","Data":"2f7b08c788225e261da0d3d972593a7b1fdc1519295f7da3ba1f64ed38b7764f"} Jul 02 00:18:07.423721 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:07.423672 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r76sc" podStartSLOduration=7.0758207 podStartE2EDuration="40.423656521s" totalImagesPullingTime="33.347835821s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 00:17:27 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:18:07.422738095 +0000 UTC m=+40.838175801" watchObservedRunningTime="2026-07-02 00:18:07.423656521 +0000 UTC m=+40.839094188" Jul 02 00:18:07.549108 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:07.549067 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:07.601019 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:07.600987 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:08.939842 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:08.939806 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:18:08.939842 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:08.939846 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-8jnpt\" (UID: \"2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-8jnpt" Jul 02 00:18:08.940214 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:08.939942 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 00:18:08.940214 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:08.939951 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 00:18:08.940214 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:08.939969 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c4d86f8c4-jlszr: secret "image-registry-tls" not found Jul 02 00:18:08.940214 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:08.939993 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert podName:2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2 nodeName:}" failed. No retries permitted until 2026-07-02 00:18:16.939980183 +0000 UTC m=+50.355417828 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-8jnpt" (UID: "2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2") : secret "networking-console-plugin-cert" not found Jul 02 00:18:08.940214 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:08.940012 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls podName:3c528ee8-34d5-41d5-ac52-1ce87a4a240f nodeName:}" failed. No retries permitted until 2026-07-02 00:18:16.939997971 +0000 UTC m=+50.355435619 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls") pod "image-registry-c4d86f8c4-jlszr" (UID: "3c528ee8-34d5-41d5-ac52-1ce87a4a240f") : secret "image-registry-tls" not found Jul 02 00:18:09.041131 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:09.041104 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-metrics-tls\") pod \"dns-default-zn9z5\" (UID: \"2a6a9ab0-db65-483f-8eb1-ad0220bb56a3\") " pod="openshift-dns/dns-default-zn9z5" Jul 02 00:18:09.041267 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:09.041188 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 00:18:09.041267 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:09.041236 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-metrics-tls podName:2a6a9ab0-db65-483f-8eb1-ad0220bb56a3 nodeName:}" failed. No retries permitted until 2026-07-02 00:18:17.041225682 +0000 UTC m=+50.456663327 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-metrics-tls") pod "dns-default-zn9z5" (UID: "2a6a9ab0-db65-483f-8eb1-ad0220bb56a3") : secret "dns-default-metrics-tls" not found Jul 02 00:18:09.226073 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:09.226004 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:09.342184 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:09.342143 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:09.436703 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:09.436663 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:09.544950 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:09.544918 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:09.646274 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:09.646244 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:09.745633 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:09.745592 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:09.845392 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:09.845325 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:10.315460 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:10.315411 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:10.368257 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:10.368225 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:10.718013 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:10.717936 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:10.765897 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:10.765860 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:16.998158 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:16.998120 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:18:16.998158 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:16.998166 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-8jnpt\" (UID: \"2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-8jnpt" Jul 02 00:18:16.998684 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:16.998267 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 00:18:16.998684 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:16.998272 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 00:18:16.998684 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:16.998290 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c4d86f8c4-jlszr: secret "image-registry-tls" not found Jul 02 00:18:16.998684 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:16.998321 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert podName:2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2 nodeName:}" failed. No retries permitted until 2026-07-02 00:18:32.998307664 +0000 UTC m=+66.413745308 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-8jnpt" (UID: "2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2") : secret "networking-console-plugin-cert" not found Jul 02 00:18:16.998684 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:16.998344 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls podName:3c528ee8-34d5-41d5-ac52-1ce87a4a240f nodeName:}" failed. No retries permitted until 2026-07-02 00:18:32.998331198 +0000 UTC m=+66.413768843 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls") pod "image-registry-c4d86f8c4-jlszr" (UID: "3c528ee8-34d5-41d5-ac52-1ce87a4a240f") : secret "image-registry-tls" not found Jul 02 00:18:17.080450 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:17.080402 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:17.098687 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:17.098661 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-metrics-tls\") pod \"dns-default-zn9z5\" (UID: \"2a6a9ab0-db65-483f-8eb1-ad0220bb56a3\") " pod="openshift-dns/dns-default-zn9z5" Jul 02 00:18:17.098802 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:17.098771 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 00:18:17.098840 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:17.098834 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-metrics-tls podName:2a6a9ab0-db65-483f-8eb1-ad0220bb56a3 nodeName:}" failed. No retries permitted until 2026-07-02 00:18:33.098815026 +0000 UTC m=+66.514252685 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-metrics-tls") pod "dns-default-zn9z5" (UID: "2a6a9ab0-db65-483f-8eb1-ad0220bb56a3") : secret "dns-default-metrics-tls" not found Jul 02 00:18:17.181478 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:17.181448 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:27.383021 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:27.382983 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-55kgg" Jul 02 00:18:27.529447 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:27.529403 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:27.587705 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:27.587683 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:31.536307 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:31.536256 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:31.613556 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:31.613526 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:31.688972 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:31.688928 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:31.751373 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:31.751343 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:31.898613 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:31.898534 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs\") pod \"network-metrics-daemon-7tkzk\" (UID: \"3c33c8e2-8b03-4815-8cd7-d72d4eb01015\") " pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:18:31.898613 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:31.898609 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ca43bb6-818e-4157-a77e-cbe116cdb95e-original-pull-secret\") pod \"global-pull-secret-syncer-9rkkw\" (UID: \"9ca43bb6-818e-4157-a77e-cbe116cdb95e\") " pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:18:31.901484 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:31.901465 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 00:18:31.901553 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:31.901482 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 00:18:31.909623 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:31.909605 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 00:18:31.909678 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:31.909659 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs podName:3c33c8e2-8b03-4815-8cd7-d72d4eb01015 nodeName:}" failed. No retries permitted until 2026-07-02 00:19:35.909644381 +0000 UTC m=+129.325082026 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs") pod "network-metrics-daemon-7tkzk" (UID: "3c33c8e2-8b03-4815-8cd7-d72d4eb01015") : secret "metrics-daemon-secret" not found Jul 02 00:18:31.913082 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:31.913066 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ca43bb6-818e-4157-a77e-cbe116cdb95e-original-pull-secret\") pod \"global-pull-secret-syncer-9rkkw\" (UID: \"9ca43bb6-818e-4157-a77e-cbe116cdb95e\") " pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:18:31.999224 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:31.999184 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgf8p\" (UniqueName: \"kubernetes.io/projected/fbf366bb-ccd3-4b51-93c2-9949baa79462-kube-api-access-xgf8p\") pod \"network-check-target-jvbq7\" (UID: \"fbf366bb-ccd3-4b51-93c2-9949baa79462\") " pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:18:32.001868 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:32.001849 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 00:18:32.012154 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:32.012136 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 00:18:32.022189 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:32.022171 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgf8p\" (UniqueName: \"kubernetes.io/projected/fbf366bb-ccd3-4b51-93c2-9949baa79462-kube-api-access-xgf8p\") pod \"network-check-target-jvbq7\" (UID: \"fbf366bb-ccd3-4b51-93c2-9949baa79462\") " pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:18:32.073311 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:32.073294 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rkkw" Jul 02 00:18:32.085531 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:32.085513 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wtrrm\"" Jul 02 00:18:32.093551 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:32.093534 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:18:32.216125 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:32.216101 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9rkkw"] Jul 02 00:18:32.218499 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:18:32.218472 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ca43bb6_818e_4157_a77e_cbe116cdb95e.slice/crio-9ce3611307785d434f2f988635d14ee72e8d49e246cad52376af88658793098f WatchSource:0}: Error finding container 9ce3611307785d434f2f988635d14ee72e8d49e246cad52376af88658793098f: Status 404 returned error can't find the container with id 9ce3611307785d434f2f988635d14ee72e8d49e246cad52376af88658793098f Jul 02 00:18:32.230727 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:32.230708 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jvbq7"] Jul 02 00:18:32.233284 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:18:32.233261 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbf366bb_ccd3_4b51_93c2_9949baa79462.slice/crio-f543ea30fd282ed237acabefa8d1a2d33d9622f5d88bab0e3d2dad8e290832e9 WatchSource:0}: Error finding container f543ea30fd282ed237acabefa8d1a2d33d9622f5d88bab0e3d2dad8e290832e9: Status 404 returned error can't find the container with id f543ea30fd282ed237acabefa8d1a2d33d9622f5d88bab0e3d2dad8e290832e9 Jul 02 00:18:32.460740 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:32.460655 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jvbq7" event={"ID":"fbf366bb-ccd3-4b51-93c2-9949baa79462","Type":"ContainerStarted","Data":"f543ea30fd282ed237acabefa8d1a2d33d9622f5d88bab0e3d2dad8e290832e9"} Jul 02 00:18:32.461653 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:32.461633 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9rkkw" event={"ID":"9ca43bb6-818e-4157-a77e-cbe116cdb95e","Type":"ContainerStarted","Data":"9ce3611307785d434f2f988635d14ee72e8d49e246cad52376af88658793098f"} Jul 02 00:18:32.589388 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:32.589358 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:32.876258 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:32.876214 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:32.931048 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:32.931011 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:33.008756 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:33.008727 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:18:33.008922 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:33.008775 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-8jnpt\" (UID: \"2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-8jnpt" Jul 02 00:18:33.008922 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:33.008894 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 00:18:33.008922 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:33.008899 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 00:18:33.008922 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:33.008922 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c4d86f8c4-jlszr: secret "image-registry-tls" not found Jul 02 00:18:33.009254 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:33.008961 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert podName:2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2 nodeName:}" failed. No retries permitted until 2026-07-02 00:19:05.008942693 +0000 UTC m=+98.424380384 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-8jnpt" (UID: "2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2") : secret "networking-console-plugin-cert" not found Jul 02 00:18:33.009254 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:33.008979 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls podName:3c528ee8-34d5-41d5-ac52-1ce87a4a240f nodeName:}" failed. No retries permitted until 2026-07-02 00:19:05.008969778 +0000 UTC m=+98.424407430 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls") pod "image-registry-c4d86f8c4-jlszr" (UID: "3c528ee8-34d5-41d5-ac52-1ce87a4a240f") : secret "image-registry-tls" not found Jul 02 00:18:33.109731 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:33.109695 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-metrics-tls\") pod \"dns-default-zn9z5\" (UID: \"2a6a9ab0-db65-483f-8eb1-ad0220bb56a3\") " pod="openshift-dns/dns-default-zn9z5" Jul 02 00:18:33.109898 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:33.109866 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 00:18:33.109951 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:18:33.109938 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-metrics-tls podName:2a6a9ab0-db65-483f-8eb1-ad0220bb56a3 nodeName:}" failed. No retries permitted until 2026-07-02 00:19:05.10991664 +0000 UTC m=+98.525354305 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-metrics-tls") pod "dns-default-zn9z5" (UID: "2a6a9ab0-db65-483f-8eb1-ad0220bb56a3") : secret "dns-default-metrics-tls" not found Jul 02 00:18:33.672549 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:33.672498 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:34.068559 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:34.068530 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:34.121391 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:34.121360 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:35.410015 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:35.409978 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:36.476204 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:36.476171 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jvbq7" event={"ID":"fbf366bb-ccd3-4b51-93c2-9949baa79462","Type":"ContainerStarted","Data":"bd097f1845d8323feabdb380bde81ea277975aefbd89ad01b57b2397bf807a1b"} Jul 02 00:18:36.476581 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:36.476322 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:18:36.492624 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:36.492576 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jvbq7" podStartSLOduration=66.071658502 podStartE2EDuration="1m9.492561835s" totalImagesPullingTime="3.420903333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:17:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:18:36.491399343 +0000 UTC m=+69.906837010" watchObservedRunningTime="2026-07-02 00:18:36.492561835 +0000 UTC m=+69.907999535" Jul 02 00:18:36.617649 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:36.617605 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:38.482634 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:38.482550 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9rkkw" event={"ID":"9ca43bb6-818e-4157-a77e-cbe116cdb95e","Type":"ContainerStarted","Data":"0fcc060d51bab6d5a0b70a6613d59c7bc9bca53af3c4d5f8baf4d270672a2b76"} Jul 02 00:18:38.498555 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:38.498512 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9rkkw" podStartSLOduration=64.600657368 podStartE2EDuration="1m10.498496754s" totalImagesPullingTime="5.897839386s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 00:17:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:18:38.497730172 +0000 UTC m=+71.913167838" watchObservedRunningTime="2026-07-02 00:18:38.498496754 +0000 UTC m=+71.913934421" Jul 02 00:18:43.829439 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:43.829388 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:43.887486 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:43.887457 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:45.056475 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:45.056438 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:45.108435 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:45.108393 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:47.673014 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:47.672978 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:47.773888 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:47.773854 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:48.551040 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:48.550918 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:48.650910 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:48.650883 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:48.945120 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:48.945043 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:49.175842 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:49.175814 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:18:49.277301 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:18:49.277257 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:19:05.033679 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:19:05.033638 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:19:05.033679 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:19:05.033684 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-8jnpt\" (UID: \"2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-8jnpt" Jul 02 00:19:05.034125 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:19:05.033772 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 00:19:05.034125 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:19:05.033778 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 00:19:05.034125 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:19:05.033795 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c4d86f8c4-jlszr: secret "image-registry-tls" not found Jul 02 00:19:05.034125 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:19:05.033823 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert podName:2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2 nodeName:}" failed. No retries permitted until 2026-07-02 00:20:09.033810517 +0000 UTC m=+162.449248163 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-8jnpt" (UID: "2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2") : secret "networking-console-plugin-cert" not found Jul 02 00:19:05.034125 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:19:05.033836 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls podName:3c528ee8-34d5-41d5-ac52-1ce87a4a240f nodeName:}" failed. No retries permitted until 2026-07-02 00:20:09.033829786 +0000 UTC m=+162.449267431 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls") pod "image-registry-c4d86f8c4-jlszr" (UID: "3c528ee8-34d5-41d5-ac52-1ce87a4a240f") : secret "image-registry-tls" not found Jul 02 00:19:05.134882 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:19:05.134854 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-metrics-tls\") pod \"dns-default-zn9z5\" (UID: \"2a6a9ab0-db65-483f-8eb1-ad0220bb56a3\") " pod="openshift-dns/dns-default-zn9z5" Jul 02 00:19:05.135032 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:19:05.134967 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 00:19:05.135032 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:19:05.135012 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-metrics-tls podName:2a6a9ab0-db65-483f-8eb1-ad0220bb56a3 nodeName:}" failed. No retries permitted until 2026-07-02 00:20:09.134999798 +0000 UTC m=+162.550437443 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-metrics-tls") pod "dns-default-zn9z5" (UID: "2a6a9ab0-db65-483f-8eb1-ad0220bb56a3") : secret "dns-default-metrics-tls" not found Jul 02 00:19:07.482114 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:19:07.482087 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jvbq7" Jul 02 00:19:08.652392 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:19:08.652358 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:19:08.704448 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:19:08.704396 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:19:11.513267 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:19:11.513231 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:19:11.567149 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:19:11.567121 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:19:35.941019 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:19:35.940986 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs\") pod \"network-metrics-daemon-7tkzk\" (UID: \"3c33c8e2-8b03-4815-8cd7-d72d4eb01015\") " pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:19:35.941436 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:19:35.941124 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 00:19:35.941436 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:19:35.941193 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs podName:3c33c8e2-8b03-4815-8cd7-d72d4eb01015 nodeName:}" failed. No retries permitted until 2026-07-02 00:21:37.941178278 +0000 UTC m=+251.356615923 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs") pod "network-metrics-daemon-7tkzk" (UID: "3c33c8e2-8b03-4815-8cd7-d72d4eb01015") : secret "metrics-daemon-secret" not found Jul 02 00:20:04.179136 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:20:04.179083 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-8jnpt" podUID="2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2" Jul 02 00:20:04.186205 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:20:04.186182 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" podUID="3c528ee8-34d5-41d5-ac52-1ce87a4a240f" Jul 02 00:20:04.210473 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:20:04.210451 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zn9z5" podUID="2a6a9ab0-db65-483f-8eb1-ad0220bb56a3" Jul 02 00:20:04.674853 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:20:04.674824 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zn9z5" Jul 02 00:20:04.675077 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:20:04.674861 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:20:04.675077 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:20:04.674968 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-8jnpt" Jul 02 00:20:05.079061 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:20:05.079026 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-7tkzk" podUID="3c33c8e2-8b03-4815-8cd7-d72d4eb01015" Jul 02 00:20:09.068169 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:20:09.068133 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:20:09.068169 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:20:09.068172 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-8jnpt\" (UID: \"2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-8jnpt" Jul 02 00:20:09.068604 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:20:09.068276 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 00:20:09.068604 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:20:09.068282 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 00:20:09.068604 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:20:09.068298 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c4d86f8c4-jlszr: secret "image-registry-tls" not found Jul 02 00:20:09.068604 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:20:09.068352 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert podName:2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2 nodeName:}" failed. No retries permitted until 2026-07-02 00:22:11.068339379 +0000 UTC m=+284.483777029 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-8jnpt" (UID: "2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2") : secret "networking-console-plugin-cert" not found Jul 02 00:20:09.068604 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:20:09.068366 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls podName:3c528ee8-34d5-41d5-ac52-1ce87a4a240f nodeName:}" failed. No retries permitted until 2026-07-02 00:22:11.068360193 +0000 UTC m=+284.483797838 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls") pod "image-registry-c4d86f8c4-jlszr" (UID: "3c528ee8-34d5-41d5-ac52-1ce87a4a240f") : secret "image-registry-tls" not found Jul 02 00:20:09.168894 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:20:09.168866 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-metrics-tls\") pod \"dns-default-zn9z5\" (UID: \"2a6a9ab0-db65-483f-8eb1-ad0220bb56a3\") " pod="openshift-dns/dns-default-zn9z5" Jul 02 00:20:09.169004 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:20:09.168990 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 00:20:09.169058 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:20:09.169048 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-metrics-tls podName:2a6a9ab0-db65-483f-8eb1-ad0220bb56a3 nodeName:}" failed. No retries permitted until 2026-07-02 00:22:11.16902525 +0000 UTC m=+284.584462895 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-metrics-tls") pod "dns-default-zn9z5" (UID: "2a6a9ab0-db65-483f-8eb1-ad0220bb56a3") : secret "dns-default-metrics-tls" not found Jul 02 00:20:18.061387 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:20:18.061360 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:21:24.960168 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:24.960135 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:21:37.999048 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:37.999012 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs\") pod \"network-metrics-daemon-7tkzk\" (UID: \"3c33c8e2-8b03-4815-8cd7-d72d4eb01015\") " pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:21:37.999409 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:37.999154 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 00:21:37.999409 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:37.999224 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs podName:3c33c8e2-8b03-4815-8cd7-d72d4eb01015 nodeName:}" failed. No retries permitted until 2026-07-02 00:23:39.9992081 +0000 UTC m=+373.414645745 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs") pod "network-metrics-daemon-7tkzk" (UID: "3c33c8e2-8b03-4815-8cd7-d72d4eb01015") : secret "metrics-daemon-secret" not found Jul 02 00:21:48.496780 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.496701 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-ggbp5"] Jul 02 00:21:48.498445 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.498428 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5f67b55555-92c88"] Jul 02 00:21:48.498540 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.498525 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-ggbp5" Jul 02 00:21:48.500254 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.500236 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-92c88" Jul 02 00:21:48.500943 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.500927 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-4lnzr\"" Jul 02 00:21:48.503826 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.503806 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-4jvrw"] Jul 02 00:21:48.505465 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.505374 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6bbf6dbcc-cbv22"] Jul 02 00:21:48.505541 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.505507 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4jvrw" Jul 02 00:21:48.505660 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.505626 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 02 00:21:48.505816 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.505645 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 02 00:21:48.506442 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.506407 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 00:21:48.506907 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.506891 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-gtjnt\"" Jul 02 00:21:48.507685 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.507668 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 00:21:48.507767 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.507732 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:21:48.509618 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.509546 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 02 00:21:48.509887 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.509870 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 00:21:48.511056 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.511035 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-hpb2b\"" Jul 02 00:21:48.511644 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.511627 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 00:21:48.511862 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.511839 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 02 00:21:48.512315 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.512286 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 00:21:48.512560 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.511918 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 02 00:21:48.513522 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.513500 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-ggbp5"] Jul 02 00:21:48.515049 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.515031 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 02 00:21:48.515169 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.515150 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 02 00:21:48.515300 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.515058 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 02 00:21:48.515378 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.515165 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 02 00:21:48.515502 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.515090 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gz5hn\"" Jul 02 00:21:48.515711 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.515694 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 00:21:48.517325 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.517305 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-92c88"] Jul 02 00:21:48.519430 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.519395 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-4jvrw"] Jul 02 00:21:48.528045 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.528026 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6bbf6dbcc-cbv22"] Jul 02 00:21:48.573516 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.573492 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/954d8cc8-f8a5-4b7c-8569-cead4287cbb5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-4jvrw\" (UID: \"954d8cc8-f8a5-4b7c-8569-cead4287cbb5\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4jvrw" Jul 02 00:21:48.573767 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.573529 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e6a9de7-b7d1-44ad-b020-2f70773b582e-service-ca-bundle\") pod \"insights-operator-5f67b55555-92c88\" (UID: \"2e6a9de7-b7d1-44ad-b020-2f70773b582e\") " pod="openshift-insights/insights-operator-5f67b55555-92c88" Jul 02 00:21:48.573767 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.573571 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkptp\" (UniqueName: \"kubernetes.io/projected/954d8cc8-f8a5-4b7c-8569-cead4287cbb5-kube-api-access-pkptp\") pod \"cluster-monitoring-operator-54cb84584-4jvrw\" (UID: \"954d8cc8-f8a5-4b7c-8569-cead4287cbb5\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4jvrw" Jul 02 00:21:48.573767 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.573625 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e6a9de7-b7d1-44ad-b020-2f70773b582e-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-92c88\" (UID: \"2e6a9de7-b7d1-44ad-b020-2f70773b582e\") " pod="openshift-insights/insights-operator-5f67b55555-92c88" Jul 02 00:21:48.573767 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.573659 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2e6a9de7-b7d1-44ad-b020-2f70773b582e-snapshots\") pod \"insights-operator-5f67b55555-92c88\" (UID: \"2e6a9de7-b7d1-44ad-b020-2f70773b582e\") " pod="openshift-insights/insights-operator-5f67b55555-92c88" Jul 02 00:21:48.573767 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.573683 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csc59\" (UniqueName: \"kubernetes.io/projected/f74e75fe-e9b5-469a-be6c-683003a40ca8-kube-api-access-csc59\") pod \"network-check-source-56499946bc-ggbp5\" (UID: \"f74e75fe-e9b5-469a-be6c-683003a40ca8\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-ggbp5" Jul 02 00:21:48.573767 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.573710 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e6a9de7-b7d1-44ad-b020-2f70773b582e-tmp\") pod \"insights-operator-5f67b55555-92c88\" (UID: \"2e6a9de7-b7d1-44ad-b020-2f70773b582e\") " pod="openshift-insights/insights-operator-5f67b55555-92c88" Jul 02 00:21:48.573767 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.573728 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2e6a9de7-b7d1-44ad-b020-2f70773b582e-serving-cert\") pod \"insights-operator-5f67b55555-92c88\" (UID: \"2e6a9de7-b7d1-44ad-b020-2f70773b582e\") " pod="openshift-insights/insights-operator-5f67b55555-92c88" Jul 02 00:21:48.573767 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.573762 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfxtz\" (UniqueName: \"kubernetes.io/projected/2e6a9de7-b7d1-44ad-b020-2f70773b582e-kube-api-access-qfxtz\") pod \"insights-operator-5f67b55555-92c88\" (UID: \"2e6a9de7-b7d1-44ad-b020-2f70773b582e\") " pod="openshift-insights/insights-operator-5f67b55555-92c88" Jul 02 00:21:48.574057 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.573819 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/954d8cc8-f8a5-4b7c-8569-cead4287cbb5-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-4jvrw\" (UID: \"954d8cc8-f8a5-4b7c-8569-cead4287cbb5\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4jvrw" Jul 02 00:21:48.590431 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.590388 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-vr5kp"] Jul 02 00:21:48.592391 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.592377 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-vr5kp" Jul 02 00:21:48.595107 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.595089 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-9mcb8"] Jul 02 00:21:48.595619 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.595603 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-jq6jd\"" Jul 02 00:21:48.596136 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.596120 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 02 00:21:48.596443 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.596409 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 02 00:21:48.596736 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.596721 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qq8c8"] Jul 02 00:21:48.596852 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.596840 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-9mcb8" Jul 02 00:21:48.598261 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.598245 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qq8c8" Jul 02 00:21:48.599491 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.599473 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 02 00:21:48.599711 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.599695 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 02 00:21:48.599773 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.599717 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 02 00:21:48.600179 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.600166 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-f7w7t\"" Jul 02 00:21:48.600735 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.600716 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 02 00:21:48.600806 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.600756 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 02 00:21:48.600990 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.600973 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 02 00:21:48.601064 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.601011 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 02 00:21:48.601270 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.601256 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-gzp6v\"" Jul 02 00:21:48.605037 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.605016 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-vr5kp"] Jul 02 00:21:48.611335 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.611313 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-9mcb8"] Jul 02 00:21:48.612077 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.612057 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qq8c8"] Jul 02 00:21:48.675104 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.675081 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e6a9de7-b7d1-44ad-b020-2f70773b582e-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-92c88\" (UID: \"2e6a9de7-b7d1-44ad-b020-2f70773b582e\") " pod="openshift-insights/insights-operator-5f67b55555-92c88" Jul 02 00:21:48.675208 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.675110 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh6wk\" (UniqueName: \"kubernetes.io/projected/e17f6a99-9ffb-4d7d-9031-a0939e588e14-kube-api-access-wh6wk\") pod \"router-default-6bbf6dbcc-cbv22\" (UID: \"e17f6a99-9ffb-4d7d-9031-a0939e588e14\") " pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:21:48.675208 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.675133 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2e6a9de7-b7d1-44ad-b020-2f70773b582e-snapshots\") pod \"insights-operator-5f67b55555-92c88\" (UID: \"2e6a9de7-b7d1-44ad-b020-2f70773b582e\") " pod="openshift-insights/insights-operator-5f67b55555-92c88" Jul 02 00:21:48.675208 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.675150 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e6a9de7-b7d1-44ad-b020-2f70773b582e-tmp\") pod \"insights-operator-5f67b55555-92c88\" (UID: \"2e6a9de7-b7d1-44ad-b020-2f70773b582e\") " pod="openshift-insights/insights-operator-5f67b55555-92c88" Jul 02 00:21:48.675208 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.675165 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2e6a9de7-b7d1-44ad-b020-2f70773b582e-serving-cert\") pod \"insights-operator-5f67b55555-92c88\" (UID: \"2e6a9de7-b7d1-44ad-b020-2f70773b582e\") " pod="openshift-insights/insights-operator-5f67b55555-92c88" Jul 02 00:21:48.675336 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.675222 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e17f6a99-9ffb-4d7d-9031-a0939e588e14-metrics-certs\") pod \"router-default-6bbf6dbcc-cbv22\" (UID: \"e17f6a99-9ffb-4d7d-9031-a0939e588e14\") " pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:21:48.675336 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.675268 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a769b185-fefb-40c7-a21f-137f612e9d66-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-qq8c8\" (UID: \"a769b185-fefb-40c7-a21f-137f612e9d66\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qq8c8" Jul 02 00:21:48.675336 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.675297 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e17f6a99-9ffb-4d7d-9031-a0939e588e14-default-certificate\") pod \"router-default-6bbf6dbcc-cbv22\" (UID: \"e17f6a99-9ffb-4d7d-9031-a0939e588e14\") " pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:21:48.675466 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.675338 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22z7d\" (UniqueName: \"kubernetes.io/projected/a769b185-fefb-40c7-a21f-137f612e9d66-kube-api-access-22z7d\") pod \"kube-storage-version-migrator-operator-79964ff6f9-qq8c8\" (UID: \"a769b185-fefb-40c7-a21f-137f612e9d66\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qq8c8" Jul 02 00:21:48.675466 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.675410 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a769b185-fefb-40c7-a21f-137f612e9d66-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-qq8c8\" (UID: \"a769b185-fefb-40c7-a21f-137f612e9d66\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qq8c8" Jul 02 00:21:48.675562 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.675464 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/954d8cc8-f8a5-4b7c-8569-cead4287cbb5-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-4jvrw\" (UID: \"954d8cc8-f8a5-4b7c-8569-cead4287cbb5\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4jvrw" Jul 02 00:21:48.675562 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.675528 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csc59\" (UniqueName: \"kubernetes.io/projected/f74e75fe-e9b5-469a-be6c-683003a40ca8-kube-api-access-csc59\") pod \"network-check-source-56499946bc-ggbp5\" (UID: \"f74e75fe-e9b5-469a-be6c-683003a40ca8\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-ggbp5" Jul 02 00:21:48.675659 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.675589 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfxtz\" (UniqueName: \"kubernetes.io/projected/2e6a9de7-b7d1-44ad-b020-2f70773b582e-kube-api-access-qfxtz\") pod \"insights-operator-5f67b55555-92c88\" (UID: \"2e6a9de7-b7d1-44ad-b020-2f70773b582e\") " pod="openshift-insights/insights-operator-5f67b55555-92c88" Jul 02 00:21:48.675659 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.675638 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqqtt\" (UniqueName: \"kubernetes.io/projected/3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19-kube-api-access-sqqtt\") pod \"cluster-samples-operator-9ddc5ff76-9mcb8\" (UID: \"3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-9mcb8" Jul 02 00:21:48.675759 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.675672 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e6a9de7-b7d1-44ad-b020-2f70773b582e-tmp\") pod \"insights-operator-5f67b55555-92c88\" (UID: \"2e6a9de7-b7d1-44ad-b020-2f70773b582e\") " pod="openshift-insights/insights-operator-5f67b55555-92c88" Jul 02 00:21:48.675759 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.675675 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/954d8cc8-f8a5-4b7c-8569-cead4287cbb5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-4jvrw\" (UID: \"954d8cc8-f8a5-4b7c-8569-cead4287cbb5\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4jvrw" Jul 02 00:21:48.675759 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.675721 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e6a9de7-b7d1-44ad-b020-2f70773b582e-service-ca-bundle\") pod \"insights-operator-5f67b55555-92c88\" (UID: \"2e6a9de7-b7d1-44ad-b020-2f70773b582e\") " pod="openshift-insights/insights-operator-5f67b55555-92c88" Jul 02 00:21:48.675759 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:48.675752 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 00:21:48.675942 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.675819 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2e6a9de7-b7d1-44ad-b020-2f70773b582e-snapshots\") pod \"insights-operator-5f67b55555-92c88\" (UID: \"2e6a9de7-b7d1-44ad-b020-2f70773b582e\") " pod="openshift-insights/insights-operator-5f67b55555-92c88" Jul 02 00:21:48.675942 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:48.675834 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/954d8cc8-f8a5-4b7c-8569-cead4287cbb5-cluster-monitoring-operator-tls podName:954d8cc8-f8a5-4b7c-8569-cead4287cbb5 nodeName:}" failed. No retries permitted until 2026-07-02 00:21:49.175815947 +0000 UTC m=+262.591253599 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/954d8cc8-f8a5-4b7c-8569-cead4287cbb5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-4jvrw" (UID: "954d8cc8-f8a5-4b7c-8569-cead4287cbb5") : secret "cluster-monitoring-operator-tls" not found Jul 02 00:21:48.675942 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.675748 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-9mcb8\" (UID: \"3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-9mcb8" Jul 02 00:21:48.675942 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.675874 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e17f6a99-9ffb-4d7d-9031-a0939e588e14-stats-auth\") pod \"router-default-6bbf6dbcc-cbv22\" (UID: \"e17f6a99-9ffb-4d7d-9031-a0939e588e14\") " pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:21:48.675942 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.675910 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e17f6a99-9ffb-4d7d-9031-a0939e588e14-service-ca-bundle\") pod \"router-default-6bbf6dbcc-cbv22\" (UID: \"e17f6a99-9ffb-4d7d-9031-a0939e588e14\") " pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:21:48.676186 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.675942 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkptp\" (UniqueName: \"kubernetes.io/projected/954d8cc8-f8a5-4b7c-8569-cead4287cbb5-kube-api-access-pkptp\") pod \"cluster-monitoring-operator-54cb84584-4jvrw\" (UID: \"954d8cc8-f8a5-4b7c-8569-cead4287cbb5\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4jvrw" Jul 02 00:21:48.676186 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.675980 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqncx\" (UniqueName: \"kubernetes.io/projected/5c633374-db35-44a5-873e-fa69cc65215a-kube-api-access-rqncx\") pod \"volume-data-source-validator-69d9f679db-vr5kp\" (UID: \"5c633374-db35-44a5-873e-fa69cc65215a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-vr5kp" Jul 02 00:21:48.676186 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.676133 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e6a9de7-b7d1-44ad-b020-2f70773b582e-service-ca-bundle\") pod \"insights-operator-5f67b55555-92c88\" (UID: \"2e6a9de7-b7d1-44ad-b020-2f70773b582e\") " pod="openshift-insights/insights-operator-5f67b55555-92c88" Jul 02 00:21:48.676186 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.676148 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/954d8cc8-f8a5-4b7c-8569-cead4287cbb5-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-4jvrw\" (UID: \"954d8cc8-f8a5-4b7c-8569-cead4287cbb5\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4jvrw" Jul 02 00:21:48.676320 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.676188 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e6a9de7-b7d1-44ad-b020-2f70773b582e-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-92c88\" (UID: \"2e6a9de7-b7d1-44ad-b020-2f70773b582e\") " pod="openshift-insights/insights-operator-5f67b55555-92c88" Jul 02 00:21:48.677862 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.677844 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2e6a9de7-b7d1-44ad-b020-2f70773b582e-serving-cert\") pod \"insights-operator-5f67b55555-92c88\" (UID: \"2e6a9de7-b7d1-44ad-b020-2f70773b582e\") " pod="openshift-insights/insights-operator-5f67b55555-92c88" Jul 02 00:21:48.683928 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.683905 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfxtz\" (UniqueName: \"kubernetes.io/projected/2e6a9de7-b7d1-44ad-b020-2f70773b582e-kube-api-access-qfxtz\") pod \"insights-operator-5f67b55555-92c88\" (UID: \"2e6a9de7-b7d1-44ad-b020-2f70773b582e\") " pod="openshift-insights/insights-operator-5f67b55555-92c88" Jul 02 00:21:48.684027 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.683978 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csc59\" (UniqueName: \"kubernetes.io/projected/f74e75fe-e9b5-469a-be6c-683003a40ca8-kube-api-access-csc59\") pod \"network-check-source-56499946bc-ggbp5\" (UID: \"f74e75fe-e9b5-469a-be6c-683003a40ca8\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-ggbp5" Jul 02 00:21:48.684077 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.684044 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkptp\" (UniqueName: \"kubernetes.io/projected/954d8cc8-f8a5-4b7c-8569-cead4287cbb5-kube-api-access-pkptp\") pod \"cluster-monitoring-operator-54cb84584-4jvrw\" (UID: \"954d8cc8-f8a5-4b7c-8569-cead4287cbb5\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4jvrw" Jul 02 00:21:48.727902 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.727882 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:21:48.776484 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.776438 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqqtt\" (UniqueName: \"kubernetes.io/projected/3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19-kube-api-access-sqqtt\") pod \"cluster-samples-operator-9ddc5ff76-9mcb8\" (UID: \"3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-9mcb8" Jul 02 00:21:48.776484 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.776471 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-9mcb8\" (UID: \"3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-9mcb8" Jul 02 00:21:48.776587 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.776487 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e17f6a99-9ffb-4d7d-9031-a0939e588e14-stats-auth\") pod \"router-default-6bbf6dbcc-cbv22\" (UID: \"e17f6a99-9ffb-4d7d-9031-a0939e588e14\") " pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:21:48.776587 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:48.776566 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 00:21:48.776664 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.776603 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e17f6a99-9ffb-4d7d-9031-a0939e588e14-service-ca-bundle\") pod \"router-default-6bbf6dbcc-cbv22\" (UID: \"e17f6a99-9ffb-4d7d-9031-a0939e588e14\") " pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:21:48.776664 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:48.776634 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19-samples-operator-tls podName:3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19 nodeName:}" failed. No retries permitted until 2026-07-02 00:21:49.276616163 +0000 UTC m=+262.692053828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-9mcb8" (UID: "3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19") : secret "samples-operator-tls" not found Jul 02 00:21:48.776785 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.776669 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqncx\" (UniqueName: \"kubernetes.io/projected/5c633374-db35-44a5-873e-fa69cc65215a-kube-api-access-rqncx\") pod \"volume-data-source-validator-69d9f679db-vr5kp\" (UID: \"5c633374-db35-44a5-873e-fa69cc65215a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-vr5kp" Jul 02 00:21:48.776785 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:48.776694 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e17f6a99-9ffb-4d7d-9031-a0939e588e14-service-ca-bundle podName:e17f6a99-9ffb-4d7d-9031-a0939e588e14 nodeName:}" failed. No retries permitted until 2026-07-02 00:21:49.276681579 +0000 UTC m=+262.692119241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e17f6a99-9ffb-4d7d-9031-a0939e588e14-service-ca-bundle") pod "router-default-6bbf6dbcc-cbv22" (UID: "e17f6a99-9ffb-4d7d-9031-a0939e588e14") : configmap references non-existent config key: service-ca.crt Jul 02 00:21:48.776785 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.776731 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh6wk\" (UniqueName: \"kubernetes.io/projected/e17f6a99-9ffb-4d7d-9031-a0939e588e14-kube-api-access-wh6wk\") pod \"router-default-6bbf6dbcc-cbv22\" (UID: \"e17f6a99-9ffb-4d7d-9031-a0939e588e14\") " pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:21:48.776785 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.776767 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e17f6a99-9ffb-4d7d-9031-a0939e588e14-metrics-certs\") pod \"router-default-6bbf6dbcc-cbv22\" (UID: \"e17f6a99-9ffb-4d7d-9031-a0939e588e14\") " pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:21:48.777048 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.776792 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a769b185-fefb-40c7-a21f-137f612e9d66-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-qq8c8\" (UID: \"a769b185-fefb-40c7-a21f-137f612e9d66\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qq8c8" Jul 02 00:21:48.777048 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.776818 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e17f6a99-9ffb-4d7d-9031-a0939e588e14-default-certificate\") pod \"router-default-6bbf6dbcc-cbv22\" (UID: \"e17f6a99-9ffb-4d7d-9031-a0939e588e14\") " pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:21:48.777048 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:48.776847 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 00:21:48.777048 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.776852 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22z7d\" (UniqueName: \"kubernetes.io/projected/a769b185-fefb-40c7-a21f-137f612e9d66-kube-api-access-22z7d\") pod \"kube-storage-version-migrator-operator-79964ff6f9-qq8c8\" (UID: \"a769b185-fefb-40c7-a21f-137f612e9d66\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qq8c8" Jul 02 00:21:48.777048 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:48.776891 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e17f6a99-9ffb-4d7d-9031-a0939e588e14-metrics-certs podName:e17f6a99-9ffb-4d7d-9031-a0939e588e14 nodeName:}" failed. No retries permitted until 2026-07-02 00:21:49.27687504 +0000 UTC m=+262.692312735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e17f6a99-9ffb-4d7d-9031-a0939e588e14-metrics-certs") pod "router-default-6bbf6dbcc-cbv22" (UID: "e17f6a99-9ffb-4d7d-9031-a0939e588e14") : secret "router-metrics-certs-default" not found Jul 02 00:21:48.777048 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.776924 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a769b185-fefb-40c7-a21f-137f612e9d66-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-qq8c8\" (UID: \"a769b185-fefb-40c7-a21f-137f612e9d66\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qq8c8" Jul 02 00:21:48.777467 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.777449 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a769b185-fefb-40c7-a21f-137f612e9d66-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-qq8c8\" (UID: \"a769b185-fefb-40c7-a21f-137f612e9d66\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qq8c8" Jul 02 00:21:48.778772 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.778753 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e17f6a99-9ffb-4d7d-9031-a0939e588e14-stats-auth\") pod \"router-default-6bbf6dbcc-cbv22\" (UID: \"e17f6a99-9ffb-4d7d-9031-a0939e588e14\") " pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:21:48.778945 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.778926 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a769b185-fefb-40c7-a21f-137f612e9d66-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-qq8c8\" (UID: \"a769b185-fefb-40c7-a21f-137f612e9d66\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qq8c8" Jul 02 00:21:48.779158 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.779142 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e17f6a99-9ffb-4d7d-9031-a0939e588e14-default-certificate\") pod \"router-default-6bbf6dbcc-cbv22\" (UID: \"e17f6a99-9ffb-4d7d-9031-a0939e588e14\") " pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:21:48.785542 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.785517 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqqtt\" (UniqueName: \"kubernetes.io/projected/3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19-kube-api-access-sqqtt\") pod \"cluster-samples-operator-9ddc5ff76-9mcb8\" (UID: \"3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-9mcb8" Jul 02 00:21:48.785916 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.785893 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh6wk\" (UniqueName: \"kubernetes.io/projected/e17f6a99-9ffb-4d7d-9031-a0939e588e14-kube-api-access-wh6wk\") pod \"router-default-6bbf6dbcc-cbv22\" (UID: \"e17f6a99-9ffb-4d7d-9031-a0939e588e14\") " pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:21:48.786331 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.786315 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22z7d\" (UniqueName: \"kubernetes.io/projected/a769b185-fefb-40c7-a21f-137f612e9d66-kube-api-access-22z7d\") pod \"kube-storage-version-migrator-operator-79964ff6f9-qq8c8\" (UID: \"a769b185-fefb-40c7-a21f-137f612e9d66\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qq8c8" Jul 02 00:21:48.786374 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.786366 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqncx\" (UniqueName: \"kubernetes.io/projected/5c633374-db35-44a5-873e-fa69cc65215a-kube-api-access-rqncx\") pod \"volume-data-source-validator-69d9f679db-vr5kp\" (UID: \"5c633374-db35-44a5-873e-fa69cc65215a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-vr5kp" Jul 02 00:21:48.808946 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.808929 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-ggbp5" Jul 02 00:21:48.821188 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.821168 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-92c88" Jul 02 00:21:48.902903 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.902878 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-vr5kp" Jul 02 00:21:48.916229 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.916196 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qq8c8" Jul 02 00:21:48.936895 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.936864 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-ggbp5"] Jul 02 00:21:48.940258 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:21:48.940227 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf74e75fe_e9b5_469a_be6c_683003a40ca8.slice/crio-762016c2d4832ea51b3f78f6da5a6b1934c7035c142bda2ddcb2d76372154558 WatchSource:0}: Error finding container 762016c2d4832ea51b3f78f6da5a6b1934c7035c142bda2ddcb2d76372154558: Status 404 returned error can't find the container with id 762016c2d4832ea51b3f78f6da5a6b1934c7035c142bda2ddcb2d76372154558 Jul 02 00:21:48.960151 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:21:48.960110 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e6a9de7_b7d1_44ad_b020_2f70773b582e.slice/crio-777574d9bb07e2604d367983d53ab3fee6081a32a05814655ed44644999d6b1b WatchSource:0}: Error finding container 777574d9bb07e2604d367983d53ab3fee6081a32a05814655ed44644999d6b1b: Status 404 returned error can't find the container with id 777574d9bb07e2604d367983d53ab3fee6081a32a05814655ed44644999d6b1b Jul 02 00:21:48.960598 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:48.960524 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-92c88"] Jul 02 00:21:49.039308 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:49.039237 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-vr5kp"] Jul 02 00:21:49.042450 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:21:49.042404 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c633374_db35_44a5_873e_fa69cc65215a.slice/crio-d9d01e57d8fe9ab0ecb028e099125605865ee82616b1d531c4485c344f7eea76 WatchSource:0}: Error finding container d9d01e57d8fe9ab0ecb028e099125605865ee82616b1d531c4485c344f7eea76: Status 404 returned error can't find the container with id d9d01e57d8fe9ab0ecb028e099125605865ee82616b1d531c4485c344f7eea76 Jul 02 00:21:49.055689 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:49.055664 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qq8c8"] Jul 02 00:21:49.058455 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:21:49.058410 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda769b185_fefb_40c7_a21f_137f612e9d66.slice/crio-c7d23ef945943bde5bdd76f0b52ae0423af7073f7ccfcc1cc5fa830fc353928e WatchSource:0}: Error finding container c7d23ef945943bde5bdd76f0b52ae0423af7073f7ccfcc1cc5fa830fc353928e: Status 404 returned error can't find the container with id c7d23ef945943bde5bdd76f0b52ae0423af7073f7ccfcc1cc5fa830fc353928e Jul 02 00:21:49.182140 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:49.182113 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/954d8cc8-f8a5-4b7c-8569-cead4287cbb5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-4jvrw\" (UID: \"954d8cc8-f8a5-4b7c-8569-cead4287cbb5\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4jvrw" Jul 02 00:21:49.182275 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:49.182256 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 00:21:49.182324 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:49.182315 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/954d8cc8-f8a5-4b7c-8569-cead4287cbb5-cluster-monitoring-operator-tls podName:954d8cc8-f8a5-4b7c-8569-cead4287cbb5 nodeName:}" failed. No retries permitted until 2026-07-02 00:21:50.182301739 +0000 UTC m=+263.597739384 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/954d8cc8-f8a5-4b7c-8569-cead4287cbb5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-4jvrw" (UID: "954d8cc8-f8a5-4b7c-8569-cead4287cbb5") : secret "cluster-monitoring-operator-tls" not found Jul 02 00:21:49.283015 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:49.282991 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-9mcb8\" (UID: \"3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-9mcb8" Jul 02 00:21:49.283102 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:49.283023 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e17f6a99-9ffb-4d7d-9031-a0939e588e14-service-ca-bundle\") pod \"router-default-6bbf6dbcc-cbv22\" (UID: \"e17f6a99-9ffb-4d7d-9031-a0939e588e14\") " pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:21:49.283102 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:49.283053 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e17f6a99-9ffb-4d7d-9031-a0939e588e14-metrics-certs\") pod \"router-default-6bbf6dbcc-cbv22\" (UID: \"e17f6a99-9ffb-4d7d-9031-a0939e588e14\") " pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:21:49.283172 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:49.283158 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 00:21:49.283172 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:49.283167 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 00:21:49.283226 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:49.283160 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e17f6a99-9ffb-4d7d-9031-a0939e588e14-service-ca-bundle podName:e17f6a99-9ffb-4d7d-9031-a0939e588e14 nodeName:}" failed. No retries permitted until 2026-07-02 00:21:50.283147534 +0000 UTC m=+263.698585179 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e17f6a99-9ffb-4d7d-9031-a0939e588e14-service-ca-bundle") pod "router-default-6bbf6dbcc-cbv22" (UID: "e17f6a99-9ffb-4d7d-9031-a0939e588e14") : configmap references non-existent config key: service-ca.crt Jul 02 00:21:49.283226 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:49.283212 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e17f6a99-9ffb-4d7d-9031-a0939e588e14-metrics-certs podName:e17f6a99-9ffb-4d7d-9031-a0939e588e14 nodeName:}" failed. No retries permitted until 2026-07-02 00:21:50.28320093 +0000 UTC m=+263.698638575 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e17f6a99-9ffb-4d7d-9031-a0939e588e14-metrics-certs") pod "router-default-6bbf6dbcc-cbv22" (UID: "e17f6a99-9ffb-4d7d-9031-a0939e588e14") : secret "router-metrics-certs-default" not found Jul 02 00:21:49.283296 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:49.283229 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19-samples-operator-tls podName:3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19 nodeName:}" failed. No retries permitted until 2026-07-02 00:21:50.28321752 +0000 UTC m=+263.698655166 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-9mcb8" (UID: "3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19") : secret "samples-operator-tls" not found Jul 02 00:21:49.918814 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:49.918681 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-92c88" event={"ID":"2e6a9de7-b7d1-44ad-b020-2f70773b582e","Type":"ContainerStarted","Data":"777574d9bb07e2604d367983d53ab3fee6081a32a05814655ed44644999d6b1b"} Jul 02 00:21:49.921520 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:49.920842 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-ggbp5" event={"ID":"f74e75fe-e9b5-469a-be6c-683003a40ca8","Type":"ContainerStarted","Data":"39e84b55a6ddd0c428730465c9a8bf03a2bf1128b3f4054fdd99c8b9e1fca07e"} Jul 02 00:21:49.921520 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:49.920896 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-ggbp5" event={"ID":"f74e75fe-e9b5-469a-be6c-683003a40ca8","Type":"ContainerStarted","Data":"762016c2d4832ea51b3f78f6da5a6b1934c7035c142bda2ddcb2d76372154558"} Jul 02 00:21:49.923580 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:49.923538 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qq8c8" event={"ID":"a769b185-fefb-40c7-a21f-137f612e9d66","Type":"ContainerStarted","Data":"c7d23ef945943bde5bdd76f0b52ae0423af7073f7ccfcc1cc5fa830fc353928e"} Jul 02 00:21:49.925816 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:49.925789 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-vr5kp" event={"ID":"5c633374-db35-44a5-873e-fa69cc65215a","Type":"ContainerStarted","Data":"d9d01e57d8fe9ab0ecb028e099125605865ee82616b1d531c4485c344f7eea76"} Jul 02 00:21:50.154258 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:50.154200 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:21:50.191995 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:50.191909 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/954d8cc8-f8a5-4b7c-8569-cead4287cbb5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-4jvrw\" (UID: \"954d8cc8-f8a5-4b7c-8569-cead4287cbb5\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4jvrw" Jul 02 00:21:50.192156 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:50.192090 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 00:21:50.192217 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:50.192172 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/954d8cc8-f8a5-4b7c-8569-cead4287cbb5-cluster-monitoring-operator-tls podName:954d8cc8-f8a5-4b7c-8569-cead4287cbb5 nodeName:}" failed. No retries permitted until 2026-07-02 00:21:52.192150883 +0000 UTC m=+265.607588538 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/954d8cc8-f8a5-4b7c-8569-cead4287cbb5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-4jvrw" (UID: "954d8cc8-f8a5-4b7c-8569-cead4287cbb5") : secret "cluster-monitoring-operator-tls" not found Jul 02 00:21:50.293641 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:50.293375 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-9mcb8\" (UID: \"3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-9mcb8" Jul 02 00:21:50.293641 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:50.293440 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e17f6a99-9ffb-4d7d-9031-a0939e588e14-service-ca-bundle\") pod \"router-default-6bbf6dbcc-cbv22\" (UID: \"e17f6a99-9ffb-4d7d-9031-a0939e588e14\") " pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:21:50.293641 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:50.293497 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e17f6a99-9ffb-4d7d-9031-a0939e588e14-metrics-certs\") pod \"router-default-6bbf6dbcc-cbv22\" (UID: \"e17f6a99-9ffb-4d7d-9031-a0939e588e14\") " pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:21:50.293641 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:50.293555 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 00:21:50.293641 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:50.293638 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19-samples-operator-tls podName:3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19 nodeName:}" failed. No retries permitted until 2026-07-02 00:21:52.293616578 +0000 UTC m=+265.709054244 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-9mcb8" (UID: "3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19") : secret "samples-operator-tls" not found Jul 02 00:21:50.294062 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:50.293659 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e17f6a99-9ffb-4d7d-9031-a0939e588e14-service-ca-bundle podName:e17f6a99-9ffb-4d7d-9031-a0939e588e14 nodeName:}" failed. No retries permitted until 2026-07-02 00:21:52.293649797 +0000 UTC m=+265.709087442 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e17f6a99-9ffb-4d7d-9031-a0939e588e14-service-ca-bundle") pod "router-default-6bbf6dbcc-cbv22" (UID: "e17f6a99-9ffb-4d7d-9031-a0939e588e14") : configmap references non-existent config key: service-ca.crt Jul 02 00:21:50.294062 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:50.293805 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 00:21:50.294062 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:50.293848 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e17f6a99-9ffb-4d7d-9031-a0939e588e14-metrics-certs podName:e17f6a99-9ffb-4d7d-9031-a0939e588e14 nodeName:}" failed. No retries permitted until 2026-07-02 00:21:52.293835638 +0000 UTC m=+265.709273283 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e17f6a99-9ffb-4d7d-9031-a0939e588e14-metrics-certs") pod "router-default-6bbf6dbcc-cbv22" (UID: "e17f6a99-9ffb-4d7d-9031-a0939e588e14") : secret "router-metrics-certs-default" not found Jul 02 00:21:50.930942 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:50.930899 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-vr5kp" event={"ID":"5c633374-db35-44a5-873e-fa69cc65215a","Type":"ContainerStarted","Data":"67cc3821a53420512dc91ed7bea87246b83913e743aa305a13003225ce06936a"} Jul 02 00:21:50.946349 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:50.946294 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56499946bc-ggbp5" podStartSLOduration=2.946279551 podStartE2EDuration="2.946279551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:21:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:21:49.93589182 +0000 UTC m=+263.351329482" watchObservedRunningTime="2026-07-02 00:21:50.946279551 +0000 UTC m=+264.361717217" Jul 02 00:21:50.946513 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:50.946403 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-vr5kp" podStartSLOduration=1.5399832020000002 podStartE2EDuration="2.946396125s" totalImagesPullingTime="1.406412923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:21:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:21:50.945744813 +0000 UTC m=+264.361182493" watchObservedRunningTime="2026-07-02 00:21:50.946396125 +0000 UTC m=+264.361833790" Jul 02 00:21:51.019693 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:51.019658 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:21:51.070810 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:51.070774 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:21:51.936407 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:51.936371 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-92c88" event={"ID":"2e6a9de7-b7d1-44ad-b020-2f70773b582e","Type":"ContainerStarted","Data":"887b226769c1040fe908fa2c3d15616279bee4b26387e4906ab2758147255fb6"} Jul 02 00:21:51.938060 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:51.938030 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qq8c8" event={"ID":"a769b185-fefb-40c7-a21f-137f612e9d66","Type":"ContainerStarted","Data":"1d6d66446dd38493441ed50711ca701764150d056a7812727c26624aa5ba97e9"} Jul 02 00:21:51.952531 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:51.952467 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5f67b55555-92c88" podStartSLOduration=1.090079932 podStartE2EDuration="3.952445127s" totalImagesPullingTime="2.862365195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:21:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:21:51.951136313 +0000 UTC m=+265.366573981" watchObservedRunningTime="2026-07-02 00:21:51.952445127 +0000 UTC m=+265.367882795" Jul 02 00:21:51.967640 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:51.967585 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qq8c8" podStartSLOduration=1.198828083 podStartE2EDuration="3.967566365s" totalImagesPullingTime="2.768738282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:21:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:21:51.966349696 +0000 UTC m=+265.381787364" watchObservedRunningTime="2026-07-02 00:21:51.967566365 +0000 UTC m=+265.383004034" Jul 02 00:21:52.214253 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:52.214158 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/954d8cc8-f8a5-4b7c-8569-cead4287cbb5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-4jvrw\" (UID: \"954d8cc8-f8a5-4b7c-8569-cead4287cbb5\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4jvrw" Jul 02 00:21:52.214408 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:52.214297 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 00:21:52.214408 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:52.214366 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/954d8cc8-f8a5-4b7c-8569-cead4287cbb5-cluster-monitoring-operator-tls podName:954d8cc8-f8a5-4b7c-8569-cead4287cbb5 nodeName:}" failed. No retries permitted until 2026-07-02 00:21:56.214345116 +0000 UTC m=+269.629782766 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/954d8cc8-f8a5-4b7c-8569-cead4287cbb5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-4jvrw" (UID: "954d8cc8-f8a5-4b7c-8569-cead4287cbb5") : secret "cluster-monitoring-operator-tls" not found Jul 02 00:21:52.315748 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:52.315714 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-9mcb8\" (UID: \"3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-9mcb8" Jul 02 00:21:52.315748 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:52.315752 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e17f6a99-9ffb-4d7d-9031-a0939e588e14-service-ca-bundle\") pod \"router-default-6bbf6dbcc-cbv22\" (UID: \"e17f6a99-9ffb-4d7d-9031-a0939e588e14\") " pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:21:52.315977 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:52.315798 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e17f6a99-9ffb-4d7d-9031-a0939e588e14-metrics-certs\") pod \"router-default-6bbf6dbcc-cbv22\" (UID: \"e17f6a99-9ffb-4d7d-9031-a0939e588e14\") " pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:21:52.315977 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:52.315864 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 00:21:52.315977 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:52.315901 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e17f6a99-9ffb-4d7d-9031-a0939e588e14-service-ca-bundle podName:e17f6a99-9ffb-4d7d-9031-a0939e588e14 nodeName:}" failed. No retries permitted until 2026-07-02 00:21:56.315879402 +0000 UTC m=+269.731317064 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e17f6a99-9ffb-4d7d-9031-a0939e588e14-service-ca-bundle") pod "router-default-6bbf6dbcc-cbv22" (UID: "e17f6a99-9ffb-4d7d-9031-a0939e588e14") : configmap references non-existent config key: service-ca.crt Jul 02 00:21:52.315977 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:52.315910 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 00:21:52.315977 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:52.315920 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19-samples-operator-tls podName:3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19 nodeName:}" failed. No retries permitted until 2026-07-02 00:21:56.315913738 +0000 UTC m=+269.731351383 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-9mcb8" (UID: "3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19") : secret "samples-operator-tls" not found Jul 02 00:21:52.315977 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:52.315950 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e17f6a99-9ffb-4d7d-9031-a0939e588e14-metrics-certs podName:e17f6a99-9ffb-4d7d-9031-a0939e588e14 nodeName:}" failed. No retries permitted until 2026-07-02 00:21:56.315939222 +0000 UTC m=+269.731376866 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e17f6a99-9ffb-4d7d-9031-a0939e588e14-metrics-certs") pod "router-default-6bbf6dbcc-cbv22" (UID: "e17f6a99-9ffb-4d7d-9031-a0939e588e14") : secret "router-metrics-certs-default" not found Jul 02 00:21:53.153916 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.153863 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:21:53.171284 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.171253 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-dnpnt"] Jul 02 00:21:53.175047 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.175028 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-dnpnt" Jul 02 00:21:53.177558 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.177537 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 02 00:21:53.178580 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.178558 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-bf882\"" Jul 02 00:21:53.178711 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.178562 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 02 00:21:53.183066 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.183045 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-dnpnt"] Jul 02 00:21:53.249906 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.249881 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:21:53.325779 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.325747 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6flfm\" (UniqueName: \"kubernetes.io/projected/8cde6005-b26c-46de-a354-f5842cc6d299-kube-api-access-6flfm\") pod \"migrator-786f9fbc5-dnpnt\" (UID: \"8cde6005-b26c-46de-a354-f5842cc6d299\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-dnpnt" Jul 02 00:21:53.352185 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.352161 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:21:53.426812 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.426739 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6flfm\" (UniqueName: \"kubernetes.io/projected/8cde6005-b26c-46de-a354-f5842cc6d299-kube-api-access-6flfm\") pod \"migrator-786f9fbc5-dnpnt\" (UID: \"8cde6005-b26c-46de-a354-f5842cc6d299\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-dnpnt" Jul 02 00:21:53.434923 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.434892 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6flfm\" (UniqueName: \"kubernetes.io/projected/8cde6005-b26c-46de-a354-f5842cc6d299-kube-api-access-6flfm\") pod \"migrator-786f9fbc5-dnpnt\" (UID: \"8cde6005-b26c-46de-a354-f5842cc6d299\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-dnpnt" Jul 02 00:21:53.484172 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.484134 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-dnpnt" Jul 02 00:21:53.529070 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.528734 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-npfwr"] Jul 02 00:21:53.533288 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.533230 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-npfwr" Jul 02 00:21:53.536554 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.536531 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 00:21:53.537019 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.536997 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 00:21:53.537683 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.537662 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-x52fb\"" Jul 02 00:21:53.555904 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.555708 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-npfwr"] Jul 02 00:21:53.564059 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.564033 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:21:53.620302 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.620269 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:21:53.620567 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.620549 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-dnpnt"] Jul 02 00:21:53.622927 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:21:53.622906 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cde6005_b26c_46de_a354_f5842cc6d299.slice/crio-48a62a00cc120d2934476f5388c537a2aca8721de9f38d132593969f0c2b850b WatchSource:0}: Error finding container 48a62a00cc120d2934476f5388c537a2aca8721de9f38d132593969f0c2b850b: Status 404 returned error can't find the container with id 48a62a00cc120d2934476f5388c537a2aca8721de9f38d132593969f0c2b850b Jul 02 00:21:53.629502 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.629478 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7279cc09-e4af-498a-a45b-18d03393002b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npfwr\" (UID: \"7279cc09-e4af-498a-a45b-18d03393002b\") " pod="openshift-insights/insights-runtime-extractor-npfwr" Jul 02 00:21:53.629608 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.629591 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7279cc09-e4af-498a-a45b-18d03393002b-crio-socket\") pod \"insights-runtime-extractor-npfwr\" (UID: \"7279cc09-e4af-498a-a45b-18d03393002b\") " pod="openshift-insights/insights-runtime-extractor-npfwr" Jul 02 00:21:53.629658 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.629646 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7279cc09-e4af-498a-a45b-18d03393002b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-npfwr\" (UID: \"7279cc09-e4af-498a-a45b-18d03393002b\") " pod="openshift-insights/insights-runtime-extractor-npfwr" Jul 02 00:21:53.629701 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.629690 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7279cc09-e4af-498a-a45b-18d03393002b-data-volume\") pod \"insights-runtime-extractor-npfwr\" (UID: \"7279cc09-e4af-498a-a45b-18d03393002b\") " pod="openshift-insights/insights-runtime-extractor-npfwr" Jul 02 00:21:53.629792 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.629770 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx28q\" (UniqueName: \"kubernetes.io/projected/7279cc09-e4af-498a-a45b-18d03393002b-kube-api-access-fx28q\") pod \"insights-runtime-extractor-npfwr\" (UID: \"7279cc09-e4af-498a-a45b-18d03393002b\") " pod="openshift-insights/insights-runtime-extractor-npfwr" Jul 02 00:21:53.731123 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.731038 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx28q\" (UniqueName: \"kubernetes.io/projected/7279cc09-e4af-498a-a45b-18d03393002b-kube-api-access-fx28q\") pod \"insights-runtime-extractor-npfwr\" (UID: \"7279cc09-e4af-498a-a45b-18d03393002b\") " pod="openshift-insights/insights-runtime-extractor-npfwr" Jul 02 00:21:53.731123 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.731080 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7279cc09-e4af-498a-a45b-18d03393002b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npfwr\" (UID: \"7279cc09-e4af-498a-a45b-18d03393002b\") " pod="openshift-insights/insights-runtime-extractor-npfwr" Jul 02 00:21:53.731317 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:53.731177 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 00:21:53.731317 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:53.731242 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7279cc09-e4af-498a-a45b-18d03393002b-insights-runtime-extractor-tls podName:7279cc09-e4af-498a-a45b-18d03393002b nodeName:}" failed. No retries permitted until 2026-07-02 00:21:54.231219504 +0000 UTC m=+267.646657154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7279cc09-e4af-498a-a45b-18d03393002b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-npfwr" (UID: "7279cc09-e4af-498a-a45b-18d03393002b") : secret "insights-runtime-extractor-tls" not found Jul 02 00:21:53.731317 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.731306 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7279cc09-e4af-498a-a45b-18d03393002b-crio-socket\") pod \"insights-runtime-extractor-npfwr\" (UID: \"7279cc09-e4af-498a-a45b-18d03393002b\") " pod="openshift-insights/insights-runtime-extractor-npfwr" Jul 02 00:21:53.731505 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.731338 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7279cc09-e4af-498a-a45b-18d03393002b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-npfwr\" (UID: \"7279cc09-e4af-498a-a45b-18d03393002b\") " pod="openshift-insights/insights-runtime-extractor-npfwr" Jul 02 00:21:53.731505 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.731366 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7279cc09-e4af-498a-a45b-18d03393002b-data-volume\") pod \"insights-runtime-extractor-npfwr\" (UID: \"7279cc09-e4af-498a-a45b-18d03393002b\") " pod="openshift-insights/insights-runtime-extractor-npfwr" Jul 02 00:21:53.731505 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:53.731445 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 00:21:53.731505 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.731452 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7279cc09-e4af-498a-a45b-18d03393002b-crio-socket\") pod \"insights-runtime-extractor-npfwr\" (UID: \"7279cc09-e4af-498a-a45b-18d03393002b\") " pod="openshift-insights/insights-runtime-extractor-npfwr" Jul 02 00:21:53.731505 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:53.731493 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7279cc09-e4af-498a-a45b-18d03393002b-kube-rbac-proxy-cm podName:7279cc09-e4af-498a-a45b-18d03393002b nodeName:}" failed. No retries permitted until 2026-07-02 00:21:54.231480411 +0000 UTC m=+267.646918074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7279cc09-e4af-498a-a45b-18d03393002b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-npfwr" (UID: "7279cc09-e4af-498a-a45b-18d03393002b") : configmap "kube-rbac-proxy" not found Jul 02 00:21:53.731731 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.731716 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7279cc09-e4af-498a-a45b-18d03393002b-data-volume\") pod \"insights-runtime-extractor-npfwr\" (UID: \"7279cc09-e4af-498a-a45b-18d03393002b\") " pod="openshift-insights/insights-runtime-extractor-npfwr" Jul 02 00:21:53.739538 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.739517 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx28q\" (UniqueName: \"kubernetes.io/projected/7279cc09-e4af-498a-a45b-18d03393002b-kube-api-access-fx28q\") pod \"insights-runtime-extractor-npfwr\" (UID: \"7279cc09-e4af-498a-a45b-18d03393002b\") " pod="openshift-insights/insights-runtime-extractor-npfwr" Jul 02 00:21:53.952528 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:53.952493 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-dnpnt" event={"ID":"8cde6005-b26c-46de-a354-f5842cc6d299","Type":"ContainerStarted","Data":"48a62a00cc120d2934476f5388c537a2aca8721de9f38d132593969f0c2b850b"} Jul 02 00:21:54.235022 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:54.234978 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7279cc09-e4af-498a-a45b-18d03393002b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npfwr\" (UID: \"7279cc09-e4af-498a-a45b-18d03393002b\") " pod="openshift-insights/insights-runtime-extractor-npfwr" Jul 02 00:21:54.235481 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:54.235129 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 00:21:54.235481 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:54.235204 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7279cc09-e4af-498a-a45b-18d03393002b-insights-runtime-extractor-tls podName:7279cc09-e4af-498a-a45b-18d03393002b nodeName:}" failed. No retries permitted until 2026-07-02 00:21:55.235186257 +0000 UTC m=+268.650623924 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7279cc09-e4af-498a-a45b-18d03393002b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-npfwr" (UID: "7279cc09-e4af-498a-a45b-18d03393002b") : secret "insights-runtime-extractor-tls" not found Jul 02 00:21:54.235481 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:54.235230 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7279cc09-e4af-498a-a45b-18d03393002b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-npfwr\" (UID: \"7279cc09-e4af-498a-a45b-18d03393002b\") " pod="openshift-insights/insights-runtime-extractor-npfwr" Jul 02 00:21:54.235481 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:54.235359 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 00:21:54.235481 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:54.235407 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7279cc09-e4af-498a-a45b-18d03393002b-kube-rbac-proxy-cm podName:7279cc09-e4af-498a-a45b-18d03393002b nodeName:}" failed. No retries permitted until 2026-07-02 00:21:55.235394629 +0000 UTC m=+268.650832284 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7279cc09-e4af-498a-a45b-18d03393002b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-npfwr" (UID: "7279cc09-e4af-498a-a45b-18d03393002b") : configmap "kube-rbac-proxy" not found Jul 02 00:21:55.245610 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:55.245583 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7279cc09-e4af-498a-a45b-18d03393002b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npfwr\" (UID: \"7279cc09-e4af-498a-a45b-18d03393002b\") " pod="openshift-insights/insights-runtime-extractor-npfwr" Jul 02 00:21:55.245902 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:55.245700 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7279cc09-e4af-498a-a45b-18d03393002b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-npfwr\" (UID: \"7279cc09-e4af-498a-a45b-18d03393002b\") " pod="openshift-insights/insights-runtime-extractor-npfwr" Jul 02 00:21:55.245902 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:55.245742 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 00:21:55.245902 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:55.245805 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7279cc09-e4af-498a-a45b-18d03393002b-insights-runtime-extractor-tls podName:7279cc09-e4af-498a-a45b-18d03393002b nodeName:}" failed. No retries permitted until 2026-07-02 00:21:57.245788811 +0000 UTC m=+270.661226475 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7279cc09-e4af-498a-a45b-18d03393002b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-npfwr" (UID: "7279cc09-e4af-498a-a45b-18d03393002b") : secret "insights-runtime-extractor-tls" not found Jul 02 00:21:55.245902 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:55.245806 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 00:21:55.245902 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:55.245847 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7279cc09-e4af-498a-a45b-18d03393002b-kube-rbac-proxy-cm podName:7279cc09-e4af-498a-a45b-18d03393002b nodeName:}" failed. No retries permitted until 2026-07-02 00:21:57.245836223 +0000 UTC m=+270.661273871 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7279cc09-e4af-498a-a45b-18d03393002b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-npfwr" (UID: "7279cc09-e4af-498a-a45b-18d03393002b") : configmap "kube-rbac-proxy" not found Jul 02 00:21:55.961200 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:55.961165 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-dnpnt" event={"ID":"8cde6005-b26c-46de-a354-f5842cc6d299","Type":"ContainerStarted","Data":"b9107debd18e58b6bfbe5a3e3211b360e174e61774c78552fc3c13dcbe648472"} Jul 02 00:21:55.961543 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:55.961232 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-dnpnt" event={"ID":"8cde6005-b26c-46de-a354-f5842cc6d299","Type":"ContainerStarted","Data":"41ccd249472c140e978540924b7eb1fab15e2b7d0d85dd43e059567e8280cb82"} Jul 02 00:21:55.975761 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:55.975690 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-dnpnt" podStartSLOduration=1.468960435 podStartE2EDuration="2.975676745s" totalImagesPullingTime="1.50671631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:21:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:21:55.975618554 +0000 UTC m=+269.391056221" watchObservedRunningTime="2026-07-02 00:21:55.975676745 +0000 UTC m=+269.391114390" Jul 02 00:21:56.049827 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:56.049778 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:21:56.154310 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:56.151452 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:21:56.204672 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:56.204645 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kcpxt_d32c2993-ca5d-4b91-9051-53784803a737/dns-node-resolver/0.log" Jul 02 00:21:56.251078 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:56.251054 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:21:56.255224 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:56.255203 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/954d8cc8-f8a5-4b7c-8569-cead4287cbb5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-4jvrw\" (UID: \"954d8cc8-f8a5-4b7c-8569-cead4287cbb5\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4jvrw" Jul 02 00:21:56.255368 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:56.255353 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 00:21:56.255442 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:56.255433 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/954d8cc8-f8a5-4b7c-8569-cead4287cbb5-cluster-monitoring-operator-tls podName:954d8cc8-f8a5-4b7c-8569-cead4287cbb5 nodeName:}" failed. No retries permitted until 2026-07-02 00:22:04.255396402 +0000 UTC m=+277.670834061 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/954d8cc8-f8a5-4b7c-8569-cead4287cbb5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-4jvrw" (UID: "954d8cc8-f8a5-4b7c-8569-cead4287cbb5") : secret "cluster-monitoring-operator-tls" not found Jul 02 00:21:56.356593 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:56.356560 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e17f6a99-9ffb-4d7d-9031-a0939e588e14-metrics-certs\") pod \"router-default-6bbf6dbcc-cbv22\" (UID: \"e17f6a99-9ffb-4d7d-9031-a0939e588e14\") " pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:21:56.356735 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:56.356675 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-9mcb8\" (UID: \"3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-9mcb8" Jul 02 00:21:56.356735 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:56.356697 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e17f6a99-9ffb-4d7d-9031-a0939e588e14-service-ca-bundle\") pod \"router-default-6bbf6dbcc-cbv22\" (UID: \"e17f6a99-9ffb-4d7d-9031-a0939e588e14\") " pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:21:56.356735 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:56.356711 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 00:21:56.356835 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:56.356794 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e17f6a99-9ffb-4d7d-9031-a0939e588e14-metrics-certs podName:e17f6a99-9ffb-4d7d-9031-a0939e588e14 nodeName:}" failed. No retries permitted until 2026-07-02 00:22:04.356773004 +0000 UTC m=+277.772210655 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e17f6a99-9ffb-4d7d-9031-a0939e588e14-metrics-certs") pod "router-default-6bbf6dbcc-cbv22" (UID: "e17f6a99-9ffb-4d7d-9031-a0939e588e14") : secret "router-metrics-certs-default" not found Jul 02 00:21:56.356835 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:56.356803 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 00:21:56.356835 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:56.356814 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e17f6a99-9ffb-4d7d-9031-a0939e588e14-service-ca-bundle podName:e17f6a99-9ffb-4d7d-9031-a0939e588e14 nodeName:}" failed. No retries permitted until 2026-07-02 00:22:04.356802027 +0000 UTC m=+277.772239672 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e17f6a99-9ffb-4d7d-9031-a0939e588e14-service-ca-bundle") pod "router-default-6bbf6dbcc-cbv22" (UID: "e17f6a99-9ffb-4d7d-9031-a0939e588e14") : configmap references non-existent config key: service-ca.crt Jul 02 00:21:56.356934 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:56.356840 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19-samples-operator-tls podName:3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19 nodeName:}" failed. No retries permitted until 2026-07-02 00:22:04.3568295 +0000 UTC m=+277.772267154 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-9mcb8" (UID: "3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19") : secret "samples-operator-tls" not found Jul 02 00:21:56.792319 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:56.792285 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:21:56.892531 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:56.892508 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:21:57.264558 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:57.264524 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7279cc09-e4af-498a-a45b-18d03393002b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npfwr\" (UID: \"7279cc09-e4af-498a-a45b-18d03393002b\") " pod="openshift-insights/insights-runtime-extractor-npfwr" Jul 02 00:21:57.264930 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:57.264614 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7279cc09-e4af-498a-a45b-18d03393002b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-npfwr\" (UID: \"7279cc09-e4af-498a-a45b-18d03393002b\") " pod="openshift-insights/insights-runtime-extractor-npfwr" Jul 02 00:21:57.264930 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:57.264681 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 00:21:57.264930 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:57.264742 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7279cc09-e4af-498a-a45b-18d03393002b-insights-runtime-extractor-tls podName:7279cc09-e4af-498a-a45b-18d03393002b nodeName:}" failed. No retries permitted until 2026-07-02 00:22:01.264728197 +0000 UTC m=+274.680165841 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7279cc09-e4af-498a-a45b-18d03393002b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-npfwr" (UID: "7279cc09-e4af-498a-a45b-18d03393002b") : secret "insights-runtime-extractor-tls" not found Jul 02 00:21:57.264930 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:57.264692 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 00:21:57.264930 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:21:57.264813 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7279cc09-e4af-498a-a45b-18d03393002b-kube-rbac-proxy-cm podName:7279cc09-e4af-498a-a45b-18d03393002b nodeName:}" failed. No retries permitted until 2026-07-02 00:22:01.264797224 +0000 UTC m=+274.680234884 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7279cc09-e4af-498a-a45b-18d03393002b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-npfwr" (UID: "7279cc09-e4af-498a-a45b-18d03393002b") : configmap "kube-rbac-proxy" not found Jul 02 00:21:57.603693 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:57.603620 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-swljq_8a8c9b7b-235d-45e2-a810-d0db55313f20/node-ca/0.log" Jul 02 00:21:58.004636 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:58.004611 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8gm58_ab4130b0-b250-4476-8c49-5c45b2d82f25/serve-healthcheck-canary/0.log" Jul 02 00:21:58.424432 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:58.424335 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:21:58.477154 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:58.477127 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:21:58.604302 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:58.604270 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-dnpnt_8cde6005-b26c-46de-a354-f5842cc6d299/migrator/0.log" Jul 02 00:21:58.805199 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:58.805171 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-dnpnt_8cde6005-b26c-46de-a354-f5842cc6d299/graceful-termination/0.log" Jul 02 00:21:59.005906 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:59.005877 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-qq8c8_a769b185-fefb-40c7-a21f-137f612e9d66/kube-storage-version-migrator-operator/0.log" Jul 02 00:21:59.320984 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:21:59.320955 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:01.297159 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:01.297126 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7279cc09-e4af-498a-a45b-18d03393002b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npfwr\" (UID: \"7279cc09-e4af-498a-a45b-18d03393002b\") " pod="openshift-insights/insights-runtime-extractor-npfwr" Jul 02 00:22:01.297608 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:01.297236 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7279cc09-e4af-498a-a45b-18d03393002b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-npfwr\" (UID: \"7279cc09-e4af-498a-a45b-18d03393002b\") " pod="openshift-insights/insights-runtime-extractor-npfwr" Jul 02 00:22:01.297608 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:22:01.297283 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 00:22:01.297608 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:22:01.297348 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7279cc09-e4af-498a-a45b-18d03393002b-insights-runtime-extractor-tls podName:7279cc09-e4af-498a-a45b-18d03393002b nodeName:}" failed. No retries permitted until 2026-07-02 00:22:09.297333744 +0000 UTC m=+282.712771405 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7279cc09-e4af-498a-a45b-18d03393002b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-npfwr" (UID: "7279cc09-e4af-498a-a45b-18d03393002b") : secret "insights-runtime-extractor-tls" not found Jul 02 00:22:01.297608 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:22:01.297361 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 00:22:01.297608 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:22:01.297453 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7279cc09-e4af-498a-a45b-18d03393002b-kube-rbac-proxy-cm podName:7279cc09-e4af-498a-a45b-18d03393002b nodeName:}" failed. No retries permitted until 2026-07-02 00:22:09.297433988 +0000 UTC m=+282.712871652 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7279cc09-e4af-498a-a45b-18d03393002b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-npfwr" (UID: "7279cc09-e4af-498a-a45b-18d03393002b") : configmap "kube-rbac-proxy" not found Jul 02 00:22:02.394095 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:02.394062 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:03.725255 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:03.725222 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:03.872546 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:03.872510 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:04.108827 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:04.108791 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:04.209312 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:04.209283 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:04.318317 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:04.318285 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:04.324634 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:04.324612 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/954d8cc8-f8a5-4b7c-8569-cead4287cbb5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-4jvrw\" (UID: \"954d8cc8-f8a5-4b7c-8569-cead4287cbb5\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4jvrw" Jul 02 00:22:04.324776 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:22:04.324761 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 00:22:04.324833 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:22:04.324824 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/954d8cc8-f8a5-4b7c-8569-cead4287cbb5-cluster-monitoring-operator-tls podName:954d8cc8-f8a5-4b7c-8569-cead4287cbb5 nodeName:}" failed. No retries permitted until 2026-07-02 00:22:20.324805434 +0000 UTC m=+293.740243091 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/954d8cc8-f8a5-4b7c-8569-cead4287cbb5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-4jvrw" (UID: "954d8cc8-f8a5-4b7c-8569-cead4287cbb5") : secret "cluster-monitoring-operator-tls" not found Jul 02 00:22:04.418941 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:04.418859 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:04.426018 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:04.425987 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-9mcb8\" (UID: \"3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-9mcb8" Jul 02 00:22:04.426144 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:04.426029 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e17f6a99-9ffb-4d7d-9031-a0939e588e14-service-ca-bundle\") pod \"router-default-6bbf6dbcc-cbv22\" (UID: \"e17f6a99-9ffb-4d7d-9031-a0939e588e14\") " pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:22:04.426144 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:04.426082 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e17f6a99-9ffb-4d7d-9031-a0939e588e14-metrics-certs\") pod \"router-default-6bbf6dbcc-cbv22\" (UID: \"e17f6a99-9ffb-4d7d-9031-a0939e588e14\") " pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:22:04.426144 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:22:04.426133 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 00:22:04.426295 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:22:04.426187 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19-samples-operator-tls podName:3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19 nodeName:}" failed. No retries permitted until 2026-07-02 00:22:20.426172599 +0000 UTC m=+293.841610283 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-9mcb8" (UID: "3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19") : secret "samples-operator-tls" not found Jul 02 00:22:04.426295 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:22:04.426216 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e17f6a99-9ffb-4d7d-9031-a0939e588e14-service-ca-bundle podName:e17f6a99-9ffb-4d7d-9031-a0939e588e14 nodeName:}" failed. No retries permitted until 2026-07-02 00:22:20.426199523 +0000 UTC m=+293.841637168 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e17f6a99-9ffb-4d7d-9031-a0939e588e14-service-ca-bundle") pod "router-default-6bbf6dbcc-cbv22" (UID: "e17f6a99-9ffb-4d7d-9031-a0939e588e14") : configmap references non-existent config key: service-ca.crt Jul 02 00:22:04.426295 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:22:04.426219 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 00:22:04.426295 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:22:04.426279 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e17f6a99-9ffb-4d7d-9031-a0939e588e14-metrics-certs podName:e17f6a99-9ffb-4d7d-9031-a0939e588e14 nodeName:}" failed. No retries permitted until 2026-07-02 00:22:20.426261587 +0000 UTC m=+293.841699234 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e17f6a99-9ffb-4d7d-9031-a0939e588e14-metrics-certs") pod "router-default-6bbf6dbcc-cbv22" (UID: "e17f6a99-9ffb-4d7d-9031-a0939e588e14") : secret "router-metrics-certs-default" not found Jul 02 00:22:04.518951 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:04.518920 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:05.397136 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:05.397092 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:05.715315 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:05.715237 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:05.816029 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:05.816001 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:05.996177 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:05.996151 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:06.194155 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:06.194113 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:06.292150 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:06.292087 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:06.391696 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:06.391666 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:07.188566 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:07.188537 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:07.602219 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:07.602185 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:07.675848 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:22:07.675820 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zn9z5" podUID="2a6a9ab0-db65-483f-8eb1-ad0220bb56a3" Jul 02 00:22:07.675848 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:22:07.675840 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" podUID="3c528ee8-34d5-41d5-ac52-1ce87a4a240f" Jul 02 00:22:07.675998 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:22:07.675854 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-8jnpt" podUID="2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2" Jul 02 00:22:07.792626 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:07.792600 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:07.894259 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:07.894189 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:07.995755 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:07.995730 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zn9z5" Jul 02 00:22:07.995864 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:07.995730 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-8jnpt" Jul 02 00:22:07.995915 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:07.995737 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:22:08.001522 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:08.001503 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:08.049180 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:08.049162 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:08.191713 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:08.191639 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:08.391470 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:08.391438 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:09.368950 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:09.368921 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7279cc09-e4af-498a-a45b-18d03393002b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npfwr\" (UID: \"7279cc09-e4af-498a-a45b-18d03393002b\") " pod="openshift-insights/insights-runtime-extractor-npfwr" Jul 02 00:22:09.369320 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:22:09.369062 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 00:22:09.369320 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:09.369066 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7279cc09-e4af-498a-a45b-18d03393002b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-npfwr\" (UID: \"7279cc09-e4af-498a-a45b-18d03393002b\") " pod="openshift-insights/insights-runtime-extractor-npfwr" Jul 02 00:22:09.369320 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:22:09.369141 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7279cc09-e4af-498a-a45b-18d03393002b-insights-runtime-extractor-tls podName:7279cc09-e4af-498a-a45b-18d03393002b nodeName:}" failed. No retries permitted until 2026-07-02 00:22:25.369119933 +0000 UTC m=+298.784557579 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7279cc09-e4af-498a-a45b-18d03393002b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-npfwr" (UID: "7279cc09-e4af-498a-a45b-18d03393002b") : secret "insights-runtime-extractor-tls" not found Jul 02 00:22:09.369621 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:09.369604 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7279cc09-e4af-498a-a45b-18d03393002b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-npfwr\" (UID: \"7279cc09-e4af-498a-a45b-18d03393002b\") " pod="openshift-insights/insights-runtime-extractor-npfwr" Jul 02 00:22:09.402523 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:09.402498 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:09.594283 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:09.594253 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:09.990451 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:09.990410 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:10.197276 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:10.197244 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:10.247877 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:10.247849 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:10.594253 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:10.594181 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:11.084220 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:11.084187 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-8jnpt\" (UID: \"2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-8jnpt" Jul 02 00:22:11.084387 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:11.084278 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:22:11.084387 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:22:11.084325 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 00:22:11.084387 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:22:11.084382 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert podName:2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2 nodeName:}" failed. No retries permitted until 2026-07-02 00:24:13.08436785 +0000 UTC m=+406.499805495 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-8jnpt" (UID: "2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2") : secret "networking-console-plugin-cert" not found Jul 02 00:22:11.086565 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:11.086545 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls\") pod \"image-registry-c4d86f8c4-jlszr\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:22:11.184784 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:11.184749 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-metrics-tls\") pod \"dns-default-zn9z5\" (UID: \"2a6a9ab0-db65-483f-8eb1-ad0220bb56a3\") " pod="openshift-dns/dns-default-zn9z5" Jul 02 00:22:11.186944 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:11.186924 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a6a9ab0-db65-483f-8eb1-ad0220bb56a3-metrics-tls\") pod \"dns-default-zn9z5\" (UID: \"2a6a9ab0-db65-483f-8eb1-ad0220bb56a3\") " pod="openshift-dns/dns-default-zn9z5" Jul 02 00:22:11.192523 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:11.192494 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:11.299936 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:11.299906 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t7ssp\"" Jul 02 00:22:11.299936 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:11.299906 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6xp6s\"" Jul 02 00:22:11.307008 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:11.306988 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:22:11.307067 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:11.307019 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zn9z5" Jul 02 00:22:11.437825 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:11.437802 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zn9z5"] Jul 02 00:22:11.440024 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:22:11.440000 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a6a9ab0_db65_483f_8eb1_ad0220bb56a3.slice/crio-308201793c69de35dd4c7104a983d646f6292b277535568f42d87b783b02d106 WatchSource:0}: Error finding container 308201793c69de35dd4c7104a983d646f6292b277535568f42d87b783b02d106: Status 404 returned error can't find the container with id 308201793c69de35dd4c7104a983d646f6292b277535568f42d87b783b02d106 Jul 02 00:22:11.454648 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:11.454611 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c4d86f8c4-jlszr"] Jul 02 00:22:11.458672 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:22:11.458645 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c528ee8_34d5_41d5_ac52_1ce87a4a240f.slice/crio-930b4391fb444bbf5deb30382c7a0c681d34fc7b893d08564fe1238efc066652 WatchSource:0}: Error finding container 930b4391fb444bbf5deb30382c7a0c681d34fc7b893d08564fe1238efc066652: Status 404 returned error can't find the container with id 930b4391fb444bbf5deb30382c7a0c681d34fc7b893d08564fe1238efc066652 Jul 02 00:22:11.591105 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:11.591058 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:11.988573 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:11.988543 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:12.009059 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:12.009028 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zn9z5" event={"ID":"2a6a9ab0-db65-483f-8eb1-ad0220bb56a3","Type":"ContainerStarted","Data":"308201793c69de35dd4c7104a983d646f6292b277535568f42d87b783b02d106"} Jul 02 00:22:12.010344 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:12.010322 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" event={"ID":"3c528ee8-34d5-41d5-ac52-1ce87a4a240f","Type":"ContainerStarted","Data":"abc139b78c1f9b0c37e9ec8c5fef7272a376471b72ed1300e10afcd61e375261"} Jul 02 00:22:12.010475 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:12.010363 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" event={"ID":"3c528ee8-34d5-41d5-ac52-1ce87a4a240f","Type":"ContainerStarted","Data":"930b4391fb444bbf5deb30382c7a0c681d34fc7b893d08564fe1238efc066652"} Jul 02 00:22:12.010475 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:12.010457 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:22:12.030956 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:12.030911 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" podStartSLOduration=263.030898096 podStartE2EDuration="4m23.030898096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:17:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:22:12.029914502 +0000 UTC m=+285.445352169" watchObservedRunningTime="2026-07-02 00:22:12.030898096 +0000 UTC m=+285.446335763" Jul 02 00:22:12.388226 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:12.388192 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:12.588918 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:12.588886 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:12.993762 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:12.993721 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:13.592168 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:13.592132 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:13.990201 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:13.990176 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:14.018428 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:14.018392 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zn9z5" event={"ID":"2a6a9ab0-db65-483f-8eb1-ad0220bb56a3","Type":"ContainerStarted","Data":"699082adde5206a14b6d624931fbb905873d1bffdabe48cf74794f19a8d3826a"} Jul 02 00:22:14.018834 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:14.018463 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zn9z5" event={"ID":"2a6a9ab0-db65-483f-8eb1-ad0220bb56a3","Type":"ContainerStarted","Data":"d126890b7e87c90e8ba4ab99585031452f418e7e277f8d1d7f260e9154e1b774"} Jul 02 00:22:14.018834 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:14.018563 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zn9z5" Jul 02 00:22:14.036258 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:14.036182 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zn9z5" podStartSLOduration=250.64864078 podStartE2EDuration="4m13.036163945s" totalImagesPullingTime="2.387523165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:18:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:22:14.035727864 +0000 UTC m=+287.451165543" watchObservedRunningTime="2026-07-02 00:22:14.036163945 +0000 UTC m=+287.451601616" Jul 02 00:22:14.197622 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:14.197552 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:14.389211 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:14.389184 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:17.062463 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:17.062432 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:17.130457 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:17.130402 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:18.605132 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:18.605093 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:18.705485 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:18.705454 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:20.359531 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:20.359492 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/954d8cc8-f8a5-4b7c-8569-cead4287cbb5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-4jvrw\" (UID: \"954d8cc8-f8a5-4b7c-8569-cead4287cbb5\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4jvrw" Jul 02 00:22:20.361894 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:20.361870 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/954d8cc8-f8a5-4b7c-8569-cead4287cbb5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-4jvrw\" (UID: \"954d8cc8-f8a5-4b7c-8569-cead4287cbb5\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4jvrw" Jul 02 00:22:20.460293 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:20.460262 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-9mcb8\" (UID: \"3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-9mcb8" Jul 02 00:22:20.460464 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:20.460296 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e17f6a99-9ffb-4d7d-9031-a0939e588e14-service-ca-bundle\") pod \"router-default-6bbf6dbcc-cbv22\" (UID: \"e17f6a99-9ffb-4d7d-9031-a0939e588e14\") " pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:22:20.460464 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:20.460324 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e17f6a99-9ffb-4d7d-9031-a0939e588e14-metrics-certs\") pod \"router-default-6bbf6dbcc-cbv22\" (UID: \"e17f6a99-9ffb-4d7d-9031-a0939e588e14\") " pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:22:20.460923 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:20.460890 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e17f6a99-9ffb-4d7d-9031-a0939e588e14-service-ca-bundle\") pod \"router-default-6bbf6dbcc-cbv22\" (UID: \"e17f6a99-9ffb-4d7d-9031-a0939e588e14\") " pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:22:20.462669 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:20.462641 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e17f6a99-9ffb-4d7d-9031-a0939e588e14-metrics-certs\") pod \"router-default-6bbf6dbcc-cbv22\" (UID: \"e17f6a99-9ffb-4d7d-9031-a0939e588e14\") " pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:22:20.462669 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:20.462654 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-9mcb8\" (UID: \"3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-9mcb8" Jul 02 00:22:20.627901 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:20.627823 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4jvrw" Jul 02 00:22:20.633050 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:20.633023 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:22:20.709685 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:20.709336 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-9mcb8" Jul 02 00:22:20.782626 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:20.782597 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-4jvrw"] Jul 02 00:22:20.786809 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:22:20.786779 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod954d8cc8_f8a5_4b7c_8569_cead4287cbb5.slice/crio-e09b021a6196424d1fc9aec7ea311f22394bcb40e8d37491a3144505371efd3d WatchSource:0}: Error finding container e09b021a6196424d1fc9aec7ea311f22394bcb40e8d37491a3144505371efd3d: Status 404 returned error can't find the container with id e09b021a6196424d1fc9aec7ea311f22394bcb40e8d37491a3144505371efd3d Jul 02 00:22:20.805158 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:20.805050 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6bbf6dbcc-cbv22"] Jul 02 00:22:20.807527 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:22:20.807499 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode17f6a99_9ffb_4d7d_9031_a0939e588e14.slice/crio-30f701d96c2cd13af44fea07c31aae4387d87b4f44beecc33935988f84d4b83b WatchSource:0}: Error finding container 30f701d96c2cd13af44fea07c31aae4387d87b4f44beecc33935988f84d4b83b: Status 404 returned error can't find the container with id 30f701d96c2cd13af44fea07c31aae4387d87b4f44beecc33935988f84d4b83b Jul 02 00:22:20.847930 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:20.847900 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-9mcb8"] Jul 02 00:22:21.043866 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:21.043831 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-9mcb8" event={"ID":"3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19","Type":"ContainerStarted","Data":"03c0e83687ccf337617609dd8b8485ef4e6f2420c8471c3482c487b5a6800a85"} Jul 02 00:22:21.045270 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:21.045241 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" event={"ID":"e17f6a99-9ffb-4d7d-9031-a0939e588e14","Type":"ContainerStarted","Data":"61f7579a975eaad4624b071723396a2e3eb6063637992f152fd0ff2736221589"} Jul 02 00:22:21.045441 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:21.045288 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" event={"ID":"e17f6a99-9ffb-4d7d-9031-a0939e588e14","Type":"ContainerStarted","Data":"30f701d96c2cd13af44fea07c31aae4387d87b4f44beecc33935988f84d4b83b"} Jul 02 00:22:21.046217 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:21.046199 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4jvrw" event={"ID":"954d8cc8-f8a5-4b7c-8569-cead4287cbb5","Type":"ContainerStarted","Data":"e09b021a6196424d1fc9aec7ea311f22394bcb40e8d37491a3144505371efd3d"} Jul 02 00:22:21.061974 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:22:21.061942 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-7tkzk" podUID="3c33c8e2-8b03-4815-8cd7-d72d4eb01015" Jul 02 00:22:21.063058 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:21.063010 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" podStartSLOduration=33.062997564 podStartE2EDuration="33.062997564s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:21:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:22:21.061963319 +0000 UTC m=+294.477400988" watchObservedRunningTime="2026-07-02 00:22:21.062997564 +0000 UTC m=+294.478435210" Jul 02 00:22:21.633701 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:21.633655 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:22:21.636573 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:21.636549 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:22:22.049846 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:22.049817 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:22:22.050980 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:22.050960 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6bbf6dbcc-cbv22" Jul 02 00:22:22.232002 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:22.231951 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:22.332239 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:22.332150 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:22.382270 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:22.382232 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:23.055540 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:23.055446 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-9mcb8" event={"ID":"3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19","Type":"ContainerStarted","Data":"e88fd92a6ac9fc1c5f4751034462663c16224be9f71c1d038e417dda05798c62"} Jul 02 00:22:23.055540 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:23.055502 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-9mcb8" event={"ID":"3c80d8b0-8a0f-4eb1-9a66-c445f62e2a19","Type":"ContainerStarted","Data":"78089bc0164ee3f882da08831185ccc3bd8d7cbb87af6ff23247c7445dcb7618"} Jul 02 00:22:23.072125 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:23.072054 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-9mcb8" podStartSLOduration=33.174723529 podStartE2EDuration="35.07203701s" totalImagesPullingTime="1.897313481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:21:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:22:23.07141175 +0000 UTC m=+296.486849418" watchObservedRunningTime="2026-07-02 00:22:23.07203701 +0000 UTC m=+296.487474678" Jul 02 00:22:23.133126 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:23.133078 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:23.193082 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:23.193051 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:23.757846 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:23.757814 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:23.909489 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:23.909457 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:24.024123 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:24.024045 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zn9z5" Jul 02 00:22:24.063068 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:24.063038 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4jvrw" event={"ID":"954d8cc8-f8a5-4b7c-8569-cead4287cbb5","Type":"ContainerStarted","Data":"57f833c4704cec643d9b05bb4f9dcf291fce59f561d248eb58acf346a69e61ff"} Jul 02 00:22:24.094524 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:24.094470 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4jvrw" podStartSLOduration=33.448910754 podStartE2EDuration="36.094436747s" totalImagesPullingTime="2.645525993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:21:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:22:24.092671169 +0000 UTC m=+297.508108837" watchObservedRunningTime="2026-07-02 00:22:24.094436747 +0000 UTC m=+297.509874413" Jul 02 00:22:24.134174 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:24.134141 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:25.400429 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:25.400397 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7279cc09-e4af-498a-a45b-18d03393002b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npfwr\" (UID: \"7279cc09-e4af-498a-a45b-18d03393002b\") " pod="openshift-insights/insights-runtime-extractor-npfwr" Jul 02 00:22:25.402433 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:25.402388 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7279cc09-e4af-498a-a45b-18d03393002b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npfwr\" (UID: \"7279cc09-e4af-498a-a45b-18d03393002b\") " pod="openshift-insights/insights-runtime-extractor-npfwr" Jul 02 00:22:25.644940 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:25.644910 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-npfwr" Jul 02 00:22:25.765356 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:25.765282 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-npfwr"] Jul 02 00:22:25.767404 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:22:25.767383 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7279cc09_e4af_498a_a45b_18d03393002b.slice/crio-da3c9a05df322c5c4d824008a58073d63539f84ee379f33455fa60bfeefa6e62 WatchSource:0}: Error finding container da3c9a05df322c5c4d824008a58073d63539f84ee379f33455fa60bfeefa6e62: Status 404 returned error can't find the container with id da3c9a05df322c5c4d824008a58073d63539f84ee379f33455fa60bfeefa6e62 Jul 02 00:22:26.073656 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:26.073616 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-npfwr" event={"ID":"7279cc09-e4af-498a-a45b-18d03393002b","Type":"ContainerStarted","Data":"da3c9a05df322c5c4d824008a58073d63539f84ee379f33455fa60bfeefa6e62"} Jul 02 00:22:27.012368 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:27.012337 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55kgg_3ea67bc7-0faa-4fa0-904c-adfea68a4992/ovn-acl-logging/0.log" Jul 02 00:22:27.013625 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:27.013597 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55kgg_3ea67bc7-0faa-4fa0-904c-adfea68a4992/ovn-acl-logging/0.log" Jul 02 00:22:27.021446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:27.021404 2581 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 00:22:27.941556 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:27.941518 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:28.010738 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:28.010687 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:28.130635 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:28.130597 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:29.430520 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:29.430499 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 00:22:30.091034 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:30.091008 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-npfwr" event={"ID":"7279cc09-e4af-498a-a45b-18d03393002b","Type":"ContainerStarted","Data":"cb09b242cbde87136b352d1140641aa14594737f3a03ec48b7ff43218132dd0e"} Jul 02 00:22:30.091156 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:30.091107 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-npfwr" event={"ID":"7279cc09-e4af-498a-a45b-18d03393002b","Type":"ContainerStarted","Data":"7ae2a9346452dfd1468057d50088ff400049c2872c4f0fabc22fd6e83059e986"} Jul 02 00:22:31.313269 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:31.313230 2581 patch_prober.go:28] interesting pod/image-registry-c4d86f8c4-jlszr container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 02 00:22:31.313717 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:31.313295 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" podUID="3c528ee8-34d5-41d5-ac52-1ce87a4a240f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 00:22:31.859323 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:31.859285 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:33.017741 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:33.017719 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:22:33.102989 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:33.102955 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-npfwr" event={"ID":"7279cc09-e4af-498a-a45b-18d03393002b","Type":"ContainerStarted","Data":"0f45f279816385aeaa364058600be7437c1bd40281bcd5762cdd138d88390614"} Jul 02 00:22:33.123772 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:33.123727 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-npfwr" podStartSLOduration=33.620370599 podStartE2EDuration="40.123712671s" totalImagesPullingTime="6.503342072s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 00:21:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:22:33.12292614 +0000 UTC m=+306.538363808" watchObservedRunningTime="2026-07-02 00:22:33.123712671 +0000 UTC m=+306.539150338" Jul 02 00:22:33.140674 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:33.140653 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:33.441631 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:33.441548 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:33.542302 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:33.542271 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:35.096113 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.096084 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:35.302605 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.302575 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:35.341343 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.341313 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-r4fbj"] Jul 02 00:22:35.347840 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.347812 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-r4fbj" Jul 02 00:22:35.351502 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.351478 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 02 00:22:35.351684 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.351553 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 00:22:35.351684 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.351598 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7k9gt\"" Jul 02 00:22:35.351684 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.351598 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 02 00:22:35.351684 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.351646 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 02 00:22:35.358457 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.358432 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-f66ml"] Jul 02 00:22:35.361974 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.361958 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-r4fbj"] Jul 02 00:22:35.362051 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.362045 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f66ml" Jul 02 00:22:35.365314 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.365294 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 00:22:35.365782 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.365761 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 00:22:35.365927 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.365911 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 00:22:35.366376 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.366358 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gcr8q\"" Jul 02 00:22:35.416347 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.416318 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:35.484620 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.484594 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87deb294-03cf-4e01-94aa-90bc5e0e36bb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f66ml\" (UID: \"87deb294-03cf-4e01-94aa-90bc5e0e36bb\") " pod="openshift-monitoring/node-exporter-f66ml" Jul 02 00:22:35.484725 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.484624 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g4tj\" (UniqueName: \"kubernetes.io/projected/35182afa-99f0-4ffd-ab82-e8b111076888-kube-api-access-9g4tj\") pod \"kube-state-metrics-845b954455-r4fbj\" (UID: \"35182afa-99f0-4ffd-ab82-e8b111076888\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r4fbj" Jul 02 00:22:35.484725 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.484647 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/87deb294-03cf-4e01-94aa-90bc5e0e36bb-node-exporter-textfile\") pod \"node-exporter-f66ml\" (UID: \"87deb294-03cf-4e01-94aa-90bc5e0e36bb\") " pod="openshift-monitoring/node-exporter-f66ml" Jul 02 00:22:35.484725 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.484665 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/87deb294-03cf-4e01-94aa-90bc5e0e36bb-node-exporter-accelerators-collector-config\") pod \"node-exporter-f66ml\" (UID: \"87deb294-03cf-4e01-94aa-90bc5e0e36bb\") " pod="openshift-monitoring/node-exporter-f66ml" Jul 02 00:22:35.484725 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.484686 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99hl7\" (UniqueName: \"kubernetes.io/projected/87deb294-03cf-4e01-94aa-90bc5e0e36bb-kube-api-access-99hl7\") pod \"node-exporter-f66ml\" (UID: \"87deb294-03cf-4e01-94aa-90bc5e0e36bb\") " pod="openshift-monitoring/node-exporter-f66ml" Jul 02 00:22:35.484725 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.484706 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87deb294-03cf-4e01-94aa-90bc5e0e36bb-sys\") pod \"node-exporter-f66ml\" (UID: \"87deb294-03cf-4e01-94aa-90bc5e0e36bb\") " pod="openshift-monitoring/node-exporter-f66ml" Jul 02 00:22:35.484725 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.484722 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35182afa-99f0-4ffd-ab82-e8b111076888-metrics-client-ca\") pod \"kube-state-metrics-845b954455-r4fbj\" (UID: \"35182afa-99f0-4ffd-ab82-e8b111076888\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r4fbj" Jul 02 00:22:35.484954 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.484740 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/35182afa-99f0-4ffd-ab82-e8b111076888-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-r4fbj\" (UID: \"35182afa-99f0-4ffd-ab82-e8b111076888\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r4fbj" Jul 02 00:22:35.484954 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.484809 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35182afa-99f0-4ffd-ab82-e8b111076888-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-r4fbj\" (UID: \"35182afa-99f0-4ffd-ab82-e8b111076888\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r4fbj" Jul 02 00:22:35.484954 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.484859 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/87deb294-03cf-4e01-94aa-90bc5e0e36bb-node-exporter-wtmp\") pod \"node-exporter-f66ml\" (UID: \"87deb294-03cf-4e01-94aa-90bc5e0e36bb\") " pod="openshift-monitoring/node-exporter-f66ml" Jul 02 00:22:35.484954 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.484889 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87deb294-03cf-4e01-94aa-90bc5e0e36bb-metrics-client-ca\") pod \"node-exporter-f66ml\" (UID: \"87deb294-03cf-4e01-94aa-90bc5e0e36bb\") " pod="openshift-monitoring/node-exporter-f66ml" Jul 02 00:22:35.484954 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.484935 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/87deb294-03cf-4e01-94aa-90bc5e0e36bb-root\") pod \"node-exporter-f66ml\" (UID: \"87deb294-03cf-4e01-94aa-90bc5e0e36bb\") " pod="openshift-monitoring/node-exporter-f66ml" Jul 02 00:22:35.485097 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.484961 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/87deb294-03cf-4e01-94aa-90bc5e0e36bb-node-exporter-tls\") pod \"node-exporter-f66ml\" (UID: \"87deb294-03cf-4e01-94aa-90bc5e0e36bb\") " pod="openshift-monitoring/node-exporter-f66ml" Jul 02 00:22:35.485097 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.484982 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/35182afa-99f0-4ffd-ab82-e8b111076888-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-r4fbj\" (UID: \"35182afa-99f0-4ffd-ab82-e8b111076888\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r4fbj" Jul 02 00:22:35.485097 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.485003 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/35182afa-99f0-4ffd-ab82-e8b111076888-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-r4fbj\" (UID: \"35182afa-99f0-4ffd-ab82-e8b111076888\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r4fbj" Jul 02 00:22:35.512622 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.512601 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:35.585868 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.585794 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/87deb294-03cf-4e01-94aa-90bc5e0e36bb-node-exporter-textfile\") pod \"node-exporter-f66ml\" (UID: \"87deb294-03cf-4e01-94aa-90bc5e0e36bb\") " pod="openshift-monitoring/node-exporter-f66ml" Jul 02 00:22:35.585868 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.585824 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/87deb294-03cf-4e01-94aa-90bc5e0e36bb-node-exporter-accelerators-collector-config\") pod \"node-exporter-f66ml\" (UID: \"87deb294-03cf-4e01-94aa-90bc5e0e36bb\") " pod="openshift-monitoring/node-exporter-f66ml" Jul 02 00:22:35.585868 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.585843 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99hl7\" (UniqueName: \"kubernetes.io/projected/87deb294-03cf-4e01-94aa-90bc5e0e36bb-kube-api-access-99hl7\") pod \"node-exporter-f66ml\" (UID: \"87deb294-03cf-4e01-94aa-90bc5e0e36bb\") " pod="openshift-monitoring/node-exporter-f66ml" Jul 02 00:22:35.586104 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.585985 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87deb294-03cf-4e01-94aa-90bc5e0e36bb-sys\") pod \"node-exporter-f66ml\" (UID: \"87deb294-03cf-4e01-94aa-90bc5e0e36bb\") " pod="openshift-monitoring/node-exporter-f66ml" Jul 02 00:22:35.586104 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.586030 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35182afa-99f0-4ffd-ab82-e8b111076888-metrics-client-ca\") pod \"kube-state-metrics-845b954455-r4fbj\" (UID: \"35182afa-99f0-4ffd-ab82-e8b111076888\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r4fbj" Jul 02 00:22:35.586104 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.586060 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/35182afa-99f0-4ffd-ab82-e8b111076888-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-r4fbj\" (UID: \"35182afa-99f0-4ffd-ab82-e8b111076888\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r4fbj" Jul 02 00:22:35.586104 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.586092 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35182afa-99f0-4ffd-ab82-e8b111076888-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-r4fbj\" (UID: \"35182afa-99f0-4ffd-ab82-e8b111076888\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r4fbj" Jul 02 00:22:35.586275 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.586125 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/87deb294-03cf-4e01-94aa-90bc5e0e36bb-node-exporter-wtmp\") pod \"node-exporter-f66ml\" (UID: \"87deb294-03cf-4e01-94aa-90bc5e0e36bb\") " pod="openshift-monitoring/node-exporter-f66ml" Jul 02 00:22:35.586275 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.586163 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/87deb294-03cf-4e01-94aa-90bc5e0e36bb-node-exporter-textfile\") pod \"node-exporter-f66ml\" (UID: \"87deb294-03cf-4e01-94aa-90bc5e0e36bb\") " pod="openshift-monitoring/node-exporter-f66ml" Jul 02 00:22:35.586275 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.586168 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87deb294-03cf-4e01-94aa-90bc5e0e36bb-metrics-client-ca\") pod \"node-exporter-f66ml\" (UID: \"87deb294-03cf-4e01-94aa-90bc5e0e36bb\") " pod="openshift-monitoring/node-exporter-f66ml" Jul 02 00:22:35.586275 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.586219 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/87deb294-03cf-4e01-94aa-90bc5e0e36bb-root\") pod \"node-exporter-f66ml\" (UID: \"87deb294-03cf-4e01-94aa-90bc5e0e36bb\") " pod="openshift-monitoring/node-exporter-f66ml" Jul 02 00:22:35.586275 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.586259 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/87deb294-03cf-4e01-94aa-90bc5e0e36bb-node-exporter-tls\") pod \"node-exporter-f66ml\" (UID: \"87deb294-03cf-4e01-94aa-90bc5e0e36bb\") " pod="openshift-monitoring/node-exporter-f66ml" Jul 02 00:22:35.586476 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.586285 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/35182afa-99f0-4ffd-ab82-e8b111076888-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-r4fbj\" (UID: \"35182afa-99f0-4ffd-ab82-e8b111076888\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r4fbj" Jul 02 00:22:35.586476 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.586307 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/87deb294-03cf-4e01-94aa-90bc5e0e36bb-node-exporter-wtmp\") pod \"node-exporter-f66ml\" (UID: \"87deb294-03cf-4e01-94aa-90bc5e0e36bb\") " pod="openshift-monitoring/node-exporter-f66ml" Jul 02 00:22:35.586476 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.586354 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/87deb294-03cf-4e01-94aa-90bc5e0e36bb-root\") pod \"node-exporter-f66ml\" (UID: \"87deb294-03cf-4e01-94aa-90bc5e0e36bb\") " pod="openshift-monitoring/node-exporter-f66ml" Jul 02 00:22:35.586476 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.586311 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/35182afa-99f0-4ffd-ab82-e8b111076888-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-r4fbj\" (UID: \"35182afa-99f0-4ffd-ab82-e8b111076888\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r4fbj" Jul 02 00:22:35.586476 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:22:35.586392 2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 02 00:22:35.586476 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.586455 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87deb294-03cf-4e01-94aa-90bc5e0e36bb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f66ml\" (UID: \"87deb294-03cf-4e01-94aa-90bc5e0e36bb\") " pod="openshift-monitoring/node-exporter-f66ml" Jul 02 00:22:35.586769 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:22:35.586480 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87deb294-03cf-4e01-94aa-90bc5e0e36bb-node-exporter-tls podName:87deb294-03cf-4e01-94aa-90bc5e0e36bb nodeName:}" failed. No retries permitted until 2026-07-02 00:22:36.086461159 +0000 UTC m=+309.501898805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/87deb294-03cf-4e01-94aa-90bc5e0e36bb-node-exporter-tls") pod "node-exporter-f66ml" (UID: "87deb294-03cf-4e01-94aa-90bc5e0e36bb") : secret "node-exporter-tls" not found Jul 02 00:22:35.586769 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.586511 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g4tj\" (UniqueName: \"kubernetes.io/projected/35182afa-99f0-4ffd-ab82-e8b111076888-kube-api-access-9g4tj\") pod \"kube-state-metrics-845b954455-r4fbj\" (UID: \"35182afa-99f0-4ffd-ab82-e8b111076888\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r4fbj" Jul 02 00:22:35.586769 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.586749 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/35182afa-99f0-4ffd-ab82-e8b111076888-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-r4fbj\" (UID: \"35182afa-99f0-4ffd-ab82-e8b111076888\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r4fbj" Jul 02 00:22:35.586965 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.586804 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87deb294-03cf-4e01-94aa-90bc5e0e36bb-metrics-client-ca\") pod \"node-exporter-f66ml\" (UID: \"87deb294-03cf-4e01-94aa-90bc5e0e36bb\") " pod="openshift-monitoring/node-exporter-f66ml" Jul 02 00:22:35.586965 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.586809 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87deb294-03cf-4e01-94aa-90bc5e0e36bb-sys\") pod \"node-exporter-f66ml\" (UID: \"87deb294-03cf-4e01-94aa-90bc5e0e36bb\") " pod="openshift-monitoring/node-exporter-f66ml" Jul 02 00:22:35.586965 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.586949 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/87deb294-03cf-4e01-94aa-90bc5e0e36bb-node-exporter-accelerators-collector-config\") pod \"node-exporter-f66ml\" (UID: \"87deb294-03cf-4e01-94aa-90bc5e0e36bb\") " pod="openshift-monitoring/node-exporter-f66ml" Jul 02 00:22:35.587173 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.587153 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35182afa-99f0-4ffd-ab82-e8b111076888-metrics-client-ca\") pod \"kube-state-metrics-845b954455-r4fbj\" (UID: \"35182afa-99f0-4ffd-ab82-e8b111076888\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r4fbj" Jul 02 00:22:35.587235 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.587154 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/35182afa-99f0-4ffd-ab82-e8b111076888-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-r4fbj\" (UID: \"35182afa-99f0-4ffd-ab82-e8b111076888\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r4fbj" Jul 02 00:22:35.588962 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.588940 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87deb294-03cf-4e01-94aa-90bc5e0e36bb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f66ml\" (UID: \"87deb294-03cf-4e01-94aa-90bc5e0e36bb\") " pod="openshift-monitoring/node-exporter-f66ml" Jul 02 00:22:35.589156 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.589135 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/35182afa-99f0-4ffd-ab82-e8b111076888-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-r4fbj\" (UID: \"35182afa-99f0-4ffd-ab82-e8b111076888\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r4fbj" Jul 02 00:22:35.589226 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.589126 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35182afa-99f0-4ffd-ab82-e8b111076888-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-r4fbj\" (UID: \"35182afa-99f0-4ffd-ab82-e8b111076888\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r4fbj" Jul 02 00:22:35.599209 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.599180 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99hl7\" (UniqueName: \"kubernetes.io/projected/87deb294-03cf-4e01-94aa-90bc5e0e36bb-kube-api-access-99hl7\") pod \"node-exporter-f66ml\" (UID: \"87deb294-03cf-4e01-94aa-90bc5e0e36bb\") " pod="openshift-monitoring/node-exporter-f66ml" Jul 02 00:22:35.599381 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.599365 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g4tj\" (UniqueName: \"kubernetes.io/projected/35182afa-99f0-4ffd-ab82-e8b111076888-kube-api-access-9g4tj\") pod \"kube-state-metrics-845b954455-r4fbj\" (UID: \"35182afa-99f0-4ffd-ab82-e8b111076888\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r4fbj" Jul 02 00:22:35.609794 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.609775 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:35.656826 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.656804 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-r4fbj" Jul 02 00:22:35.710723 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.710665 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:35.784973 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.784914 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-r4fbj"] Jul 02 00:22:35.785855 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.785837 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:35.787746 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:22:35.787726 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35182afa_99f0_4ffd_ab82_e8b111076888.slice/crio-5e62db8bab5594cd5151608f74fd9825250c2746ca25c4a72fd29b8aca45c0c5 WatchSource:0}: Error finding container 5e62db8bab5594cd5151608f74fd9825250c2746ca25c4a72fd29b8aca45c0c5: Status 404 returned error can't find the container with id 5e62db8bab5594cd5151608f74fd9825250c2746ca25c4a72fd29b8aca45c0c5 Jul 02 00:22:35.972873 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:35.972805 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:36.060937 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:36.060916 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:22:36.090538 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:36.090510 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/87deb294-03cf-4e01-94aa-90bc5e0e36bb-node-exporter-tls\") pod \"node-exporter-f66ml\" (UID: \"87deb294-03cf-4e01-94aa-90bc5e0e36bb\") " pod="openshift-monitoring/node-exporter-f66ml" Jul 02 00:22:36.092790 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:36.092768 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/87deb294-03cf-4e01-94aa-90bc5e0e36bb-node-exporter-tls\") pod \"node-exporter-f66ml\" (UID: \"87deb294-03cf-4e01-94aa-90bc5e0e36bb\") " pod="openshift-monitoring/node-exporter-f66ml" Jul 02 00:22:36.113578 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:36.113551 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-r4fbj" event={"ID":"35182afa-99f0-4ffd-ab82-e8b111076888","Type":"ContainerStarted","Data":"5e62db8bab5594cd5151608f74fd9825250c2746ca25c4a72fd29b8aca45c0c5"} Jul 02 00:22:36.271982 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:36.271956 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f66ml" Jul 02 00:22:36.283234 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:22:36.283206 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87deb294_03cf_4e01_94aa_90bc5e0e36bb.slice/crio-106f301d8cb8f4038aa9e68483ad434296f4307dae106140ef97a4248709c98f WatchSource:0}: Error finding container 106f301d8cb8f4038aa9e68483ad434296f4307dae106140ef97a4248709c98f: Status 404 returned error can't find the container with id 106f301d8cb8f4038aa9e68483ad434296f4307dae106140ef97a4248709c98f Jul 02 00:22:36.356403 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:36.356373 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:36.428209 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:36.428181 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:36.821765 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:36.821719 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:37.118542 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:37.118459 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f66ml" event={"ID":"87deb294-03cf-4e01-94aa-90bc5e0e36bb","Type":"ContainerStarted","Data":"106f301d8cb8f4038aa9e68483ad434296f4307dae106140ef97a4248709c98f"} Jul 02 00:22:38.123895 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:38.123858 2581 generic.go:356] "Generic (PLEG): container finished" podID="87deb294-03cf-4e01-94aa-90bc5e0e36bb" containerID="92597f82c25f078e8cfce06590099afedc81dbc225fad18592573f3db248c4e5" exitCode=0 Jul 02 00:22:38.124297 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:38.123939 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f66ml" event={"ID":"87deb294-03cf-4e01-94aa-90bc5e0e36bb","Type":"ContainerDied","Data":"92597f82c25f078e8cfce06590099afedc81dbc225fad18592573f3db248c4e5"} Jul 02 00:22:38.126219 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:38.126185 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-r4fbj" event={"ID":"35182afa-99f0-4ffd-ab82-e8b111076888","Type":"ContainerStarted","Data":"83be3ba170d2564d794a704a1cb23ec5f3e354d31938cb985f5ee1d5dd4b3712"} Jul 02 00:22:38.126322 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:38.126239 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-r4fbj" event={"ID":"35182afa-99f0-4ffd-ab82-e8b111076888","Type":"ContainerStarted","Data":"de733f75e49cf071ce111387c34dfb0a0f5e12f4c7b563c68c3902b7a0037494"} Jul 02 00:22:38.126322 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:38.126260 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-r4fbj" event={"ID":"35182afa-99f0-4ffd-ab82-e8b111076888","Type":"ContainerStarted","Data":"0f632d14896a3176b44e5e6bfba4fc7d75d74c0b81a5f4b921d34470ab7cf50b"} Jul 02 00:22:38.280737 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:38.280711 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:38.338748 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:38.338720 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:38.545456 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:38.545431 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:38.645586 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:38.645559 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:39.131937 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:39.131900 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f66ml" event={"ID":"87deb294-03cf-4e01-94aa-90bc5e0e36bb","Type":"ContainerStarted","Data":"8dc1808ea55a1af06d015b1f611db4ad4c9420bd3fc4b66402ae2224d1988b47"} Jul 02 00:22:39.132311 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:39.131952 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f66ml" event={"ID":"87deb294-03cf-4e01-94aa-90bc5e0e36bb","Type":"ContainerStarted","Data":"cf8c9b2bc843ca5d0b8167acffa774ef6e9152a72a5818926dcb7ab4577a431a"} Jul 02 00:22:39.150565 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:39.150521 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-f66ml" podStartSLOduration=2.787013308 podStartE2EDuration="4.150507019s" totalImagesPullingTime="1.274206131s" totalInitContainerRuntime="89.28758ms" isStatefulPod=true podCreationTimestamp="2026-07-02 00:22:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:22:39.149285292 +0000 UTC m=+312.564722991" watchObservedRunningTime="2026-07-02 00:22:39.150507019 +0000 UTC m=+312.565944685" Jul 02 00:22:39.151027 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:39.151005 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-845b954455-r4fbj" podStartSLOduration=2.383639519 podStartE2EDuration="4.150995765s" totalImagesPullingTime="1.767356246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:22:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:22:38.159287153 +0000 UTC m=+311.574724819" watchObservedRunningTime="2026-07-02 00:22:39.150995765 +0000 UTC m=+312.566433432" Jul 02 00:22:39.426275 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:39.426199 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:39.526088 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:39.526057 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:39.602707 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:39.602678 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:40.108081 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:40.108047 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:40.111122 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:40.111099 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-prjgt"] Jul 02 00:22:40.114322 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:40.114308 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-prjgt" Jul 02 00:22:40.116865 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:40.116837 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 02 00:22:40.116945 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:40.116882 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-9p948\"" Jul 02 00:22:40.121715 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:40.121692 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-prjgt"] Jul 02 00:22:40.226009 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:40.225979 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e201079c-fd71-4a27-8846-d04516933aca-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-prjgt\" (UID: \"e201079c-fd71-4a27-8846-d04516933aca\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-prjgt" Jul 02 00:22:40.226456 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:40.226056 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfnsk\" (UniqueName: \"kubernetes.io/projected/e201079c-fd71-4a27-8846-d04516933aca-kube-api-access-jfnsk\") pod \"monitoring-plugin-cd8656b8-prjgt\" (UID: \"e201079c-fd71-4a27-8846-d04516933aca\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-prjgt" Jul 02 00:22:40.327584 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:40.327553 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfnsk\" (UniqueName: \"kubernetes.io/projected/e201079c-fd71-4a27-8846-d04516933aca-kube-api-access-jfnsk\") pod \"monitoring-plugin-cd8656b8-prjgt\" (UID: \"e201079c-fd71-4a27-8846-d04516933aca\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-prjgt" Jul 02 00:22:40.327728 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:40.327661 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e201079c-fd71-4a27-8846-d04516933aca-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-prjgt\" (UID: \"e201079c-fd71-4a27-8846-d04516933aca\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-prjgt" Jul 02 00:22:40.327780 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:22:40.327769 2581 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 02 00:22:40.327834 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:22:40.327823 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e201079c-fd71-4a27-8846-d04516933aca-monitoring-plugin-cert podName:e201079c-fd71-4a27-8846-d04516933aca nodeName:}" failed. No retries permitted until 2026-07-02 00:22:40.827805663 +0000 UTC m=+314.243243311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/e201079c-fd71-4a27-8846-d04516933aca-monitoring-plugin-cert") pod "monitoring-plugin-cd8656b8-prjgt" (UID: "e201079c-fd71-4a27-8846-d04516933aca") : secret "monitoring-plugin-cert" not found Jul 02 00:22:40.338313 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:40.338289 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfnsk\" (UniqueName: \"kubernetes.io/projected/e201079c-fd71-4a27-8846-d04516933aca-kube-api-access-jfnsk\") pod \"monitoring-plugin-cd8656b8-prjgt\" (UID: \"e201079c-fd71-4a27-8846-d04516933aca\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-prjgt" Jul 02 00:22:40.426836 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:40.426766 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:40.832912 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:40.832879 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e201079c-fd71-4a27-8846-d04516933aca-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-prjgt\" (UID: \"e201079c-fd71-4a27-8846-d04516933aca\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-prjgt" Jul 02 00:22:40.835254 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:40.835224 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e201079c-fd71-4a27-8846-d04516933aca-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-prjgt\" (UID: \"e201079c-fd71-4a27-8846-d04516933aca\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-prjgt" Jul 02 00:22:41.024104 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.024063 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-prjgt" Jul 02 00:22:41.071563 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.071532 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c4d86f8c4-jlszr"] Jul 02 00:22:41.148148 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.148122 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:41.154804 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.154678 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-prjgt"] Jul 02 00:22:41.157276 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:22:41.157244 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode201079c_fd71_4a27_8846_d04516933aca.slice/crio-f1fde7754c0580677c6fad2a4895c00d4569d7a655b1dd0e92b74cdb731c6143 WatchSource:0}: Error finding container f1fde7754c0580677c6fad2a4895c00d4569d7a655b1dd0e92b74cdb731c6143: Status 404 returned error can't find the container with id f1fde7754c0580677c6fad2a4895c00d4569d7a655b1dd0e92b74cdb731c6143 Jul 02 00:22:41.248885 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.248859 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:41.348471 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.348440 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:41.450130 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.450066 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:41.533266 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.533241 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:41.537623 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.537602 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 00:22:41.547540 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.543085 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.548345 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.548115 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 00:22:41.548345 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.548131 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 00:22:41.548345 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.548116 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 00:22:41.548345 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.548261 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 00:22:41.548345 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.548261 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 00:22:41.548345 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.548309 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 00:22:41.548345 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.548327 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-chfm12674mu55\"" Jul 02 00:22:41.548727 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.548367 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 00:22:41.548727 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.548393 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 00:22:41.548727 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.548493 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-87zfz\"" Jul 02 00:22:41.548852 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.548821 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 00:22:41.548852 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.548831 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 02 00:22:41.548959 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.548868 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 00:22:41.548959 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.548877 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 00:22:41.549051 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.549039 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 00:22:41.549238 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.549220 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 00:22:41.550888 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.550868 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 00:22:41.555637 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.555617 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 00:22:41.638840 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.638815 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.638966 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.638844 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.638966 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.638863 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6e10e251-9cde-423a-87c1-e33b2df6a751-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.638966 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.638935 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.638966 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.638954 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.639122 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.638992 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-478xn\" (UniqueName: \"kubernetes.io/projected/6e10e251-9cde-423a-87c1-e33b2df6a751-kube-api-access-478xn\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.639122 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.639028 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.639122 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.639058 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.639122 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.639076 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-web-config\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.639122 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.639098 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e10e251-9cde-423a-87c1-e33b2df6a751-config-out\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.639284 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.639126 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.639284 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.639149 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.639284 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.639186 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.639284 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.639207 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.639284 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.639225 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.639284 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.639248 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e10e251-9cde-423a-87c1-e33b2df6a751-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.639488 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.639286 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-config\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.639488 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.639301 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.639488 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.639316 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.639488 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.639358 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.740725 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.740660 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.740725 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.740692 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-web-config\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.740725 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.740714 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e10e251-9cde-423a-87c1-e33b2df6a751-config-out\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.740933 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.740730 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.740933 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.740859 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.740933 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.740916 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.741084 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.740950 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.741084 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.740981 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.741084 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.741018 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e10e251-9cde-423a-87c1-e33b2df6a751-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.741524 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.741498 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.741673 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.741559 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-config\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.741673 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.741580 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.741673 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.741592 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.741673 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.741617 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.741673 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.741669 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.741935 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.741700 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.742037 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.742015 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.742128 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.742081 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.742128 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.741701 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.742224 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.742144 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.742224 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.742173 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6e10e251-9cde-423a-87c1-e33b2df6a751-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.742329 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.742221 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.742329 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.742250 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.742329 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.742281 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-478xn\" (UniqueName: \"kubernetes.io/projected/6e10e251-9cde-423a-87c1-e33b2df6a751-kube-api-access-478xn\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.742329 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.742320 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.743503 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.743178 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6e10e251-9cde-423a-87c1-e33b2df6a751-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.743634 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.743587 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e10e251-9cde-423a-87c1-e33b2df6a751-config-out\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.744229 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.743886 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-web-config\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.744385 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.744359 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.745227 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.745207 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-config\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.745330 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.745262 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.746069 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.746001 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.746192 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.746164 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.746827 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.746782 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.747531 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.747227 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e10e251-9cde-423a-87c1-e33b2df6a751-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.747531 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.747245 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.747531 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.747470 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.748058 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.748039 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.748282 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.748262 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.751278 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.751247 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-478xn\" (UniqueName: \"kubernetes.io/projected/6e10e251-9cde-423a-87c1-e33b2df6a751-kube-api-access-478xn\") pod \"prometheus-k8s-0\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:41.856911 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:41.856877 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:42.007894 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:42.007829 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 00:22:42.010377 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:22:42.010346 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e10e251_9cde_423a_87c1_e33b2df6a751.slice/crio-8cbb0b45bb1b2f911617d86cdd1e142212321ab99c397dad2413df428ed70a0d WatchSource:0}: Error finding container 8cbb0b45bb1b2f911617d86cdd1e142212321ab99c397dad2413df428ed70a0d: Status 404 returned error can't find the container with id 8cbb0b45bb1b2f911617d86cdd1e142212321ab99c397dad2413df428ed70a0d Jul 02 00:22:42.034910 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:42.034888 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:42.128826 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:42.128797 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:42.143068 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:42.143041 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e10e251-9cde-423a-87c1-e33b2df6a751","Type":"ContainerStarted","Data":"8cbb0b45bb1b2f911617d86cdd1e142212321ab99c397dad2413df428ed70a0d"} Jul 02 00:22:42.144133 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:42.144109 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-prjgt" event={"ID":"e201079c-fd71-4a27-8846-d04516933aca","Type":"ContainerStarted","Data":"f1fde7754c0580677c6fad2a4895c00d4569d7a655b1dd0e92b74cdb731c6143"} Jul 02 00:22:42.228794 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:42.228770 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:42.329224 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:42.329129 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:42.490868 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:42.490832 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:42.684524 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:42.684444 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:42.783659 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:42.783630 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:43.113324 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:43.113277 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:43.150243 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:43.150170 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-prjgt" event={"ID":"e201079c-fd71-4a27-8846-d04516933aca","Type":"ContainerStarted","Data":"31192064e080fb00ee60289ab52f446a503ac2e4ca0d320834635255e49eebd9"} Jul 02 00:22:43.150514 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:43.150486 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-prjgt" Jul 02 00:22:43.155466 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:43.155447 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-prjgt" Jul 02 00:22:43.164946 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:43.164908 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-cd8656b8-prjgt" podStartSLOduration=1.527751267 podStartE2EDuration="3.164893495s" totalImagesPullingTime="1.637142228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:22:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:22:43.16410528 +0000 UTC m=+316.579542950" watchObservedRunningTime="2026-07-02 00:22:43.164893495 +0000 UTC m=+316.580331162" Jul 02 00:22:43.309105 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:43.309065 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:43.409740 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:43.409667 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:43.697755 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:43.697725 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:43.713128 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:22:43.713103 2581 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e10e251_9cde_423a_87c1_e33b2df6a751.slice/crio-30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e10e251_9cde_423a_87c1_e33b2df6a751.slice/crio-conmon-30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2.scope\": RecentStats: unable to find data in memory cache]" Jul 02 00:22:43.894988 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:43.894950 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:44.088247 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:44.088216 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:44.160746 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:44.160712 2581 generic.go:356] "Generic (PLEG): container finished" podID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerID="30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2" exitCode=0 Jul 02 00:22:44.160907 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:44.160791 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e10e251-9cde-423a-87c1-e33b2df6a751","Type":"ContainerDied","Data":"30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2"} Jul 02 00:22:44.252239 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:44.252214 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:45.514638 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:45.514590 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:45.613085 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:45.613058 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:46.191826 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:46.191796 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:46.247894 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:46.247859 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:47.047863 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:47.047823 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:47.115430 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:47.115382 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:48.185561 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:48.185471 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e10e251-9cde-423a-87c1-e33b2df6a751","Type":"ContainerStarted","Data":"613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d"} Jul 02 00:22:48.186040 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:48.185581 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e10e251-9cde-423a-87c1-e33b2df6a751","Type":"ContainerStarted","Data":"7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6"} Jul 02 00:22:51.201944 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:51.201909 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e10e251-9cde-423a-87c1-e33b2df6a751","Type":"ContainerStarted","Data":"5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093"} Jul 02 00:22:51.202340 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:51.201977 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e10e251-9cde-423a-87c1-e33b2df6a751","Type":"ContainerStarted","Data":"d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524"} Jul 02 00:22:51.202340 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:51.202006 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e10e251-9cde-423a-87c1-e33b2df6a751","Type":"ContainerStarted","Data":"0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130"} Jul 02 00:22:51.202340 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:51.202031 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e10e251-9cde-423a-87c1-e33b2df6a751","Type":"ContainerStarted","Data":"d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7"} Jul 02 00:22:51.239148 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:51.239094 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.418125313 podStartE2EDuration="10.239073783s" totalImagesPullingTime="7.79293625s" totalInitContainerRuntime="28.01222ms" isStatefulPod=false podCreationTimestamp="2026-07-02 00:22:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:22:51.236283403 +0000 UTC m=+324.651721089" watchObservedRunningTime="2026-07-02 00:22:51.239073783 +0000 UTC m=+324.654511450" Jul 02 00:22:51.857682 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:51.857647 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:22:52.122190 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:52.122107 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:52.224174 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:52.224140 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:55.321545 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:55.321508 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:55.422826 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:55.422792 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:22:57.712931 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:22:57.712894 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:23:01.121764 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:01.121729 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:23:02.065938 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:02.065902 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:23:02.114221 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:02.114191 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:23:05.510124 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:05.510089 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:23:05.568516 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:05.568487 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:23:06.096737 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:06.096672 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" podUID="3c528ee8-34d5-41d5-ac52-1ce87a4a240f" containerName="registry" containerID="cri-o://abc139b78c1f9b0c37e9ec8c5fef7272a376471b72ed1300e10afcd61e375261" gracePeriod=30 Jul 02 00:23:06.256790 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:06.256759 2581 generic.go:356] "Generic (PLEG): container finished" podID="3c528ee8-34d5-41d5-ac52-1ce87a4a240f" containerID="abc139b78c1f9b0c37e9ec8c5fef7272a376471b72ed1300e10afcd61e375261" exitCode=0 Jul 02 00:23:06.256942 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:06.256833 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" event={"ID":"3c528ee8-34d5-41d5-ac52-1ce87a4a240f","Type":"ContainerDied","Data":"abc139b78c1f9b0c37e9ec8c5fef7272a376471b72ed1300e10afcd61e375261"} Jul 02 00:23:06.335328 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:06.335305 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:23:06.457871 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:06.457793 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-ca-trust-extracted\") pod \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " Jul 02 00:23:06.457871 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:06.457825 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2gcs\" (UniqueName: \"kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-kube-api-access-l2gcs\") pod \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " Jul 02 00:23:06.457871 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:06.457861 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-installation-pull-secrets\") pod \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " Jul 02 00:23:06.458136 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:06.457897 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls\") pod \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " Jul 02 00:23:06.458136 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:06.457959 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-trusted-ca\") pod \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " Jul 02 00:23:06.458136 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:06.458020 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-image-registry-private-configuration\") pod \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " Jul 02 00:23:06.458136 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:06.458056 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-certificates\") pod \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " Jul 02 00:23:06.458136 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:06.458082 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-bound-sa-token\") pod \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\" (UID: \"3c528ee8-34d5-41d5-ac52-1ce87a4a240f\") " Jul 02 00:23:06.458576 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:06.458545 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3c528ee8-34d5-41d5-ac52-1ce87a4a240f" (UID: "3c528ee8-34d5-41d5-ac52-1ce87a4a240f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 00:23:06.458690 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:06.458663 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3c528ee8-34d5-41d5-ac52-1ce87a4a240f" (UID: "3c528ee8-34d5-41d5-ac52-1ce87a4a240f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 00:23:06.460347 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:06.460298 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3c528ee8-34d5-41d5-ac52-1ce87a4a240f" (UID: "3c528ee8-34d5-41d5-ac52-1ce87a4a240f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 00:23:06.460643 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:06.460617 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3c528ee8-34d5-41d5-ac52-1ce87a4a240f" (UID: "3c528ee8-34d5-41d5-ac52-1ce87a4a240f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 00:23:06.460752 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:06.460658 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-kube-api-access-l2gcs" (OuterVolumeSpecName: "kube-api-access-l2gcs") pod "3c528ee8-34d5-41d5-ac52-1ce87a4a240f" (UID: "3c528ee8-34d5-41d5-ac52-1ce87a4a240f"). InnerVolumeSpecName "kube-api-access-l2gcs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 00:23:06.460752 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:06.460730 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3c528ee8-34d5-41d5-ac52-1ce87a4a240f" (UID: "3c528ee8-34d5-41d5-ac52-1ce87a4a240f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 00:23:06.460890 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:06.460865 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3c528ee8-34d5-41d5-ac52-1ce87a4a240f" (UID: "3c528ee8-34d5-41d5-ac52-1ce87a4a240f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 00:23:06.467811 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:06.467786 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3c528ee8-34d5-41d5-ac52-1ce87a4a240f" (UID: "3c528ee8-34d5-41d5-ac52-1ce87a4a240f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 00:23:06.558773 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:06.558740 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-ca-trust-extracted\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:23:06.558773 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:06.558765 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2gcs\" (UniqueName: \"kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-kube-api-access-l2gcs\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:23:06.558773 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:06.558776 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-installation-pull-secrets\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:23:06.559201 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:06.558789 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-tls\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:23:06.559201 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:06.558804 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-trusted-ca\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:23:06.559201 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:06.558816 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-image-registry-private-configuration\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:23:06.559201 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:06.558830 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-registry-certificates\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:23:06.559201 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:06.558844 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c528ee8-34d5-41d5-ac52-1ce87a4a240f-bound-sa-token\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:23:07.261680 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:07.261637 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" event={"ID":"3c528ee8-34d5-41d5-ac52-1ce87a4a240f","Type":"ContainerDied","Data":"930b4391fb444bbf5deb30382c7a0c681d34fc7b893d08564fe1238efc066652"} Jul 02 00:23:07.261680 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:07.261655 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c4d86f8c4-jlszr" Jul 02 00:23:07.261942 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:07.261703 2581 scope.go:117] "RemoveContainer" containerID="abc139b78c1f9b0c37e9ec8c5fef7272a376471b72ed1300e10afcd61e375261" Jul 02 00:23:07.280122 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:07.280097 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c4d86f8c4-jlszr"] Jul 02 00:23:07.292435 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:07.289691 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-c4d86f8c4-jlszr"] Jul 02 00:23:08.266175 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:08.266140 2581 generic.go:356] "Generic (PLEG): container finished" podID="a769b185-fefb-40c7-a21f-137f612e9d66" containerID="1d6d66446dd38493441ed50711ca701764150d056a7812727c26624aa5ba97e9" exitCode=0 Jul 02 00:23:08.266604 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:08.266214 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qq8c8" event={"ID":"a769b185-fefb-40c7-a21f-137f612e9d66","Type":"ContainerDied","Data":"1d6d66446dd38493441ed50711ca701764150d056a7812727c26624aa5ba97e9"} Jul 02 00:23:08.266667 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:08.266616 2581 scope.go:117] "RemoveContainer" containerID="1d6d66446dd38493441ed50711ca701764150d056a7812727c26624aa5ba97e9" Jul 02 00:23:09.066285 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:09.066246 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c528ee8-34d5-41d5-ac52-1ce87a4a240f" path="/var/lib/kubelet/pods/3c528ee8-34d5-41d5-ac52-1ce87a4a240f/volumes" Jul 02 00:23:09.272346 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:09.272310 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qq8c8" event={"ID":"a769b185-fefb-40c7-a21f-137f612e9d66","Type":"ContainerStarted","Data":"728041ef1e4262175ff1895610f04ffc7b55b81d1cb705ec15aa2a1b1506150b"} Jul 02 00:23:09.524756 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:09.524724 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:23:09.622591 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:09.622560 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:23:12.417699 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:12.417660 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:23:12.476161 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:12.476136 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:23:12.679997 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:12.679922 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:23:17.047869 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:17.047816 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:23:17.147306 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:17.147274 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:23:17.369068 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:17.368991 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:23:17.426906 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:17.426872 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:23:23.323453 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:23.323397 2581 generic.go:356] "Generic (PLEG): container finished" podID="2e6a9de7-b7d1-44ad-b020-2f70773b582e" containerID="887b226769c1040fe908fa2c3d15616279bee4b26387e4906ab2758147255fb6" exitCode=0 Jul 02 00:23:23.323813 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:23.323468 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-92c88" event={"ID":"2e6a9de7-b7d1-44ad-b020-2f70773b582e","Type":"ContainerDied","Data":"887b226769c1040fe908fa2c3d15616279bee4b26387e4906ab2758147255fb6"} Jul 02 00:23:23.323813 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:23.323769 2581 scope.go:117] "RemoveContainer" containerID="887b226769c1040fe908fa2c3d15616279bee4b26387e4906ab2758147255fb6" Jul 02 00:23:24.329386 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:24.329354 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-92c88" event={"ID":"2e6a9de7-b7d1-44ad-b020-2f70773b582e","Type":"ContainerStarted","Data":"99445d82939391d3d7d97f7317e4bc9b5a93b352a9319fb90ce4f24af3f92467"} Jul 02 00:23:26.500967 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:26.500934 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:23:26.554465 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:26.554412 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:23:40.036072 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:40.036033 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs\") pod \"network-metrics-daemon-7tkzk\" (UID: \"3c33c8e2-8b03-4815-8cd7-d72d4eb01015\") " pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:23:40.038270 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:40.038249 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c33c8e2-8b03-4815-8cd7-d72d4eb01015-metrics-certs\") pod \"network-metrics-daemon-7tkzk\" (UID: \"3c33c8e2-8b03-4815-8cd7-d72d4eb01015\") " pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:23:40.264179 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:40.264151 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sw8l9\"" Jul 02 00:23:40.271843 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:40.271826 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tkzk" Jul 02 00:23:40.399490 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:40.399464 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7tkzk"] Jul 02 00:23:40.401962 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:23:40.401927 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c33c8e2_8b03_4815_8cd7_d72d4eb01015.slice/crio-f24a3c4a3019f2327a5870f83b6aaebec0cc64ec33c28626163b0afb502e52e8 WatchSource:0}: Error finding container f24a3c4a3019f2327a5870f83b6aaebec0cc64ec33c28626163b0afb502e52e8: Status 404 returned error can't find the container with id f24a3c4a3019f2327a5870f83b6aaebec0cc64ec33c28626163b0afb502e52e8 Jul 02 00:23:41.395529 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:41.395493 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7tkzk" event={"ID":"3c33c8e2-8b03-4815-8cd7-d72d4eb01015","Type":"ContainerStarted","Data":"f24a3c4a3019f2327a5870f83b6aaebec0cc64ec33c28626163b0afb502e52e8"} Jul 02 00:23:41.857582 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:41.857549 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:23:41.872883 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:41.872854 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:23:42.400807 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:42.400771 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7tkzk" event={"ID":"3c33c8e2-8b03-4815-8cd7-d72d4eb01015","Type":"ContainerStarted","Data":"f77c199c857c44b7f5cdb594aa2622cfbba233d8eb2a76f2cd716b4ddb91cf35"} Jul 02 00:23:42.401239 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:42.400833 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7tkzk" event={"ID":"3c33c8e2-8b03-4815-8cd7-d72d4eb01015","Type":"ContainerStarted","Data":"3b2c9f3b4b893dd4c135a302c3c213883ab6e778049f0ac849a9ef6f4f218f62"} Jul 02 00:23:42.416067 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:42.416035 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:23:42.416986 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:42.416943 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7tkzk" podStartSLOduration=374.426701519 podStartE2EDuration="6m15.416928461s" totalImagesPullingTime="990.226942ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:17:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:23:42.415819365 +0000 UTC m=+375.831257035" watchObservedRunningTime="2026-07-02 00:23:42.416928461 +0000 UTC m=+375.832366150" Jul 02 00:23:42.572649 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:42.572614 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:23:42.628116 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:42.628092 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:23:51.443629 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:51.443593 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:23:51.503726 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:51.503685 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:23:56.591526 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:56.591487 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:23:56.645159 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:56.645124 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:23:59.952219 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:59.952184 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 00:23:59.952625 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:59.952473 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerName="prometheus" containerID="cri-o://7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6" gracePeriod=600 Jul 02 00:23:59.952625 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:59.952507 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerName="kube-rbac-proxy" containerID="cri-o://d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524" gracePeriod=600 Jul 02 00:23:59.952625 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:59.952540 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerName="kube-rbac-proxy-thanos" containerID="cri-o://5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093" gracePeriod=600 Jul 02 00:23:59.952625 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:59.952552 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerName="thanos-sidecar" containerID="cri-o://d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7" gracePeriod=600 Jul 02 00:23:59.952625 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:59.952571 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerName="config-reloader" containerID="cri-o://613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d" gracePeriod=600 Jul 02 00:23:59.952958 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:23:59.952589 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerName="kube-rbac-proxy-web" containerID="cri-o://0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130" gracePeriod=600 Jul 02 00:24:00.192793 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.192766 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.301820 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.301791 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"6e10e251-9cde-423a-87c1-e33b2df6a751\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " Jul 02 00:24:00.301973 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.301832 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-configmap-kubelet-serving-ca-bundle\") pod \"6e10e251-9cde-423a-87c1-e33b2df6a751\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " Jul 02 00:24:00.301973 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.301856 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-thanos-prometheus-http-client-file\") pod \"6e10e251-9cde-423a-87c1-e33b2df6a751\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " Jul 02 00:24:00.301973 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.301885 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-prometheus-k8s-rulefiles-1\") pod \"6e10e251-9cde-423a-87c1-e33b2df6a751\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " Jul 02 00:24:00.302089 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.302004 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-kube-rbac-proxy\") pod \"6e10e251-9cde-423a-87c1-e33b2df6a751\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " Jul 02 00:24:00.302089 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.302052 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e10e251-9cde-423a-87c1-e33b2df6a751-config-out\") pod \"6e10e251-9cde-423a-87c1-e33b2df6a751\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " Jul 02 00:24:00.302089 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.302084 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"6e10e251-9cde-423a-87c1-e33b2df6a751\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " Jul 02 00:24:00.302215 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.302117 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-prometheus-k8s-tls\") pod \"6e10e251-9cde-423a-87c1-e33b2df6a751\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " Jul 02 00:24:00.302215 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.302149 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-478xn\" (UniqueName: \"kubernetes.io/projected/6e10e251-9cde-423a-87c1-e33b2df6a751-kube-api-access-478xn\") pod \"6e10e251-9cde-423a-87c1-e33b2df6a751\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " Jul 02 00:24:00.302215 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.302174 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-configmap-metrics-client-ca\") pod \"6e10e251-9cde-423a-87c1-e33b2df6a751\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " Jul 02 00:24:00.302215 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.302197 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e10e251-9cde-423a-87c1-e33b2df6a751-tls-assets\") pod \"6e10e251-9cde-423a-87c1-e33b2df6a751\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " Jul 02 00:24:00.302215 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.302202 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "6e10e251-9cde-423a-87c1-e33b2df6a751" (UID: "6e10e251-9cde-423a-87c1-e33b2df6a751"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 00:24:00.302501 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.302231 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-grpc-tls\") pod \"6e10e251-9cde-423a-87c1-e33b2df6a751\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " Jul 02 00:24:00.302501 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.302246 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "6e10e251-9cde-423a-87c1-e33b2df6a751" (UID: "6e10e251-9cde-423a-87c1-e33b2df6a751"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 00:24:00.302501 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.302273 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-configmap-serving-certs-ca-bundle\") pod \"6e10e251-9cde-423a-87c1-e33b2df6a751\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " Jul 02 00:24:00.302501 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.302303 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-prometheus-k8s-rulefiles-2\") pod \"6e10e251-9cde-423a-87c1-e33b2df6a751\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " Jul 02 00:24:00.302501 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.302332 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-web-config\") pod \"6e10e251-9cde-423a-87c1-e33b2df6a751\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " Jul 02 00:24:00.302501 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.302374 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-prometheus-trusted-ca-bundle\") pod \"6e10e251-9cde-423a-87c1-e33b2df6a751\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " Jul 02 00:24:00.302501 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.302398 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-prometheus-k8s-rulefiles-0\") pod \"6e10e251-9cde-423a-87c1-e33b2df6a751\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " Jul 02 00:24:00.302501 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.302456 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6e10e251-9cde-423a-87c1-e33b2df6a751-prometheus-k8s-db\") pod \"6e10e251-9cde-423a-87c1-e33b2df6a751\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " Jul 02 00:24:00.302501 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.302485 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-metrics-client-certs\") pod \"6e10e251-9cde-423a-87c1-e33b2df6a751\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " Jul 02 00:24:00.302943 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.302507 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-config\") pod \"6e10e251-9cde-423a-87c1-e33b2df6a751\" (UID: \"6e10e251-9cde-423a-87c1-e33b2df6a751\") " Jul 02 00:24:00.302943 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.302747 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "6e10e251-9cde-423a-87c1-e33b2df6a751" (UID: "6e10e251-9cde-423a-87c1-e33b2df6a751"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 00:24:00.302943 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.302795 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:24:00.302943 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.302816 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:24:00.304615 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.304584 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "6e10e251-9cde-423a-87c1-e33b2df6a751" (UID: "6e10e251-9cde-423a-87c1-e33b2df6a751"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 00:24:00.304615 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.304599 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e10e251-9cde-423a-87c1-e33b2df6a751-kube-api-access-478xn" (OuterVolumeSpecName: "kube-api-access-478xn") pod "6e10e251-9cde-423a-87c1-e33b2df6a751" (UID: "6e10e251-9cde-423a-87c1-e33b2df6a751"). InnerVolumeSpecName "kube-api-access-478xn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 00:24:00.304794 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.304644 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "6e10e251-9cde-423a-87c1-e33b2df6a751" (UID: "6e10e251-9cde-423a-87c1-e33b2df6a751"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 00:24:00.304794 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.304747 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e10e251-9cde-423a-87c1-e33b2df6a751-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6e10e251-9cde-423a-87c1-e33b2df6a751" (UID: "6e10e251-9cde-423a-87c1-e33b2df6a751"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 00:24:00.304907 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.304835 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "6e10e251-9cde-423a-87c1-e33b2df6a751" (UID: "6e10e251-9cde-423a-87c1-e33b2df6a751"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 00:24:00.305087 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.304987 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "6e10e251-9cde-423a-87c1-e33b2df6a751" (UID: "6e10e251-9cde-423a-87c1-e33b2df6a751"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 00:24:00.305195 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.305175 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "6e10e251-9cde-423a-87c1-e33b2df6a751" (UID: "6e10e251-9cde-423a-87c1-e33b2df6a751"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 00:24:00.305272 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.305190 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "6e10e251-9cde-423a-87c1-e33b2df6a751" (UID: "6e10e251-9cde-423a-87c1-e33b2df6a751"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 00:24:00.305559 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.305518 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e10e251-9cde-423a-87c1-e33b2df6a751-config-out" (OuterVolumeSpecName: "config-out") pod "6e10e251-9cde-423a-87c1-e33b2df6a751" (UID: "6e10e251-9cde-423a-87c1-e33b2df6a751"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 00:24:00.305649 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.305572 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "6e10e251-9cde-423a-87c1-e33b2df6a751" (UID: "6e10e251-9cde-423a-87c1-e33b2df6a751"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 00:24:00.306051 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.305801 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e10e251-9cde-423a-87c1-e33b2df6a751-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "6e10e251-9cde-423a-87c1-e33b2df6a751" (UID: "6e10e251-9cde-423a-87c1-e33b2df6a751"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 00:24:00.306700 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.306676 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "6e10e251-9cde-423a-87c1-e33b2df6a751" (UID: "6e10e251-9cde-423a-87c1-e33b2df6a751"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 00:24:00.306823 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.306801 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "6e10e251-9cde-423a-87c1-e33b2df6a751" (UID: "6e10e251-9cde-423a-87c1-e33b2df6a751"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 00:24:00.306971 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.306948 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "6e10e251-9cde-423a-87c1-e33b2df6a751" (UID: "6e10e251-9cde-423a-87c1-e33b2df6a751"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 00:24:00.307289 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.307272 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "6e10e251-9cde-423a-87c1-e33b2df6a751" (UID: "6e10e251-9cde-423a-87c1-e33b2df6a751"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 00:24:00.307513 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.307494 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-config" (OuterVolumeSpecName: "config") pod "6e10e251-9cde-423a-87c1-e33b2df6a751" (UID: "6e10e251-9cde-423a-87c1-e33b2df6a751"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 00:24:00.315248 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.315225 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-web-config" (OuterVolumeSpecName: "web-config") pod "6e10e251-9cde-423a-87c1-e33b2df6a751" (UID: "6e10e251-9cde-423a-87c1-e33b2df6a751"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 00:24:00.404128 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.404102 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6e10e251-9cde-423a-87c1-e33b2df6a751-prometheus-k8s-db\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:24:00.404128 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.404126 2581 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-metrics-client-certs\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:24:00.404284 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.404140 2581 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-config\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:24:00.404284 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.404152 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:24:00.404284 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.404166 2581 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:24:00.404284 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.404178 2581 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-kube-rbac-proxy\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:24:00.404284 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.404190 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e10e251-9cde-423a-87c1-e33b2df6a751-config-out\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:24:00.404284 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.404205 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:24:00.404284 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.404218 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:24:00.404284 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.404230 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-478xn\" (UniqueName: \"kubernetes.io/projected/6e10e251-9cde-423a-87c1-e33b2df6a751-kube-api-access-478xn\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:24:00.404284 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.404243 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-configmap-metrics-client-ca\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:24:00.404284 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.404257 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e10e251-9cde-423a-87c1-e33b2df6a751-tls-assets\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:24:00.404284 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.404269 2581 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-secret-grpc-tls\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:24:00.404284 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.404282 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:24:00.404702 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.404295 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:24:00.404702 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.404310 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e10e251-9cde-423a-87c1-e33b2df6a751-web-config\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:24:00.404702 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.404323 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:24:00.404702 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.404336 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6e10e251-9cde-423a-87c1-e33b2df6a751-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:24:00.469652 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.469620 2581 generic.go:356] "Generic (PLEG): container finished" podID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerID="5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093" exitCode=0 Jul 02 00:24:00.469652 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.469644 2581 generic.go:356] "Generic (PLEG): container finished" podID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerID="d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524" exitCode=0 Jul 02 00:24:00.469652 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.469654 2581 generic.go:356] "Generic (PLEG): container finished" podID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerID="0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130" exitCode=0 Jul 02 00:24:00.469832 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.469662 2581 generic.go:356] "Generic (PLEG): container finished" podID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerID="d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7" exitCode=0 Jul 02 00:24:00.469832 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.469671 2581 generic.go:356] "Generic (PLEG): container finished" podID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerID="613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d" exitCode=0 Jul 02 00:24:00.469832 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.469679 2581 generic.go:356] "Generic (PLEG): container finished" podID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerID="7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6" exitCode=0 Jul 02 00:24:00.469832 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.469702 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.469832 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.469701 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e10e251-9cde-423a-87c1-e33b2df6a751","Type":"ContainerDied","Data":"5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093"} Jul 02 00:24:00.469832 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.469799 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e10e251-9cde-423a-87c1-e33b2df6a751","Type":"ContainerDied","Data":"d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524"} Jul 02 00:24:00.470011 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.469847 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e10e251-9cde-423a-87c1-e33b2df6a751","Type":"ContainerDied","Data":"0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130"} Jul 02 00:24:00.470011 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.469865 2581 scope.go:117] "RemoveContainer" containerID="5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093" Jul 02 00:24:00.470011 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.469889 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e10e251-9cde-423a-87c1-e33b2df6a751","Type":"ContainerDied","Data":"d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7"} Jul 02 00:24:00.470011 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.469931 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e10e251-9cde-423a-87c1-e33b2df6a751","Type":"ContainerDied","Data":"613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d"} Jul 02 00:24:00.470011 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.469972 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e10e251-9cde-423a-87c1-e33b2df6a751","Type":"ContainerDied","Data":"7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6"} Jul 02 00:24:00.470181 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.470012 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e10e251-9cde-423a-87c1-e33b2df6a751","Type":"ContainerDied","Data":"8cbb0b45bb1b2f911617d86cdd1e142212321ab99c397dad2413df428ed70a0d"} Jul 02 00:24:00.477943 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.477821 2581 scope.go:117] "RemoveContainer" containerID="d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524" Jul 02 00:24:00.485224 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.485203 2581 scope.go:117] "RemoveContainer" containerID="0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130" Jul 02 00:24:00.491576 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.491558 2581 scope.go:117] "RemoveContainer" containerID="d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7" Jul 02 00:24:00.494858 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.494837 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 00:24:00.498751 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.498726 2581 scope.go:117] "RemoveContainer" containerID="613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d" Jul 02 00:24:00.499072 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.499053 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 00:24:00.505048 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.505030 2581 scope.go:117] "RemoveContainer" containerID="7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6" Jul 02 00:24:00.513139 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.512523 2581 scope.go:117] "RemoveContainer" containerID="30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2" Jul 02 00:24:00.519832 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.519816 2581 scope.go:117] "RemoveContainer" containerID="5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093" Jul 02 00:24:00.520098 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:24:00.520079 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093\": container with ID starting with 5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093 not found: ID does not exist" containerID="5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093" Jul 02 00:24:00.520150 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.520107 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093"} err="failed to get container status \"5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093\": rpc error: code = NotFound desc = could not find container \"5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093\": container with ID starting with 5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093 not found: ID does not exist" Jul 02 00:24:00.520150 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.520140 2581 scope.go:117] "RemoveContainer" containerID="d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524" Jul 02 00:24:00.520371 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:24:00.520355 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524\": container with ID starting with d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524 not found: ID does not exist" containerID="d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524" Jul 02 00:24:00.520449 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.520376 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524"} err="failed to get container status \"d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524\": rpc error: code = NotFound desc = could not find container \"d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524\": container with ID starting with d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524 not found: ID does not exist" Jul 02 00:24:00.520449 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.520390 2581 scope.go:117] "RemoveContainer" containerID="0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130" Jul 02 00:24:00.520642 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:24:00.520626 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130\": container with ID starting with 0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130 not found: ID does not exist" containerID="0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130" Jul 02 00:24:00.520694 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.520648 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130"} err="failed to get container status \"0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130\": rpc error: code = NotFound desc = could not find container \"0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130\": container with ID starting with 0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130 not found: ID does not exist" Jul 02 00:24:00.520694 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.520663 2581 scope.go:117] "RemoveContainer" containerID="d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7" Jul 02 00:24:00.520941 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:24:00.520926 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7\": container with ID starting with d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7 not found: ID does not exist" containerID="d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7" Jul 02 00:24:00.520984 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.520945 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7"} err="failed to get container status \"d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7\": rpc error: code = NotFound desc = could not find container \"d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7\": container with ID starting with d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7 not found: ID does not exist" Jul 02 00:24:00.520984 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.520957 2581 scope.go:117] "RemoveContainer" containerID="613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d" Jul 02 00:24:00.521236 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:24:00.521211 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d\": container with ID starting with 613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d not found: ID does not exist" containerID="613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d" Jul 02 00:24:00.521299 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.521242 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d"} err="failed to get container status \"613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d\": rpc error: code = NotFound desc = could not find container \"613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d\": container with ID starting with 613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d not found: ID does not exist" Jul 02 00:24:00.521299 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.521263 2581 scope.go:117] "RemoveContainer" containerID="7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6" Jul 02 00:24:00.521592 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:24:00.521558 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6\": container with ID starting with 7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6 not found: ID does not exist" containerID="7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6" Jul 02 00:24:00.521592 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.521584 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6"} err="failed to get container status \"7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6\": rpc error: code = NotFound desc = could not find container \"7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6\": container with ID starting with 7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6 not found: ID does not exist" Jul 02 00:24:00.521724 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.521598 2581 scope.go:117] "RemoveContainer" containerID="30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2" Jul 02 00:24:00.521837 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:24:00.521820 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2\": container with ID starting with 30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2 not found: ID does not exist" containerID="30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2" Jul 02 00:24:00.521899 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.521847 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2"} err="failed to get container status \"30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2\": rpc error: code = NotFound desc = could not find container \"30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2\": container with ID starting with 30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2 not found: ID does not exist" Jul 02 00:24:00.521899 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.521868 2581 scope.go:117] "RemoveContainer" containerID="5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093" Jul 02 00:24:00.522102 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.522081 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093"} err="failed to get container status \"5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093\": rpc error: code = NotFound desc = could not find container \"5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093\": container with ID starting with 5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093 not found: ID does not exist" Jul 02 00:24:00.522102 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.522098 2581 scope.go:117] "RemoveContainer" containerID="d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524" Jul 02 00:24:00.522281 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.522260 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524"} err="failed to get container status \"d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524\": rpc error: code = NotFound desc = could not find container \"d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524\": container with ID starting with d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524 not found: ID does not exist" Jul 02 00:24:00.522281 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.522272 2581 scope.go:117] "RemoveContainer" containerID="0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130" Jul 02 00:24:00.522500 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.522484 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130"} err="failed to get container status \"0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130\": rpc error: code = NotFound desc = could not find container \"0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130\": container with ID starting with 0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130 not found: ID does not exist" Jul 02 00:24:00.522500 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.522500 2581 scope.go:117] "RemoveContainer" containerID="d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7" Jul 02 00:24:00.522676 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.522659 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7"} err="failed to get container status \"d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7\": rpc error: code = NotFound desc = could not find container \"d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7\": container with ID starting with d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7 not found: ID does not exist" Jul 02 00:24:00.522714 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.522676 2581 scope.go:117] "RemoveContainer" containerID="613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d" Jul 02 00:24:00.522880 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.522856 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d"} err="failed to get container status \"613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d\": rpc error: code = NotFound desc = could not find container \"613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d\": container with ID starting with 613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d not found: ID does not exist" Jul 02 00:24:00.522880 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.522878 2581 scope.go:117] "RemoveContainer" containerID="7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6" Jul 02 00:24:00.523249 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.523181 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6"} err="failed to get container status \"7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6\": rpc error: code = NotFound desc = could not find container \"7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6\": container with ID starting with 7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6 not found: ID does not exist" Jul 02 00:24:00.523354 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.523239 2581 scope.go:117] "RemoveContainer" containerID="30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2" Jul 02 00:24:00.523532 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.523513 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2"} err="failed to get container status \"30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2\": rpc error: code = NotFound desc = could not find container \"30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2\": container with ID starting with 30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2 not found: ID does not exist" Jul 02 00:24:00.523603 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.523532 2581 scope.go:117] "RemoveContainer" containerID="5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093" Jul 02 00:24:00.523882 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.523858 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093"} err="failed to get container status \"5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093\": rpc error: code = NotFound desc = could not find container \"5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093\": container with ID starting with 5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093 not found: ID does not exist" Jul 02 00:24:00.523952 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.523883 2581 scope.go:117] "RemoveContainer" containerID="d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524" Jul 02 00:24:00.524177 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.524159 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524"} err="failed to get container status \"d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524\": rpc error: code = NotFound desc = could not find container \"d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524\": container with ID starting with d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524 not found: ID does not exist" Jul 02 00:24:00.524238 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.524179 2581 scope.go:117] "RemoveContainer" containerID="0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130" Jul 02 00:24:00.524456 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.524404 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130"} err="failed to get container status \"0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130\": rpc error: code = NotFound desc = could not find container \"0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130\": container with ID starting with 0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130 not found: ID does not exist" Jul 02 00:24:00.524540 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.524457 2581 scope.go:117] "RemoveContainer" containerID="d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7" Jul 02 00:24:00.524685 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.524665 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7"} err="failed to get container status \"d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7\": rpc error: code = NotFound desc = could not find container \"d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7\": container with ID starting with d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7 not found: ID does not exist" Jul 02 00:24:00.524794 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.524688 2581 scope.go:117] "RemoveContainer" containerID="613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d" Jul 02 00:24:00.525015 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.524996 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 00:24:00.525093 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.524997 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d"} err="failed to get container status \"613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d\": rpc error: code = NotFound desc = could not find container \"613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d\": container with ID starting with 613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d not found: ID does not exist" Jul 02 00:24:00.525163 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.525095 2581 scope.go:117] "RemoveContainer" containerID="7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6" Jul 02 00:24:00.525357 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.525338 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6"} err="failed to get container status \"7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6\": rpc error: code = NotFound desc = could not find container \"7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6\": container with ID starting with 7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6 not found: ID does not exist" Jul 02 00:24:00.525446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.525358 2581 scope.go:117] "RemoveContainer" containerID="30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2" Jul 02 00:24:00.525446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.525381 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c528ee8-34d5-41d5-ac52-1ce87a4a240f" containerName="registry" Jul 02 00:24:00.525446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.525397 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c528ee8-34d5-41d5-ac52-1ce87a4a240f" containerName="registry" Jul 02 00:24:00.525446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.525408 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerName="init-config-reloader" Jul 02 00:24:00.525446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.525434 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerName="init-config-reloader" Jul 02 00:24:00.525446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.525445 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerName="prometheus" Jul 02 00:24:00.525701 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.525453 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerName="prometheus" Jul 02 00:24:00.525701 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.525464 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerName="config-reloader" Jul 02 00:24:00.525701 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.525472 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerName="config-reloader" Jul 02 00:24:00.525701 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.525491 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerName="kube-rbac-proxy-web" Jul 02 00:24:00.525701 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.525500 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerName="kube-rbac-proxy-web" Jul 02 00:24:00.525701 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.525515 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerName="thanos-sidecar" Jul 02 00:24:00.525701 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.525522 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerName="thanos-sidecar" Jul 02 00:24:00.525701 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.525531 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerName="kube-rbac-proxy-thanos" Jul 02 00:24:00.525701 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.525539 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerName="kube-rbac-proxy-thanos" Jul 02 00:24:00.525701 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.525550 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerName="kube-rbac-proxy" Jul 02 00:24:00.525701 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.525558 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerName="kube-rbac-proxy" Jul 02 00:24:00.525701 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.525636 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerName="kube-rbac-proxy-web" Jul 02 00:24:00.525701 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.525647 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerName="kube-rbac-proxy-thanos" Jul 02 00:24:00.525701 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.525658 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerName="kube-rbac-proxy" Jul 02 00:24:00.525701 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.525667 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c528ee8-34d5-41d5-ac52-1ce87a4a240f" containerName="registry" Jul 02 00:24:00.525701 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.525675 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerName="config-reloader" Jul 02 00:24:00.525701 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.525681 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerName="prometheus" Jul 02 00:24:00.525701 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.525689 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e10e251-9cde-423a-87c1-e33b2df6a751" containerName="thanos-sidecar" Jul 02 00:24:00.525701 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.525691 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2"} err="failed to get container status \"30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2\": rpc error: code = NotFound desc = could not find container \"30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2\": container with ID starting with 30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2 not found: ID does not exist" Jul 02 00:24:00.525701 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.525708 2581 scope.go:117] "RemoveContainer" containerID="5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093" Jul 02 00:24:00.526354 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.525892 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093"} err="failed to get container status \"5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093\": rpc error: code = NotFound desc = could not find container \"5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093\": container with ID starting with 5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093 not found: ID does not exist" Jul 02 00:24:00.526354 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.525905 2581 scope.go:117] "RemoveContainer" containerID="d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524" Jul 02 00:24:00.526354 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.526090 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524"} err="failed to get container status \"d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524\": rpc error: code = NotFound desc = could not find container \"d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524\": container with ID starting with d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524 not found: ID does not exist" Jul 02 00:24:00.526354 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.526106 2581 scope.go:117] "RemoveContainer" containerID="0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130" Jul 02 00:24:00.526354 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.526336 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130"} err="failed to get container status \"0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130\": rpc error: code = NotFound desc = could not find container \"0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130\": container with ID starting with 0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130 not found: ID does not exist" Jul 02 00:24:00.526571 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.526359 2581 scope.go:117] "RemoveContainer" containerID="d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7" Jul 02 00:24:00.526617 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.526566 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7"} err="failed to get container status \"d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7\": rpc error: code = NotFound desc = could not find container \"d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7\": container with ID starting with d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7 not found: ID does not exist" Jul 02 00:24:00.526617 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.526579 2581 scope.go:117] "RemoveContainer" containerID="613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d" Jul 02 00:24:00.526844 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.526824 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d"} err="failed to get container status \"613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d\": rpc error: code = NotFound desc = could not find container \"613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d\": container with ID starting with 613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d not found: ID does not exist" Jul 02 00:24:00.526925 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.526846 2581 scope.go:117] "RemoveContainer" containerID="7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6" Jul 02 00:24:00.527070 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.527051 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6"} err="failed to get container status \"7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6\": rpc error: code = NotFound desc = could not find container \"7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6\": container with ID starting with 7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6 not found: ID does not exist" Jul 02 00:24:00.527120 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.527071 2581 scope.go:117] "RemoveContainer" containerID="30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2" Jul 02 00:24:00.527289 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.527255 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2"} err="failed to get container status \"30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2\": rpc error: code = NotFound desc = could not find container \"30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2\": container with ID starting with 30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2 not found: ID does not exist" Jul 02 00:24:00.527289 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.527278 2581 scope.go:117] "RemoveContainer" containerID="5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093" Jul 02 00:24:00.527523 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.527505 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093"} err="failed to get container status \"5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093\": rpc error: code = NotFound desc = could not find container \"5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093\": container with ID starting with 5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093 not found: ID does not exist" Jul 02 00:24:00.527567 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.527523 2581 scope.go:117] "RemoveContainer" containerID="d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524" Jul 02 00:24:00.527742 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.527722 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524"} err="failed to get container status \"d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524\": rpc error: code = NotFound desc = could not find container \"d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524\": container with ID starting with d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524 not found: ID does not exist" Jul 02 00:24:00.527817 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.527743 2581 scope.go:117] "RemoveContainer" containerID="0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130" Jul 02 00:24:00.527947 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.527929 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130"} err="failed to get container status \"0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130\": rpc error: code = NotFound desc = could not find container \"0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130\": container with ID starting with 0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130 not found: ID does not exist" Jul 02 00:24:00.527988 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.527948 2581 scope.go:117] "RemoveContainer" containerID="d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7" Jul 02 00:24:00.528160 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.528142 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7"} err="failed to get container status \"d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7\": rpc error: code = NotFound desc = could not find container \"d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7\": container with ID starting with d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7 not found: ID does not exist" Jul 02 00:24:00.528230 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.528163 2581 scope.go:117] "RemoveContainer" containerID="613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d" Jul 02 00:24:00.528372 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.528355 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d"} err="failed to get container status \"613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d\": rpc error: code = NotFound desc = could not find container \"613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d\": container with ID starting with 613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d not found: ID does not exist" Jul 02 00:24:00.528443 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.528372 2581 scope.go:117] "RemoveContainer" containerID="7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6" Jul 02 00:24:00.528617 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.528599 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6"} err="failed to get container status \"7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6\": rpc error: code = NotFound desc = could not find container \"7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6\": container with ID starting with 7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6 not found: ID does not exist" Jul 02 00:24:00.528668 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.528617 2581 scope.go:117] "RemoveContainer" containerID="30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2" Jul 02 00:24:00.528821 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.528804 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2"} err="failed to get container status \"30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2\": rpc error: code = NotFound desc = could not find container \"30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2\": container with ID starting with 30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2 not found: ID does not exist" Jul 02 00:24:00.528880 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.528823 2581 scope.go:117] "RemoveContainer" containerID="5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093" Jul 02 00:24:00.529045 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.529030 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093"} err="failed to get container status \"5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093\": rpc error: code = NotFound desc = could not find container \"5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093\": container with ID starting with 5fd43e64bf99efbe1fb28ae6ec189b9b3b11a9b9c0e198ddd46d92baab051093 not found: ID does not exist" Jul 02 00:24:00.529112 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.529045 2581 scope.go:117] "RemoveContainer" containerID="d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524" Jul 02 00:24:00.529284 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.529266 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524"} err="failed to get container status \"d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524\": rpc error: code = NotFound desc = could not find container \"d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524\": container with ID starting with d42d66c8b7b33893431d5e3dcebe8d73a98218d19a0a8b454aad66ac04449524 not found: ID does not exist" Jul 02 00:24:00.529352 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.529285 2581 scope.go:117] "RemoveContainer" containerID="0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130" Jul 02 00:24:00.529630 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.529614 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130"} err="failed to get container status \"0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130\": rpc error: code = NotFound desc = could not find container \"0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130\": container with ID starting with 0bcae34a86b3c8d3dc5ad860d9cbc37961e242f64db65f55d0960c8e400d3130 not found: ID does not exist" Jul 02 00:24:00.529691 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.529630 2581 scope.go:117] "RemoveContainer" containerID="d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7" Jul 02 00:24:00.529904 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.529887 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7"} err="failed to get container status \"d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7\": rpc error: code = NotFound desc = could not find container \"d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7\": container with ID starting with d7e5f90e35aad56a58ca9e14a58cf8fb4dbc6bf7331de5d55aa49e30758bf9e7 not found: ID does not exist" Jul 02 00:24:00.529949 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.529905 2581 scope.go:117] "RemoveContainer" containerID="613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d" Jul 02 00:24:00.530118 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.530100 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d"} err="failed to get container status \"613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d\": rpc error: code = NotFound desc = could not find container \"613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d\": container with ID starting with 613c12af95640545d58f1f5f022888f4deb63aa1f3315f8451a27209fd12c75d not found: ID does not exist" Jul 02 00:24:00.530181 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.530120 2581 scope.go:117] "RemoveContainer" containerID="7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6" Jul 02 00:24:00.530311 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.530294 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6"} err="failed to get container status \"7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6\": rpc error: code = NotFound desc = could not find container \"7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6\": container with ID starting with 7ab52bbf2384d9a4353219a0b51a26420df4d65fcfdc2723324bbf1f6a6524c6 not found: ID does not exist" Jul 02 00:24:00.530375 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.530313 2581 scope.go:117] "RemoveContainer" containerID="30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2" Jul 02 00:24:00.530537 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.530519 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2"} err="failed to get container status \"30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2\": rpc error: code = NotFound desc = could not find container \"30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2\": container with ID starting with 30731c2b367c4e7beca3a70b67c173feea4f20e81d6ed58b227d57479b0db5c2 not found: ID does not exist" Jul 02 00:24:00.530979 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.530965 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.533670 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.533651 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 00:24:00.533944 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.533924 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 00:24:00.534396 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.534363 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 00:24:00.534683 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.534663 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 00:24:00.534783 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.534685 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 00:24:00.534783 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.534691 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 00:24:00.534975 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.534956 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-87zfz\"" Jul 02 00:24:00.535189 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.535168 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-chfm12674mu55\"" Jul 02 00:24:00.535270 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.535191 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 00:24:00.535270 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.535203 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 00:24:00.535270 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.535249 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 00:24:00.535484 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.535178 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 00:24:00.535560 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.535544 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 02 00:24:00.535678 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.535663 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 00:24:00.535943 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.535927 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 00:24:00.537938 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.537801 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 00:24:00.540636 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.540620 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 00:24:00.554077 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.554029 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 00:24:00.605895 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.605871 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b24daeea-82e3-4f21-a73a-f971a35d5ace-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.605986 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.605913 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b24daeea-82e3-4f21-a73a-f971a35d5ace-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.605986 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.605970 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b24daeea-82e3-4f21-a73a-f971a35d5ace-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.606092 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.605997 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b24daeea-82e3-4f21-a73a-f971a35d5ace-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.606092 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.606053 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b24daeea-82e3-4f21-a73a-f971a35d5ace-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.606092 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.606080 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrl8s\" (UniqueName: \"kubernetes.io/projected/b24daeea-82e3-4f21-a73a-f971a35d5ace-kube-api-access-jrl8s\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.606257 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.606139 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b24daeea-82e3-4f21-a73a-f971a35d5ace-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.606257 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.606157 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b24daeea-82e3-4f21-a73a-f971a35d5ace-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.606257 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.606178 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b24daeea-82e3-4f21-a73a-f971a35d5ace-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.606257 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.606206 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b24daeea-82e3-4f21-a73a-f971a35d5ace-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.606257 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.606223 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b24daeea-82e3-4f21-a73a-f971a35d5ace-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.606257 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.606244 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b24daeea-82e3-4f21-a73a-f971a35d5ace-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.606500 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.606264 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b24daeea-82e3-4f21-a73a-f971a35d5ace-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.606500 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.606295 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b24daeea-82e3-4f21-a73a-f971a35d5ace-config\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.606500 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.606312 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b24daeea-82e3-4f21-a73a-f971a35d5ace-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.606500 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.606330 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b24daeea-82e3-4f21-a73a-f971a35d5ace-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.606500 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.606348 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b24daeea-82e3-4f21-a73a-f971a35d5ace-config-out\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.606500 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.606364 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b24daeea-82e3-4f21-a73a-f971a35d5ace-web-config\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.606500 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.606435 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b24daeea-82e3-4f21-a73a-f971a35d5ace-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.606500 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.606469 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b24daeea-82e3-4f21-a73a-f971a35d5ace-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.706897 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.706875 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b24daeea-82e3-4f21-a73a-f971a35d5ace-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.707010 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.706902 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b24daeea-82e3-4f21-a73a-f971a35d5ace-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.707010 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.706922 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b24daeea-82e3-4f21-a73a-f971a35d5ace-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.707010 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.706943 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b24daeea-82e3-4f21-a73a-f971a35d5ace-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.707010 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.706965 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b24daeea-82e3-4f21-a73a-f971a35d5ace-config\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.707010 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.706990 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b24daeea-82e3-4f21-a73a-f971a35d5ace-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.707375 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.707017 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b24daeea-82e3-4f21-a73a-f971a35d5ace-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.707375 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.707047 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b24daeea-82e3-4f21-a73a-f971a35d5ace-config-out\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.707375 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.707148 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b24daeea-82e3-4f21-a73a-f971a35d5ace-web-config\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.707375 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.707237 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b24daeea-82e3-4f21-a73a-f971a35d5ace-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.707375 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.707288 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b24daeea-82e3-4f21-a73a-f971a35d5ace-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.707375 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.707360 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b24daeea-82e3-4f21-a73a-f971a35d5ace-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.707694 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.707406 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b24daeea-82e3-4f21-a73a-f971a35d5ace-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.707694 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.707467 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b24daeea-82e3-4f21-a73a-f971a35d5ace-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.707694 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.707495 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b24daeea-82e3-4f21-a73a-f971a35d5ace-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.707694 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.707527 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b24daeea-82e3-4f21-a73a-f971a35d5ace-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.707694 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.707530 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b24daeea-82e3-4f21-a73a-f971a35d5ace-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.707694 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.707551 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrl8s\" (UniqueName: \"kubernetes.io/projected/b24daeea-82e3-4f21-a73a-f971a35d5ace-kube-api-access-jrl8s\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.707694 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.707617 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b24daeea-82e3-4f21-a73a-f971a35d5ace-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.707694 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.707648 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b24daeea-82e3-4f21-a73a-f971a35d5ace-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.707694 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.707680 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b24daeea-82e3-4f21-a73a-f971a35d5ace-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.708170 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.707773 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b24daeea-82e3-4f21-a73a-f971a35d5ace-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.708473 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.708449 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b24daeea-82e3-4f21-a73a-f971a35d5ace-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.709364 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.709036 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b24daeea-82e3-4f21-a73a-f971a35d5ace-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.709364 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.709172 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b24daeea-82e3-4f21-a73a-f971a35d5ace-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.709752 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.709734 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b24daeea-82e3-4f21-a73a-f971a35d5ace-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.710462 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.710441 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b24daeea-82e3-4f21-a73a-f971a35d5ace-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.710881 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.710859 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b24daeea-82e3-4f21-a73a-f971a35d5ace-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.711135 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.711113 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b24daeea-82e3-4f21-a73a-f971a35d5ace-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.711309 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.711288 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b24daeea-82e3-4f21-a73a-f971a35d5ace-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.711515 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.711487 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b24daeea-82e3-4f21-a73a-f971a35d5ace-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.712227 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.712199 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b24daeea-82e3-4f21-a73a-f971a35d5ace-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.712667 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.712642 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b24daeea-82e3-4f21-a73a-f971a35d5ace-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.712786 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.712736 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b24daeea-82e3-4f21-a73a-f971a35d5ace-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.713391 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.713371 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b24daeea-82e3-4f21-a73a-f971a35d5ace-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.713835 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.713809 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b24daeea-82e3-4f21-a73a-f971a35d5ace-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.714044 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.714027 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b24daeea-82e3-4f21-a73a-f971a35d5ace-config-out\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.714044 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.714038 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b24daeea-82e3-4f21-a73a-f971a35d5ace-web-config\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.714271 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.714253 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b24daeea-82e3-4f21-a73a-f971a35d5ace-config\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.715898 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.715878 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrl8s\" (UniqueName: \"kubernetes.io/projected/b24daeea-82e3-4f21-a73a-f971a35d5ace-kube-api-access-jrl8s\") pod \"prometheus-k8s-0\" (UID: \"b24daeea-82e3-4f21-a73a-f971a35d5ace\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.841327 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.841235 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:00.983548 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:00.983518 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 00:24:00.987334 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:24:00.987301 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb24daeea_82e3_4f21_a73a_f971a35d5ace.slice/crio-710bb75ebf4d75501f3b5c22857ffdc1e4fe70e0ba7732be2703c5fd45ced01f WatchSource:0}: Error finding container 710bb75ebf4d75501f3b5c22857ffdc1e4fe70e0ba7732be2703c5fd45ced01f: Status 404 returned error can't find the container with id 710bb75ebf4d75501f3b5c22857ffdc1e4fe70e0ba7732be2703c5fd45ced01f Jul 02 00:24:01.072282 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:01.072256 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e10e251-9cde-423a-87c1-e33b2df6a751" path="/var/lib/kubelet/pods/6e10e251-9cde-423a-87c1-e33b2df6a751/volumes" Jul 02 00:24:01.474907 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:01.474869 2581 generic.go:356] "Generic (PLEG): container finished" podID="b24daeea-82e3-4f21-a73a-f971a35d5ace" containerID="06fb3fa76feb29ba0a9b1d392acb03016be026c48b518940819e14f1fe908e58" exitCode=0 Jul 02 00:24:01.475065 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:01.474961 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b24daeea-82e3-4f21-a73a-f971a35d5ace","Type":"ContainerDied","Data":"06fb3fa76feb29ba0a9b1d392acb03016be026c48b518940819e14f1fe908e58"} Jul 02 00:24:01.475065 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:01.475033 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b24daeea-82e3-4f21-a73a-f971a35d5ace","Type":"ContainerStarted","Data":"710bb75ebf4d75501f3b5c22857ffdc1e4fe70e0ba7732be2703c5fd45ced01f"} Jul 02 00:24:02.484029 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:02.483997 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b24daeea-82e3-4f21-a73a-f971a35d5ace","Type":"ContainerStarted","Data":"7a13d391bfd8d1b3882a202d69779895494c02508a43c865ffb36686ba288611"} Jul 02 00:24:02.484410 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:02.484060 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b24daeea-82e3-4f21-a73a-f971a35d5ace","Type":"ContainerStarted","Data":"9ea1473649cefa45303591d701210e8fd9628e5f9728a6d69080d0914dc725d3"} Jul 02 00:24:02.484410 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:02.484086 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b24daeea-82e3-4f21-a73a-f971a35d5ace","Type":"ContainerStarted","Data":"8a01952a7169449eab82a362ea7626f605b53f4364b501f51182cd9c9d68c8ce"} Jul 02 00:24:02.484410 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:02.484111 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b24daeea-82e3-4f21-a73a-f971a35d5ace","Type":"ContainerStarted","Data":"c00823b3124499e14a04cda284433b3e0986370557655e7f022d6996b32ae156"} Jul 02 00:24:02.484410 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:02.484135 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b24daeea-82e3-4f21-a73a-f971a35d5ace","Type":"ContainerStarted","Data":"86904a5cfb24621766e77cee029e405941e54ae2b26bdb728d74880b2f54ae02"} Jul 02 00:24:02.484410 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:02.484157 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b24daeea-82e3-4f21-a73a-f971a35d5ace","Type":"ContainerStarted","Data":"944fedb8ff920c1668b026094c2cdad243644427facc2a90265051ecfa8a54e9"} Jul 02 00:24:02.516087 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:02.516034 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.493988036 podStartE2EDuration="2.516017846s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.02981ms" isStatefulPod=false podCreationTimestamp="2026-07-02 00:24:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:24:02.513574255 +0000 UTC m=+395.929011932" watchObservedRunningTime="2026-07-02 00:24:02.516017846 +0000 UTC m=+395.931455513" Jul 02 00:24:03.303075 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:03.303042 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:24:03.357715 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:03.357668 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:24:05.841881 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:05.841840 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:24:07.708176 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:07.708142 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:24:07.807953 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:07.807922 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:24:07.861793 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:07.861769 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:24:09.453724 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:09.453692 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:24:10.997013 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:24:10.996973 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-8jnpt" podUID="2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2" Jul 02 00:24:11.520182 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:11.520153 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-8jnpt" Jul 02 00:24:13.113996 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:13.113949 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-8jnpt\" (UID: \"2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-8jnpt" Jul 02 00:24:13.116300 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:13.116279 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-8jnpt\" (UID: \"2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-8jnpt" Jul 02 00:24:13.323871 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:13.323841 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-w6rdh\"" Jul 02 00:24:13.331136 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:13.331118 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-8jnpt" Jul 02 00:24:13.454213 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:13.454088 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-8jnpt"] Jul 02 00:24:13.456320 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:24:13.456296 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ae1d967_f1b0_4ddf_b5be_2055ed3b89c2.slice/crio-57633a25b35866de2bf85d92240f4483e8e3131482ea4735cf6c8868affea501 WatchSource:0}: Error finding container 57633a25b35866de2bf85d92240f4483e8e3131482ea4735cf6c8868affea501: Status 404 returned error can't find the container with id 57633a25b35866de2bf85d92240f4483e8e3131482ea4735cf6c8868affea501 Jul 02 00:24:13.529040 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:13.529008 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-8jnpt" event={"ID":"2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2","Type":"ContainerStarted","Data":"57633a25b35866de2bf85d92240f4483e8e3131482ea4735cf6c8868affea501"} Jul 02 00:24:15.541672 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:15.541636 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-8jnpt" event={"ID":"2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2","Type":"ContainerStarted","Data":"f7fc54e2568835a21fe4a7a801a5560c9e543058798b9734e8b6322806c8827a"} Jul 02 00:24:15.557268 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:15.557215 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-8jnpt" podStartSLOduration=384.068549215 podStartE2EDuration="6m25.557200946s" totalImagesPullingTime="1.488651731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:17:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:24:15.55660724 +0000 UTC m=+408.972044921" watchObservedRunningTime="2026-07-02 00:24:15.557200946 +0000 UTC m=+408.972638612" Jul 02 00:24:15.649934 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:15.649895 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:24:15.705101 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:15.705069 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:24:17.052864 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:17.052825 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:24:17.153627 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:17.153588 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:24:17.205623 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:17.205590 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:24:59.200365 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:59.200329 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:24:59.295810 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:24:59.295781 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:25:00.841591 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:25:00.841545 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:25:00.856726 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:25:00.856703 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:25:01.735905 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:25:01.735878 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 00:25:25.767973 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:25:25.767935 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:25:26.570604 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:25:26.570572 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:25:29.384968 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:25:29.384935 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:25:29.485783 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:25:29.485751 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:25:30.769954 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:25:30.769925 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:25:30.874851 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:25:30.874819 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:25:31.278966 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:25:31.278935 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:25:31.396911 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:25:31.396886 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:25:34.078346 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:25:34.078313 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:25:34.666440 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:25:34.666389 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:25:36.175513 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:25:36.175482 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:25:36.275249 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:25:36.275215 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:25:42.189725 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:25:42.189691 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:25:42.245194 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:25:42.245159 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:25:42.474210 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:25:42.474133 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:25:49.345895 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:25:49.345862 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:25:49.446594 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:25:49.446564 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:05.186290 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:05.186256 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:05.285143 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:05.285114 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:07.430883 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:07.430851 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bkkdp"] Jul 02 00:26:07.434043 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:07.434026 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bkkdp" Jul 02 00:26:07.436584 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:07.436562 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 02 00:26:07.436724 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:07.436610 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 02 00:26:07.437593 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:07.437577 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-xvflt\"" Jul 02 00:26:07.441979 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:07.441960 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bkkdp"] Jul 02 00:26:07.496519 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:07.496496 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51314dd8-0b66-4d1d-a0da-34cbe68e4a03-tmp\") pod \"openshift-lws-operator-fd8ccff4c-bkkdp\" (UID: \"51314dd8-0b66-4d1d-a0da-34cbe68e4a03\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bkkdp" Jul 02 00:26:07.496649 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:07.496555 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw5g2\" (UniqueName: \"kubernetes.io/projected/51314dd8-0b66-4d1d-a0da-34cbe68e4a03-kube-api-access-mw5g2\") pod \"openshift-lws-operator-fd8ccff4c-bkkdp\" (UID: \"51314dd8-0b66-4d1d-a0da-34cbe68e4a03\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bkkdp" Jul 02 00:26:07.597057 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:07.597028 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw5g2\" (UniqueName: \"kubernetes.io/projected/51314dd8-0b66-4d1d-a0da-34cbe68e4a03-kube-api-access-mw5g2\") pod \"openshift-lws-operator-fd8ccff4c-bkkdp\" (UID: \"51314dd8-0b66-4d1d-a0da-34cbe68e4a03\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bkkdp" Jul 02 00:26:07.597219 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:07.597081 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51314dd8-0b66-4d1d-a0da-34cbe68e4a03-tmp\") pod \"openshift-lws-operator-fd8ccff4c-bkkdp\" (UID: \"51314dd8-0b66-4d1d-a0da-34cbe68e4a03\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bkkdp" Jul 02 00:26:07.597395 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:07.597379 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51314dd8-0b66-4d1d-a0da-34cbe68e4a03-tmp\") pod \"openshift-lws-operator-fd8ccff4c-bkkdp\" (UID: \"51314dd8-0b66-4d1d-a0da-34cbe68e4a03\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bkkdp" Jul 02 00:26:07.604718 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:07.604699 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw5g2\" (UniqueName: \"kubernetes.io/projected/51314dd8-0b66-4d1d-a0da-34cbe68e4a03-kube-api-access-mw5g2\") pod \"openshift-lws-operator-fd8ccff4c-bkkdp\" (UID: \"51314dd8-0b66-4d1d-a0da-34cbe68e4a03\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bkkdp" Jul 02 00:26:07.759157 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:07.759127 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bkkdp" Jul 02 00:26:07.885734 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:07.885712 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bkkdp"] Jul 02 00:26:07.888166 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:26:07.888130 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51314dd8_0b66_4d1d_a0da_34cbe68e4a03.slice/crio-9bf121f2f5aaca74c7c645bee3241b3bcf6233842f79052a1e70d79a072352aa WatchSource:0}: Error finding container 9bf121f2f5aaca74c7c645bee3241b3bcf6233842f79052a1e70d79a072352aa: Status 404 returned error can't find the container with id 9bf121f2f5aaca74c7c645bee3241b3bcf6233842f79052a1e70d79a072352aa Jul 02 00:26:07.967644 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:07.967594 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bkkdp" event={"ID":"51314dd8-0b66-4d1d-a0da-34cbe68e4a03","Type":"ContainerStarted","Data":"9bf121f2f5aaca74c7c645bee3241b3bcf6233842f79052a1e70d79a072352aa"} Jul 02 00:26:10.983748 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:10.983667 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bkkdp" event={"ID":"51314dd8-0b66-4d1d-a0da-34cbe68e4a03","Type":"ContainerStarted","Data":"a6aa041149ca3175479f9c56263a8979883b5b2ed74b3aef5fdcafb17bacbcec"} Jul 02 00:26:10.999617 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:10.999571 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bkkdp" podStartSLOduration=1.317351968 podStartE2EDuration="3.999555869s" totalImagesPullingTime="2.682203901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:26:10.998730277 +0000 UTC m=+524.414167948" watchObservedRunningTime="2026-07-02 00:26:10.999555869 +0000 UTC m=+524.414993536" Jul 02 00:26:11.671572 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:11.671543 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:11.781383 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:11.781322 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:13.826502 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:13.826471 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:18.037945 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:18.037908 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:18.084103 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:18.084073 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5db5fc4db4-st7dm"] Jul 02 00:26:18.087354 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:18.087334 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5db5fc4db4-st7dm" Jul 02 00:26:18.090243 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:18.090218 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 02 00:26:18.090365 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:18.090285 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 02 00:26:18.091553 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:18.091535 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 02 00:26:18.091662 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:18.091543 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rfq92\"" Jul 02 00:26:18.112317 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:18.112293 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5db5fc4db4-st7dm"] Jul 02 00:26:18.172457 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:18.172388 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:18.186180 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:18.186159 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6cc925e4-b250-495d-a652-523c294ee2ed-metrics-cert\") pod \"lws-controller-manager-5db5fc4db4-st7dm\" (UID: \"6cc925e4-b250-495d-a652-523c294ee2ed\") " pod="openshift-lws-operator/lws-controller-manager-5db5fc4db4-st7dm" Jul 02 00:26:18.186299 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:18.186210 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6cc925e4-b250-495d-a652-523c294ee2ed-cert\") pod \"lws-controller-manager-5db5fc4db4-st7dm\" (UID: \"6cc925e4-b250-495d-a652-523c294ee2ed\") " pod="openshift-lws-operator/lws-controller-manager-5db5fc4db4-st7dm" Jul 02 00:26:18.186299 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:18.186261 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6cc925e4-b250-495d-a652-523c294ee2ed-manager-config\") pod \"lws-controller-manager-5db5fc4db4-st7dm\" (UID: \"6cc925e4-b250-495d-a652-523c294ee2ed\") " pod="openshift-lws-operator/lws-controller-manager-5db5fc4db4-st7dm" Jul 02 00:26:18.186429 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:18.186380 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfsqb\" (UniqueName: \"kubernetes.io/projected/6cc925e4-b250-495d-a652-523c294ee2ed-kube-api-access-gfsqb\") pod \"lws-controller-manager-5db5fc4db4-st7dm\" (UID: \"6cc925e4-b250-495d-a652-523c294ee2ed\") " pod="openshift-lws-operator/lws-controller-manager-5db5fc4db4-st7dm" Jul 02 00:26:18.286893 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:18.286863 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6cc925e4-b250-495d-a652-523c294ee2ed-metrics-cert\") pod \"lws-controller-manager-5db5fc4db4-st7dm\" (UID: \"6cc925e4-b250-495d-a652-523c294ee2ed\") " pod="openshift-lws-operator/lws-controller-manager-5db5fc4db4-st7dm" Jul 02 00:26:18.287027 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:18.286937 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6cc925e4-b250-495d-a652-523c294ee2ed-cert\") pod \"lws-controller-manager-5db5fc4db4-st7dm\" (UID: \"6cc925e4-b250-495d-a652-523c294ee2ed\") " pod="openshift-lws-operator/lws-controller-manager-5db5fc4db4-st7dm" Jul 02 00:26:18.287027 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:18.286972 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6cc925e4-b250-495d-a652-523c294ee2ed-manager-config\") pod \"lws-controller-manager-5db5fc4db4-st7dm\" (UID: \"6cc925e4-b250-495d-a652-523c294ee2ed\") " pod="openshift-lws-operator/lws-controller-manager-5db5fc4db4-st7dm" Jul 02 00:26:18.287155 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:18.287031 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfsqb\" (UniqueName: \"kubernetes.io/projected/6cc925e4-b250-495d-a652-523c294ee2ed-kube-api-access-gfsqb\") pod \"lws-controller-manager-5db5fc4db4-st7dm\" (UID: \"6cc925e4-b250-495d-a652-523c294ee2ed\") " pod="openshift-lws-operator/lws-controller-manager-5db5fc4db4-st7dm" Jul 02 00:26:18.287674 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:18.287650 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6cc925e4-b250-495d-a652-523c294ee2ed-manager-config\") pod \"lws-controller-manager-5db5fc4db4-st7dm\" (UID: \"6cc925e4-b250-495d-a652-523c294ee2ed\") " pod="openshift-lws-operator/lws-controller-manager-5db5fc4db4-st7dm" Jul 02 00:26:18.289354 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:18.289297 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6cc925e4-b250-495d-a652-523c294ee2ed-cert\") pod \"lws-controller-manager-5db5fc4db4-st7dm\" (UID: \"6cc925e4-b250-495d-a652-523c294ee2ed\") " pod="openshift-lws-operator/lws-controller-manager-5db5fc4db4-st7dm" Jul 02 00:26:18.289589 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:18.289571 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6cc925e4-b250-495d-a652-523c294ee2ed-metrics-cert\") pod \"lws-controller-manager-5db5fc4db4-st7dm\" (UID: \"6cc925e4-b250-495d-a652-523c294ee2ed\") " pod="openshift-lws-operator/lws-controller-manager-5db5fc4db4-st7dm" Jul 02 00:26:18.295572 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:18.295538 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfsqb\" (UniqueName: \"kubernetes.io/projected/6cc925e4-b250-495d-a652-523c294ee2ed-kube-api-access-gfsqb\") pod \"lws-controller-manager-5db5fc4db4-st7dm\" (UID: \"6cc925e4-b250-495d-a652-523c294ee2ed\") " pod="openshift-lws-operator/lws-controller-manager-5db5fc4db4-st7dm" Jul 02 00:26:18.396202 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:18.396167 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5db5fc4db4-st7dm" Jul 02 00:26:18.529085 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:18.529058 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5db5fc4db4-st7dm"] Jul 02 00:26:18.531081 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:26:18.531050 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cc925e4_b250_495d_a652_523c294ee2ed.slice/crio-f3ecc35e398723a96831f66ef971505157982fc5d9c58d6d8fc2786220b33f57 WatchSource:0}: Error finding container f3ecc35e398723a96831f66ef971505157982fc5d9c58d6d8fc2786220b33f57: Status 404 returned error can't find the container with id f3ecc35e398723a96831f66ef971505157982fc5d9c58d6d8fc2786220b33f57 Jul 02 00:26:19.023858 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:19.023818 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5db5fc4db4-st7dm" event={"ID":"6cc925e4-b250-495d-a652-523c294ee2ed","Type":"ContainerStarted","Data":"f3ecc35e398723a96831f66ef971505157982fc5d9c58d6d8fc2786220b33f57"} Jul 02 00:26:20.028807 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:20.028766 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5db5fc4db4-st7dm" event={"ID":"6cc925e4-b250-495d-a652-523c294ee2ed","Type":"ContainerStarted","Data":"dfa0dd8bf6705dce0ce6dff2c6f81cfcec16741313c94b283dca4e77bd9bbbec"} Jul 02 00:26:20.029180 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:20.028847 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5db5fc4db4-st7dm" Jul 02 00:26:20.045030 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:20.044983 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5db5fc4db4-st7dm" podStartSLOduration=0.844399857 podStartE2EDuration="2.044969015s" totalImagesPullingTime="1.200569158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:26:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:26:20.04315612 +0000 UTC m=+533.458593800" watchObservedRunningTime="2026-07-02 00:26:20.044969015 +0000 UTC m=+533.460406681" Jul 02 00:26:26.203721 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:26.203684 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:26.302715 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:26.302683 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:26.793894 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:26.793860 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:27.064772 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.064681 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:27.158057 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.158020 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:27.182730 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.182700 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75d8df8c5b-72vqs"] Jul 02 00:26:27.186076 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.186059 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75d8df8c5b-72vqs" Jul 02 00:26:27.188181 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.188162 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zhqxd\"" Jul 02 00:26:27.188538 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.188521 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 02 00:26:27.188647 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.188630 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 02 00:26:27.188717 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.188638 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 02 00:26:27.188768 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.188734 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 02 00:26:27.199780 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.199761 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75d8df8c5b-72vqs"] Jul 02 00:26:27.261479 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.261443 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t45h\" (UniqueName: \"kubernetes.io/projected/96c409a2-1057-4825-8877-7baf055ed7e3-kube-api-access-7t45h\") pod \"opendatahub-operator-controller-manager-75d8df8c5b-72vqs\" (UID: \"96c409a2-1057-4825-8877-7baf055ed7e3\") " pod="opendatahub/opendatahub-operator-controller-manager-75d8df8c5b-72vqs" Jul 02 00:26:27.261479 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.261492 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/96c409a2-1057-4825-8877-7baf055ed7e3-webhook-cert\") pod \"opendatahub-operator-controller-manager-75d8df8c5b-72vqs\" (UID: \"96c409a2-1057-4825-8877-7baf055ed7e3\") " pod="opendatahub/opendatahub-operator-controller-manager-75d8df8c5b-72vqs" Jul 02 00:26:27.261874 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.261614 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/96c409a2-1057-4825-8877-7baf055ed7e3-manifests\") pod \"opendatahub-operator-controller-manager-75d8df8c5b-72vqs\" (UID: \"96c409a2-1057-4825-8877-7baf055ed7e3\") " pod="opendatahub/opendatahub-operator-controller-manager-75d8df8c5b-72vqs" Jul 02 00:26:27.261874 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.261645 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96c409a2-1057-4825-8877-7baf055ed7e3-tmp\") pod \"opendatahub-operator-controller-manager-75d8df8c5b-72vqs\" (UID: \"96c409a2-1057-4825-8877-7baf055ed7e3\") " pod="opendatahub/opendatahub-operator-controller-manager-75d8df8c5b-72vqs" Jul 02 00:26:27.261874 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.261662 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/96c409a2-1057-4825-8877-7baf055ed7e3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75d8df8c5b-72vqs\" (UID: \"96c409a2-1057-4825-8877-7baf055ed7e3\") " pod="opendatahub/opendatahub-operator-controller-manager-75d8df8c5b-72vqs" Jul 02 00:26:27.289694 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.289671 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:27.362126 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.362058 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t45h\" (UniqueName: \"kubernetes.io/projected/96c409a2-1057-4825-8877-7baf055ed7e3-kube-api-access-7t45h\") pod \"opendatahub-operator-controller-manager-75d8df8c5b-72vqs\" (UID: \"96c409a2-1057-4825-8877-7baf055ed7e3\") " pod="opendatahub/opendatahub-operator-controller-manager-75d8df8c5b-72vqs" Jul 02 00:26:27.362126 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.362090 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/96c409a2-1057-4825-8877-7baf055ed7e3-webhook-cert\") pod \"opendatahub-operator-controller-manager-75d8df8c5b-72vqs\" (UID: \"96c409a2-1057-4825-8877-7baf055ed7e3\") " pod="opendatahub/opendatahub-operator-controller-manager-75d8df8c5b-72vqs" Jul 02 00:26:27.362273 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.362155 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/96c409a2-1057-4825-8877-7baf055ed7e3-manifests\") pod \"opendatahub-operator-controller-manager-75d8df8c5b-72vqs\" (UID: \"96c409a2-1057-4825-8877-7baf055ed7e3\") " pod="opendatahub/opendatahub-operator-controller-manager-75d8df8c5b-72vqs" Jul 02 00:26:27.362273 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.362191 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96c409a2-1057-4825-8877-7baf055ed7e3-tmp\") pod \"opendatahub-operator-controller-manager-75d8df8c5b-72vqs\" (UID: \"96c409a2-1057-4825-8877-7baf055ed7e3\") " pod="opendatahub/opendatahub-operator-controller-manager-75d8df8c5b-72vqs" Jul 02 00:26:27.362273 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.362217 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/96c409a2-1057-4825-8877-7baf055ed7e3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75d8df8c5b-72vqs\" (UID: \"96c409a2-1057-4825-8877-7baf055ed7e3\") " pod="opendatahub/opendatahub-operator-controller-manager-75d8df8c5b-72vqs" Jul 02 00:26:27.362660 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.362637 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/96c409a2-1057-4825-8877-7baf055ed7e3-manifests\") pod \"opendatahub-operator-controller-manager-75d8df8c5b-72vqs\" (UID: \"96c409a2-1057-4825-8877-7baf055ed7e3\") " pod="opendatahub/opendatahub-operator-controller-manager-75d8df8c5b-72vqs" Jul 02 00:26:27.364519 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.364488 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96c409a2-1057-4825-8877-7baf055ed7e3-tmp\") pod \"opendatahub-operator-controller-manager-75d8df8c5b-72vqs\" (UID: \"96c409a2-1057-4825-8877-7baf055ed7e3\") " pod="opendatahub/opendatahub-operator-controller-manager-75d8df8c5b-72vqs" Jul 02 00:26:27.364634 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.364571 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/96c409a2-1057-4825-8877-7baf055ed7e3-webhook-cert\") pod \"opendatahub-operator-controller-manager-75d8df8c5b-72vqs\" (UID: \"96c409a2-1057-4825-8877-7baf055ed7e3\") " pod="opendatahub/opendatahub-operator-controller-manager-75d8df8c5b-72vqs" Jul 02 00:26:27.364817 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.364795 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/96c409a2-1057-4825-8877-7baf055ed7e3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75d8df8c5b-72vqs\" (UID: \"96c409a2-1057-4825-8877-7baf055ed7e3\") " pod="opendatahub/opendatahub-operator-controller-manager-75d8df8c5b-72vqs" Jul 02 00:26:27.370149 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.370132 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t45h\" (UniqueName: \"kubernetes.io/projected/96c409a2-1057-4825-8877-7baf055ed7e3-kube-api-access-7t45h\") pod \"opendatahub-operator-controller-manager-75d8df8c5b-72vqs\" (UID: \"96c409a2-1057-4825-8877-7baf055ed7e3\") " pod="opendatahub/opendatahub-operator-controller-manager-75d8df8c5b-72vqs" Jul 02 00:26:27.393823 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.393802 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:27.490243 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.490220 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:27.496210 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.496191 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75d8df8c5b-72vqs" Jul 02 00:26:27.657755 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.657732 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75d8df8c5b-72vqs"] Jul 02 00:26:27.660393 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:26:27.660361 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96c409a2_1057_4825_8877_7baf055ed7e3.slice/crio-9a96309bb3da8164452ff36a4f50a9ec74f41e352bb13287117a7be7f1ef4a11 WatchSource:0}: Error finding container 9a96309bb3da8164452ff36a4f50a9ec74f41e352bb13287117a7be7f1ef4a11: Status 404 returned error can't find the container with id 9a96309bb3da8164452ff36a4f50a9ec74f41e352bb13287117a7be7f1ef4a11 Jul 02 00:26:27.760618 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.760591 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:27.861488 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:27.861458 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:28.062082 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:28.062047 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75d8df8c5b-72vqs" event={"ID":"96c409a2-1057-4825-8877-7baf055ed7e3","Type":"ContainerStarted","Data":"9a96309bb3da8164452ff36a4f50a9ec74f41e352bb13287117a7be7f1ef4a11"} Jul 02 00:26:31.037049 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:31.037023 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5db5fc4db4-st7dm" Jul 02 00:26:31.079447 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:31.079344 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75d8df8c5b-72vqs" event={"ID":"96c409a2-1057-4825-8877-7baf055ed7e3","Type":"ContainerStarted","Data":"2fbe3393734e87d2d0f612e3e73a5134e9de1503f3c51f6deea1fa47411c320d"} Jul 02 00:26:31.381929 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:31.381856 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:32.085584 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:32.085546 2581 generic.go:356] "Generic (PLEG): container finished" podID="96c409a2-1057-4825-8877-7baf055ed7e3" containerID="2fbe3393734e87d2d0f612e3e73a5134e9de1503f3c51f6deea1fa47411c320d" exitCode=0 Jul 02 00:26:32.085968 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:32.085632 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75d8df8c5b-72vqs" event={"ID":"96c409a2-1057-4825-8877-7baf055ed7e3","Type":"ContainerDied","Data":"2fbe3393734e87d2d0f612e3e73a5134e9de1503f3c51f6deea1fa47411c320d"} Jul 02 00:26:33.092061 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:33.092030 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75d8df8c5b-72vqs" event={"ID":"96c409a2-1057-4825-8877-7baf055ed7e3","Type":"ContainerStarted","Data":"1756a30b0299fdaa5418b948c313ac4ff3e530b3bbcc9a2ccbe51fe16c211c0e"} Jul 02 00:26:33.092476 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:33.092143 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-75d8df8c5b-72vqs" Jul 02 00:26:33.114107 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:33.114056 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-75d8df8c5b-72vqs" podStartSLOduration=1.594258116 podStartE2EDuration="6.114041769s" totalImagesPullingTime="3.440026531s" totalInitContainerRuntime="1.079757122s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:26:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:26:33.111899718 +0000 UTC m=+546.527337386" watchObservedRunningTime="2026-07-02 00:26:33.114041769 +0000 UTC m=+546.529479435" Jul 02 00:26:35.920970 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:35.920937 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:38.360998 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:38.360968 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:38.461700 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:38.461669 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:44.099207 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:44.099178 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-75d8df8c5b-72vqs" Jul 02 00:26:45.705139 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:45.705109 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:45.859934 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:45.859908 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:46.168882 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:46.168852 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:46.318830 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:46.318805 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:46.509671 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:46.509646 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:46.611441 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:46.611376 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:46.707670 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:46.707630 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:46.808558 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:46.808468 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:47.332931 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:47.332900 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:47.627623 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:47.627550 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:47.692611 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:47.692577 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:48.618869 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:48.618843 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:53.558779 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:53.558742 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:53.831549 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:53.831466 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx"] Jul 02 00:26:53.834488 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:53.834464 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:26:53.837071 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:53.837050 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-sqgb8\"" Jul 02 00:26:53.837199 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:53.837099 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 02 00:26:53.850156 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:53.850131 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx"] Jul 02 00:26:53.901118 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:53.901094 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4"] Jul 02 00:26:53.904372 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:53.904355 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:53.915655 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:53.915635 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4"] Jul 02 00:26:53.970485 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:53.970463 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:26:53.970595 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:53.970489 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:26:53.970595 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:53.970510 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdx4x\" (UniqueName: \"kubernetes.io/projected/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-kube-api-access-rdx4x\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:26:53.970595 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:53.970530 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:26:53.970704 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:53.970620 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:26:53.970704 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:53.970669 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:26:53.970769 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:53.970718 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:26:53.970769 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:53.970744 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:26:53.970834 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:53.970797 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:26:54.071533 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.071507 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:26:54.071662 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.071543 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08f8a243-cecf-4ae5-887b-de38ae1f1bed-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k9nj4\" (UID: \"08f8a243-cecf-4ae5-887b-de38ae1f1bed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:54.071662 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.071571 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08f8a243-cecf-4ae5-887b-de38ae1f1bed-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k9nj4\" (UID: \"08f8a243-cecf-4ae5-887b-de38ae1f1bed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:54.071662 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.071589 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08f8a243-cecf-4ae5-887b-de38ae1f1bed-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k9nj4\" (UID: \"08f8a243-cecf-4ae5-887b-de38ae1f1bed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:54.071662 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.071613 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08f8a243-cecf-4ae5-887b-de38ae1f1bed-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k9nj4\" (UID: \"08f8a243-cecf-4ae5-887b-de38ae1f1bed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:54.071871 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.071719 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:26:54.071871 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.071763 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmcqw\" (UniqueName: \"kubernetes.io/projected/08f8a243-cecf-4ae5-887b-de38ae1f1bed-kube-api-access-dmcqw\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k9nj4\" (UID: \"08f8a243-cecf-4ae5-887b-de38ae1f1bed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:54.071871 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.071791 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08f8a243-cecf-4ae5-887b-de38ae1f1bed-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k9nj4\" (UID: \"08f8a243-cecf-4ae5-887b-de38ae1f1bed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:54.071871 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.071825 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:26:54.071871 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.071858 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:26:54.072115 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.071881 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08f8a243-cecf-4ae5-887b-de38ae1f1bed-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k9nj4\" (UID: \"08f8a243-cecf-4ae5-887b-de38ae1f1bed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:54.072115 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.071913 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:26:54.072115 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.071943 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:26:54.072115 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.072002 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:26:54.072115 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.072041 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:26:54.072115 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.072059 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:26:54.072115 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.072071 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdx4x\" (UniqueName: \"kubernetes.io/projected/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-kube-api-access-rdx4x\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:26:54.072115 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.072102 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08f8a243-cecf-4ae5-887b-de38ae1f1bed-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k9nj4\" (UID: \"08f8a243-cecf-4ae5-887b-de38ae1f1bed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:54.072470 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.072129 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08f8a243-cecf-4ae5-887b-de38ae1f1bed-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k9nj4\" (UID: \"08f8a243-cecf-4ae5-887b-de38ae1f1bed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:54.072470 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.072153 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:26:54.072470 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.072256 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:26:54.072470 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.072294 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:26:54.072706 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.072689 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:26:54.073925 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.073906 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:26:54.074270 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.074254 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:26:54.083831 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.083784 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:26:54.083905 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.083852 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdx4x\" (UniqueName: \"kubernetes.io/projected/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-kube-api-access-rdx4x\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:26:54.145499 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.145475 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:26:54.172814 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.172791 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08f8a243-cecf-4ae5-887b-de38ae1f1bed-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k9nj4\" (UID: \"08f8a243-cecf-4ae5-887b-de38ae1f1bed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:54.172934 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.172828 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08f8a243-cecf-4ae5-887b-de38ae1f1bed-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k9nj4\" (UID: \"08f8a243-cecf-4ae5-887b-de38ae1f1bed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:54.172934 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.172847 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08f8a243-cecf-4ae5-887b-de38ae1f1bed-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k9nj4\" (UID: \"08f8a243-cecf-4ae5-887b-de38ae1f1bed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:54.172934 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.172872 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08f8a243-cecf-4ae5-887b-de38ae1f1bed-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k9nj4\" (UID: \"08f8a243-cecf-4ae5-887b-de38ae1f1bed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:54.172934 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.172924 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmcqw\" (UniqueName: \"kubernetes.io/projected/08f8a243-cecf-4ae5-887b-de38ae1f1bed-kube-api-access-dmcqw\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k9nj4\" (UID: \"08f8a243-cecf-4ae5-887b-de38ae1f1bed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:54.173142 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.172964 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08f8a243-cecf-4ae5-887b-de38ae1f1bed-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k9nj4\" (UID: \"08f8a243-cecf-4ae5-887b-de38ae1f1bed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:54.173142 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.173009 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08f8a243-cecf-4ae5-887b-de38ae1f1bed-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k9nj4\" (UID: \"08f8a243-cecf-4ae5-887b-de38ae1f1bed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:54.173142 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.173063 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08f8a243-cecf-4ae5-887b-de38ae1f1bed-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k9nj4\" (UID: \"08f8a243-cecf-4ae5-887b-de38ae1f1bed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:54.173142 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.173089 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08f8a243-cecf-4ae5-887b-de38ae1f1bed-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k9nj4\" (UID: \"08f8a243-cecf-4ae5-887b-de38ae1f1bed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:54.173353 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.173295 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08f8a243-cecf-4ae5-887b-de38ae1f1bed-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k9nj4\" (UID: \"08f8a243-cecf-4ae5-887b-de38ae1f1bed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:54.173353 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.173332 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08f8a243-cecf-4ae5-887b-de38ae1f1bed-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k9nj4\" (UID: \"08f8a243-cecf-4ae5-887b-de38ae1f1bed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:54.173482 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.173351 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08f8a243-cecf-4ae5-887b-de38ae1f1bed-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k9nj4\" (UID: \"08f8a243-cecf-4ae5-887b-de38ae1f1bed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:54.173638 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.173617 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08f8a243-cecf-4ae5-887b-de38ae1f1bed-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k9nj4\" (UID: \"08f8a243-cecf-4ae5-887b-de38ae1f1bed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:54.173707 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.173663 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08f8a243-cecf-4ae5-887b-de38ae1f1bed-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k9nj4\" (UID: \"08f8a243-cecf-4ae5-887b-de38ae1f1bed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:54.175037 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.175009 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08f8a243-cecf-4ae5-887b-de38ae1f1bed-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k9nj4\" (UID: \"08f8a243-cecf-4ae5-887b-de38ae1f1bed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:54.175562 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.175546 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08f8a243-cecf-4ae5-887b-de38ae1f1bed-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k9nj4\" (UID: \"08f8a243-cecf-4ae5-887b-de38ae1f1bed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:54.181258 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.181237 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmcqw\" (UniqueName: \"kubernetes.io/projected/08f8a243-cecf-4ae5-887b-de38ae1f1bed-kube-api-access-dmcqw\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k9nj4\" (UID: \"08f8a243-cecf-4ae5-887b-de38ae1f1bed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:54.181771 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.181754 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08f8a243-cecf-4ae5-887b-de38ae1f1bed-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k9nj4\" (UID: \"08f8a243-cecf-4ae5-887b-de38ae1f1bed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:54.215028 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.214950 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:54.287722 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.287692 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx"] Jul 02 00:26:54.358932 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:54.358807 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4"] Jul 02 00:26:54.361295 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:26:54.361260 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08f8a243_cecf_4ae5_887b_de38ae1f1bed.slice/crio-a57d47af9b3483f3feb500793d119643c6fd99601063d19660b385c9e2d0d9d5 WatchSource:0}: Error finding container a57d47af9b3483f3feb500793d119643c6fd99601063d19660b385c9e2d0d9d5: Status 404 returned error can't find the container with id a57d47af9b3483f3feb500793d119643c6fd99601063d19660b385c9e2d0d9d5 Jul 02 00:26:55.183488 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:55.183451 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" event={"ID":"08f8a243-cecf-4ae5-887b-de38ae1f1bed","Type":"ContainerStarted","Data":"a57d47af9b3483f3feb500793d119643c6fd99601063d19660b385c9e2d0d9d5"} Jul 02 00:26:55.184588 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:55.184556 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" event={"ID":"ff4ba787-f6da-4a44-82e7-1c6534bbc79e","Type":"ContainerStarted","Data":"ffd51fdaffc7164b7b4a83ec13398b30f1d6a669ac7b7f2182d93c3f6d35749c"} Jul 02 00:26:55.185143 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:55.185121 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:57.278644 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:57.278565 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 00:26:57.278982 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:57.278657 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 00:26:57.278982 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:57.278702 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 00:26:57.798807 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:57.798770 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:57.905113 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:57.905084 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zjfxv"] Jul 02 00:26:57.908500 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:57.908470 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zjfxv" Jul 02 00:26:57.909747 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:57.909722 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:57.910997 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:57.910979 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 02 00:26:57.911100 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:57.911083 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-ds6j8\"" Jul 02 00:26:57.913706 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:57.913686 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-vrxsm"] Jul 02 00:26:57.916972 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:57.916950 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vrxsm" Jul 02 00:26:57.919748 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:57.919727 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-kfwkj\"" Jul 02 00:26:57.919899 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:57.919874 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 02 00:26:57.920017 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:57.919997 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zjfxv"] Jul 02 00:26:57.929569 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:57.929535 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-vrxsm"] Jul 02 00:26:58.013478 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:58.008618 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qgfg\" (UniqueName: \"kubernetes.io/projected/ef9956de-47b1-437d-85e7-c7925f04c86f-kube-api-access-7qgfg\") pod \"kserve-controller-manager-d6f4b65b8-zjfxv\" (UID: \"ef9956de-47b1-437d-85e7-c7925f04c86f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zjfxv" Jul 02 00:26:58.013478 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:58.008771 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef9956de-47b1-437d-85e7-c7925f04c86f-cert\") pod \"kserve-controller-manager-d6f4b65b8-zjfxv\" (UID: \"ef9956de-47b1-437d-85e7-c7925f04c86f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zjfxv" Jul 02 00:26:58.067549 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:58.067479 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:58.110012 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:58.109984 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqf76\" (UniqueName: \"kubernetes.io/projected/960b9c81-3996-482b-9d0d-5b9a7d6c7870-kube-api-access-tqf76\") pod \"llmisvc-controller-manager-777c6bd7d5-vrxsm\" (UID: \"960b9c81-3996-482b-9d0d-5b9a7d6c7870\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vrxsm" Jul 02 00:26:58.110134 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:58.110045 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/960b9c81-3996-482b-9d0d-5b9a7d6c7870-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-vrxsm\" (UID: \"960b9c81-3996-482b-9d0d-5b9a7d6c7870\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vrxsm" Jul 02 00:26:58.110134 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:58.110092 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qgfg\" (UniqueName: \"kubernetes.io/projected/ef9956de-47b1-437d-85e7-c7925f04c86f-kube-api-access-7qgfg\") pod \"kserve-controller-manager-d6f4b65b8-zjfxv\" (UID: \"ef9956de-47b1-437d-85e7-c7925f04c86f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zjfxv" Jul 02 00:26:58.110210 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:58.110151 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef9956de-47b1-437d-85e7-c7925f04c86f-cert\") pod \"kserve-controller-manager-d6f4b65b8-zjfxv\" (UID: \"ef9956de-47b1-437d-85e7-c7925f04c86f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zjfxv" Jul 02 00:26:58.110264 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:26:58.110252 2581 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 02 00:26:58.110323 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:26:58.110314 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef9956de-47b1-437d-85e7-c7925f04c86f-cert podName:ef9956de-47b1-437d-85e7-c7925f04c86f nodeName:}" failed. No retries permitted until 2026-07-02 00:26:58.610300313 +0000 UTC m=+572.025737959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ef9956de-47b1-437d-85e7-c7925f04c86f-cert") pod "kserve-controller-manager-d6f4b65b8-zjfxv" (UID: "ef9956de-47b1-437d-85e7-c7925f04c86f") : secret "kserve-webhook-server-cert" not found Jul 02 00:26:58.120234 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:58.120207 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qgfg\" (UniqueName: \"kubernetes.io/projected/ef9956de-47b1-437d-85e7-c7925f04c86f-kube-api-access-7qgfg\") pod \"kserve-controller-manager-d6f4b65b8-zjfxv\" (UID: \"ef9956de-47b1-437d-85e7-c7925f04c86f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zjfxv" Jul 02 00:26:58.201677 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:58.201640 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" event={"ID":"08f8a243-cecf-4ae5-887b-de38ae1f1bed","Type":"ContainerStarted","Data":"ada0a4ada38995d7fb5a5b4a82a82b412741cce514385c7501e3362b73999ab9"} Jul 02 00:26:58.211446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:58.211400 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqf76\" (UniqueName: \"kubernetes.io/projected/960b9c81-3996-482b-9d0d-5b9a7d6c7870-kube-api-access-tqf76\") pod \"llmisvc-controller-manager-777c6bd7d5-vrxsm\" (UID: \"960b9c81-3996-482b-9d0d-5b9a7d6c7870\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vrxsm" Jul 02 00:26:58.211573 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:58.211480 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/960b9c81-3996-482b-9d0d-5b9a7d6c7870-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-vrxsm\" (UID: \"960b9c81-3996-482b-9d0d-5b9a7d6c7870\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vrxsm" Jul 02 00:26:58.213746 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:58.213724 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/960b9c81-3996-482b-9d0d-5b9a7d6c7870-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-vrxsm\" (UID: \"960b9c81-3996-482b-9d0d-5b9a7d6c7870\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vrxsm" Jul 02 00:26:58.215651 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:58.215631 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:58.220297 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:58.220278 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:58.230642 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:58.230623 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqf76\" (UniqueName: \"kubernetes.io/projected/960b9c81-3996-482b-9d0d-5b9a7d6c7870-kube-api-access-tqf76\") pod \"llmisvc-controller-manager-777c6bd7d5-vrxsm\" (UID: \"960b9c81-3996-482b-9d0d-5b9a7d6c7870\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vrxsm" Jul 02 00:26:58.236448 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:58.236379 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" podStartSLOduration=2.3213898889999998 podStartE2EDuration="5.236360829s" totalImagesPullingTime="2.91497094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:26:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:26:58.234463163 +0000 UTC m=+571.649900830" watchObservedRunningTime="2026-07-02 00:26:58.236360829 +0000 UTC m=+571.651798507" Jul 02 00:26:58.338991 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:58.338877 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:58.529137 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:58.529112 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vrxsm" Jul 02 00:26:58.614982 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:58.614956 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef9956de-47b1-437d-85e7-c7925f04c86f-cert\") pod \"kserve-controller-manager-d6f4b65b8-zjfxv\" (UID: \"ef9956de-47b1-437d-85e7-c7925f04c86f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zjfxv" Jul 02 00:26:58.617407 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:58.617374 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef9956de-47b1-437d-85e7-c7925f04c86f-cert\") pod \"kserve-controller-manager-d6f4b65b8-zjfxv\" (UID: \"ef9956de-47b1-437d-85e7-c7925f04c86f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zjfxv" Jul 02 00:26:58.820028 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:58.819980 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zjfxv" Jul 02 00:26:58.880158 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:58.879926 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-vrxsm"] Jul 02 00:26:58.883289 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:26:58.883253 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod960b9c81_3996_482b_9d0d_5b9a7d6c7870.slice/crio-9e6336b1d6cf65e5a60d961bd4e115eda4f08beb221a1a5111e8d29c2e438e7a WatchSource:0}: Error finding container 9e6336b1d6cf65e5a60d961bd4e115eda4f08beb221a1a5111e8d29c2e438e7a: Status 404 returned error can't find the container with id 9e6336b1d6cf65e5a60d961bd4e115eda4f08beb221a1a5111e8d29c2e438e7a Jul 02 00:26:58.964557 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:58.964536 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zjfxv"] Jul 02 00:26:58.966754 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:26:58.966716 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef9956de_47b1_437d_85e7_c7925f04c86f.slice/crio-ee878c8dcad5718102c204edb99a3ce9834f074117017929d56f5fa06f8715ad WatchSource:0}: Error finding container ee878c8dcad5718102c204edb99a3ce9834f074117017929d56f5fa06f8715ad: Status 404 returned error can't find the container with id ee878c8dcad5718102c204edb99a3ce9834f074117017929d56f5fa06f8715ad Jul 02 00:26:59.051602 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:59.051558 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 00:26:59.051699 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:59.051648 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 00:26:59.051699 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:59.051677 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 00:26:59.119905 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:59.119874 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:59.207508 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:59.207399 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zjfxv" event={"ID":"ef9956de-47b1-437d-85e7-c7925f04c86f","Type":"ContainerStarted","Data":"ee878c8dcad5718102c204edb99a3ce9834f074117017929d56f5fa06f8715ad"} Jul 02 00:26:59.208597 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:59.208569 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vrxsm" event={"ID":"960b9c81-3996-482b-9d0d-5b9a7d6c7870","Type":"ContainerStarted","Data":"9e6336b1d6cf65e5a60d961bd4e115eda4f08beb221a1a5111e8d29c2e438e7a"} Jul 02 00:26:59.210094 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:59.210072 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" event={"ID":"ff4ba787-f6da-4a44-82e7-1c6534bbc79e","Type":"ContainerStarted","Data":"9ec524a252500a552658717ce6a2b155fa68e9e7b79380f24e0fbe0f97fb2219"} Jul 02 00:26:59.210348 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:59.210316 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:59.211316 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:59.211299 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k9nj4" Jul 02 00:26:59.224163 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:59.224142 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:26:59.249446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:59.249380 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" podStartSLOduration=1.4938053 podStartE2EDuration="6.249363702s" totalImagesPullingTime="4.755558402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:26:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:26:59.246661641 +0000 UTC m=+572.662099307" watchObservedRunningTime="2026-07-02 00:26:59.249363702 +0000 UTC m=+572.664801369" Jul 02 00:26:59.342232 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:59.342200 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx"] Jul 02 00:26:59.380852 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:26:59.380825 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:27:00.148150 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:00.148116 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:27:00.149733 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:00.149708 2581 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" start-of-body= Jul 02 00:27:00.149856 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:00.149758 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" podUID="ff4ba787-f6da-4a44-82e7-1c6534bbc79e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" Jul 02 00:27:01.146525 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:01.146490 2581 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" start-of-body= Jul 02 00:27:01.146989 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:01.146550 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" podUID="ff4ba787-f6da-4a44-82e7-1c6534bbc79e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" Jul 02 00:27:01.219743 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:01.219700 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" podUID="ff4ba787-f6da-4a44-82e7-1c6534bbc79e" containerName="istio-proxy" containerID="cri-o://9ec524a252500a552658717ce6a2b155fa68e9e7b79380f24e0fbe0f97fb2219" gracePeriod=30 Jul 02 00:27:03.232673 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:03.232537 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vrxsm" event={"ID":"960b9c81-3996-482b-9d0d-5b9a7d6c7870","Type":"ContainerStarted","Data":"eca1b557ecd61dec187c781c3c2a8a56c57251226e3a3775616f72b823072c6e"} Jul 02 00:27:03.232673 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:03.232613 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vrxsm" Jul 02 00:27:03.234170 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:03.234147 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zjfxv" event={"ID":"ef9956de-47b1-437d-85e7-c7925f04c86f","Type":"ContainerStarted","Data":"230b5c44f3d36e042d2a3e966fe3e8ed003c0978ed22962d2e6e80f6d713f76c"} Jul 02 00:27:03.234284 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:03.234272 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zjfxv" Jul 02 00:27:03.273288 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:03.273228 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vrxsm" podStartSLOduration=2.194004279 podStartE2EDuration="6.273212143s" totalImagesPullingTime="4.079207864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:26:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:27:03.271735428 +0000 UTC m=+576.687173097" watchObservedRunningTime="2026-07-02 00:27:03.273212143 +0000 UTC m=+576.688649788" Jul 02 00:27:03.310792 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:03.310733 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zjfxv" podStartSLOduration=2.310423983 podStartE2EDuration="6.310712238s" totalImagesPullingTime="4.000288255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:26:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:27:03.31030645 +0000 UTC m=+576.725744123" watchObservedRunningTime="2026-07-02 00:27:03.310712238 +0000 UTC m=+576.726149907" Jul 02 00:27:06.478287 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:06.478264 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:27:06.591197 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:06.591168 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-istiod-ca-cert\") pod \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " Jul 02 00:27:06.591197 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:06.591201 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-istio-data\") pod \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " Jul 02 00:27:06.591445 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:06.591220 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-istio-token\") pod \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " Jul 02 00:27:06.591445 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:06.591262 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdx4x\" (UniqueName: \"kubernetes.io/projected/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-kube-api-access-rdx4x\") pod \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " Jul 02 00:27:06.591445 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:06.591291 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-istio-podinfo\") pod \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " Jul 02 00:27:06.591445 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:06.591313 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-workload-socket\") pod \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " Jul 02 00:27:06.591445 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:06.591344 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-workload-certs\") pod \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " Jul 02 00:27:06.591445 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:06.591370 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-istio-envoy\") pod \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " Jul 02 00:27:06.591445 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:06.591408 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-credential-socket\") pod \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\" (UID: \"ff4ba787-f6da-4a44-82e7-1c6534bbc79e\") " Jul 02 00:27:06.591799 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:06.591499 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-istio-data" (OuterVolumeSpecName: "istio-data") pod "ff4ba787-f6da-4a44-82e7-1c6534bbc79e" (UID: "ff4ba787-f6da-4a44-82e7-1c6534bbc79e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 00:27:06.591799 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:06.591632 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ff4ba787-f6da-4a44-82e7-1c6534bbc79e" (UID: "ff4ba787-f6da-4a44-82e7-1c6534bbc79e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 00:27:06.591799 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:06.591677 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ff4ba787-f6da-4a44-82e7-1c6534bbc79e" (UID: "ff4ba787-f6da-4a44-82e7-1c6534bbc79e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 00:27:06.591799 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:06.591739 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-workload-socket\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:27:06.591799 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:06.591758 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-istio-data\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:27:06.592011 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:06.591818 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ff4ba787-f6da-4a44-82e7-1c6534bbc79e" (UID: "ff4ba787-f6da-4a44-82e7-1c6534bbc79e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 00:27:06.592011 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:06.591844 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ff4ba787-f6da-4a44-82e7-1c6534bbc79e" (UID: "ff4ba787-f6da-4a44-82e7-1c6534bbc79e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 00:27:06.593876 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:06.593821 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ff4ba787-f6da-4a44-82e7-1c6534bbc79e" (UID: "ff4ba787-f6da-4a44-82e7-1c6534bbc79e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 00:27:06.593876 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:06.593839 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-kube-api-access-rdx4x" (OuterVolumeSpecName: "kube-api-access-rdx4x") pod "ff4ba787-f6da-4a44-82e7-1c6534bbc79e" (UID: "ff4ba787-f6da-4a44-82e7-1c6534bbc79e"). InnerVolumeSpecName "kube-api-access-rdx4x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 00:27:06.594045 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:06.593903 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-istio-token" (OuterVolumeSpecName: "istio-token") pod "ff4ba787-f6da-4a44-82e7-1c6534bbc79e" (UID: "ff4ba787-f6da-4a44-82e7-1c6534bbc79e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 00:27:06.594045 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:06.593902 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ff4ba787-f6da-4a44-82e7-1c6534bbc79e" (UID: "ff4ba787-f6da-4a44-82e7-1c6534bbc79e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 00:27:06.693046 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:06.693016 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-workload-certs\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:27:06.693046 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:06.693043 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-istio-envoy\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:27:06.693240 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:06.693065 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-credential-socket\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:27:06.693240 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:06.693074 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-istiod-ca-cert\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:27:06.693240 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:06.693083 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-istio-token\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:27:06.693240 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:06.693091 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdx4x\" (UniqueName: \"kubernetes.io/projected/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-kube-api-access-rdx4x\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:27:06.693240 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:06.693099 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff4ba787-f6da-4a44-82e7-1c6534bbc79e-istio-podinfo\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:27:06.850668 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:06.850592 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:27:07.252917 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:07.252886 2581 generic.go:356] "Generic (PLEG): container finished" podID="ff4ba787-f6da-4a44-82e7-1c6534bbc79e" containerID="9ec524a252500a552658717ce6a2b155fa68e9e7b79380f24e0fbe0f97fb2219" exitCode=0 Jul 02 00:27:07.252917 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:07.252927 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" event={"ID":"ff4ba787-f6da-4a44-82e7-1c6534bbc79e","Type":"ContainerDied","Data":"9ec524a252500a552658717ce6a2b155fa68e9e7b79380f24e0fbe0f97fb2219"} Jul 02 00:27:07.253098 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:07.252934 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" Jul 02 00:27:07.253098 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:07.252966 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx" event={"ID":"ff4ba787-f6da-4a44-82e7-1c6534bbc79e","Type":"ContainerDied","Data":"ffd51fdaffc7164b7b4a83ec13398b30f1d6a669ac7b7f2182d93c3f6d35749c"} Jul 02 00:27:07.253098 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:07.252987 2581 scope.go:117] "RemoveContainer" containerID="9ec524a252500a552658717ce6a2b155fa68e9e7b79380f24e0fbe0f97fb2219" Jul 02 00:27:07.261688 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:07.261671 2581 scope.go:117] "RemoveContainer" containerID="9ec524a252500a552658717ce6a2b155fa68e9e7b79380f24e0fbe0f97fb2219" Jul 02 00:27:07.261964 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:27:07.261944 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ec524a252500a552658717ce6a2b155fa68e9e7b79380f24e0fbe0f97fb2219\": container with ID starting with 9ec524a252500a552658717ce6a2b155fa68e9e7b79380f24e0fbe0f97fb2219 not found: ID does not exist" containerID="9ec524a252500a552658717ce6a2b155fa68e9e7b79380f24e0fbe0f97fb2219" Jul 02 00:27:07.262020 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:07.261974 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ec524a252500a552658717ce6a2b155fa68e9e7b79380f24e0fbe0f97fb2219"} err="failed to get container status \"9ec524a252500a552658717ce6a2b155fa68e9e7b79380f24e0fbe0f97fb2219\": rpc error: code = NotFound desc = could not find container \"9ec524a252500a552658717ce6a2b155fa68e9e7b79380f24e0fbe0f97fb2219\": container with ID starting with 9ec524a252500a552658717ce6a2b155fa68e9e7b79380f24e0fbe0f97fb2219 not found: ID does not exist" Jul 02 00:27:07.269690 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:07.269669 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx"] Jul 02 00:27:07.273880 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:07.273861 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-wxrdx"] Jul 02 00:27:08.698675 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:08.698639 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:27:08.799221 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:08.799188 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:27:09.066665 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:09.066636 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff4ba787-f6da-4a44-82e7-1c6534bbc79e" path="/var/lib/kubelet/pods/ff4ba787-f6da-4a44-82e7-1c6534bbc79e/volumes" Jul 02 00:27:27.050771 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:27.050745 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55kgg_3ea67bc7-0faa-4fa0-904c-adfea68a4992/ovn-acl-logging/0.log" Jul 02 00:27:27.051288 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:27.051123 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55kgg_3ea67bc7-0faa-4fa0-904c-adfea68a4992/ovn-acl-logging/0.log" Jul 02 00:27:34.241340 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:34.241304 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vrxsm" Jul 02 00:27:34.245060 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:34.244234 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zjfxv" Jul 02 00:27:38.395658 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:38.395606 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:27:47.316557 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:47.316516 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:27:47.457231 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:47.457189 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:27:47.539844 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:47.539816 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:27:49.510022 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:49.509952 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:27:59.790016 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:27:59.789980 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:02.359303 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:02.359260 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:02.500369 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:02.500337 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:02.605803 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:02.601255 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:03.103896 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:03.103854 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:03.204487 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:03.204449 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:13.780617 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:13.780546 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:13.884205 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:13.884179 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:13.985667 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:13.985640 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:15.765977 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:15.765943 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:16.366892 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:16.366850 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:20.829337 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:20.829303 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:23.021385 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:23.021353 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:25.690252 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:25.690221 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:25.992059 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:25.991978 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:27.808264 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:27.808225 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-lzkdk"] Jul 02 00:28:27.808635 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:27.808562 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff4ba787-f6da-4a44-82e7-1c6534bbc79e" containerName="istio-proxy" Jul 02 00:28:27.808635 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:27.808574 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff4ba787-f6da-4a44-82e7-1c6534bbc79e" containerName="istio-proxy" Jul 02 00:28:27.808706 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:27.808642 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff4ba787-f6da-4a44-82e7-1c6534bbc79e" containerName="istio-proxy" Jul 02 00:28:27.811697 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:27.811679 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lzkdk" Jul 02 00:28:27.814466 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:27.814447 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 00:28:27.815340 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:27.815310 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-dpcfn\"" Jul 02 00:28:27.815399 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:27.815346 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 02 00:28:27.815399 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:27.815367 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 00:28:27.825312 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:27.825291 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-lzkdk"] Jul 02 00:28:27.951572 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:27.951536 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t96sg\" (UniqueName: \"kubernetes.io/projected/c3f93978-ad5c-43ab-b3af-665c305ce400-kube-api-access-t96sg\") pod \"dns-operator-controller-manager-864dd78c4c-lzkdk\" (UID: \"c3f93978-ad5c-43ab-b3af-665c305ce400\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lzkdk" Jul 02 00:28:28.052848 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:28.052817 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t96sg\" (UniqueName: \"kubernetes.io/projected/c3f93978-ad5c-43ab-b3af-665c305ce400-kube-api-access-t96sg\") pod \"dns-operator-controller-manager-864dd78c4c-lzkdk\" (UID: \"c3f93978-ad5c-43ab-b3af-665c305ce400\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lzkdk" Jul 02 00:28:28.065893 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:28.065839 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t96sg\" (UniqueName: \"kubernetes.io/projected/c3f93978-ad5c-43ab-b3af-665c305ce400-kube-api-access-t96sg\") pod \"dns-operator-controller-manager-864dd78c4c-lzkdk\" (UID: \"c3f93978-ad5c-43ab-b3af-665c305ce400\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lzkdk" Jul 02 00:28:28.128742 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:28.128710 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lzkdk" Jul 02 00:28:28.280114 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:28.280082 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-lzkdk"] Jul 02 00:28:28.283727 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:28:28.283704 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3f93978_ad5c_43ab_b3af_665c305ce400.slice/crio-47a8e6dc5d6cc25afd1ed806a07a553a157f658cee8bd04f4bef59fd6ef04c7b WatchSource:0}: Error finding container 47a8e6dc5d6cc25afd1ed806a07a553a157f658cee8bd04f4bef59fd6ef04c7b: Status 404 returned error can't find the container with id 47a8e6dc5d6cc25afd1ed806a07a553a157f658cee8bd04f4bef59fd6ef04c7b Jul 02 00:28:28.286310 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:28.286294 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 00:28:28.427676 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:28.427599 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:28.618385 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:28.618349 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lzkdk" event={"ID":"c3f93978-ad5c-43ab-b3af-665c305ce400","Type":"ContainerStarted","Data":"47a8e6dc5d6cc25afd1ed806a07a553a157f658cee8bd04f4bef59fd6ef04c7b"} Jul 02 00:28:29.029833 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:29.029788 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:30.208020 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:30.207980 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fpj8x"] Jul 02 00:28:30.211818 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:30.211791 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fpj8x" Jul 02 00:28:30.214427 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:30.214383 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-95fcw\"" Jul 02 00:28:30.222007 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:30.221963 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fpj8x"] Jul 02 00:28:30.274097 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:30.274066 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzr5n\" (UniqueName: \"kubernetes.io/projected/c9784289-9f6d-4d07-a275-754ef1d6b9e1-kube-api-access-bzr5n\") pod \"limitador-operator-controller-manager-859d7b78bd-fpj8x\" (UID: \"c9784289-9f6d-4d07-a275-754ef1d6b9e1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fpj8x" Jul 02 00:28:30.375484 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:30.375450 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzr5n\" (UniqueName: \"kubernetes.io/projected/c9784289-9f6d-4d07-a275-754ef1d6b9e1-kube-api-access-bzr5n\") pod \"limitador-operator-controller-manager-859d7b78bd-fpj8x\" (UID: \"c9784289-9f6d-4d07-a275-754ef1d6b9e1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fpj8x" Jul 02 00:28:30.384304 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:30.384270 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzr5n\" (UniqueName: \"kubernetes.io/projected/c9784289-9f6d-4d07-a275-754ef1d6b9e1-kube-api-access-bzr5n\") pod \"limitador-operator-controller-manager-859d7b78bd-fpj8x\" (UID: \"c9784289-9f6d-4d07-a275-754ef1d6b9e1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fpj8x" Jul 02 00:28:30.524916 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:30.524898 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fpj8x" Jul 02 00:28:30.630571 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:30.630537 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lzkdk" event={"ID":"c3f93978-ad5c-43ab-b3af-665c305ce400","Type":"ContainerStarted","Data":"f80f8a3fcc48a1b564dfc0f530e9bd93a96324b60f742723f5d16cd51f6ba09a"} Jul 02 00:28:30.630695 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:30.630646 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lzkdk" Jul 02 00:28:30.648739 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:30.648694 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lzkdk" podStartSLOduration=1.42093919 podStartE2EDuration="3.648677213s" totalImagesPullingTime="2.227738023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:28:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:28:30.647361429 +0000 UTC m=+664.062799136" watchObservedRunningTime="2026-07-02 00:28:30.648677213 +0000 UTC m=+664.064114879" Jul 02 00:28:30.661140 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:30.661117 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fpj8x"] Jul 02 00:28:30.663536 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:28:30.663512 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9784289_9f6d_4d07_a275_754ef1d6b9e1.slice/crio-abe303bec8b491b2087ed67acb922c5c59d0d1dc7f3c2f55d845067bb7b7dcbd WatchSource:0}: Error finding container abe303bec8b491b2087ed67acb922c5c59d0d1dc7f3c2f55d845067bb7b7dcbd: Status 404 returned error can't find the container with id abe303bec8b491b2087ed67acb922c5c59d0d1dc7f3c2f55d845067bb7b7dcbd Jul 02 00:28:31.535788 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:31.535752 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:31.637985 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:31.637950 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fpj8x" event={"ID":"c9784289-9f6d-4d07-a275-754ef1d6b9e1","Type":"ContainerStarted","Data":"abe303bec8b491b2087ed67acb922c5c59d0d1dc7f3c2f55d845067bb7b7dcbd"} Jul 02 00:28:32.175345 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:32.175308 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:32.275941 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:32.275912 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:32.581012 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:32.580984 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:32.681230 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:32.681195 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:33.652258 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:33.652218 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fpj8x" event={"ID":"c9784289-9f6d-4d07-a275-754ef1d6b9e1","Type":"ContainerStarted","Data":"06862b7f3af10cafcaf16cd6e446cc92140ca68701c8f62598c1bced1d4fb369"} Jul 02 00:28:33.652677 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:33.652337 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fpj8x" Jul 02 00:28:33.669198 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:33.669155 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fpj8x" podStartSLOduration=1.5143739649999999 podStartE2EDuration="3.66914036s" totalImagesPullingTime="2.154766395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:28:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:28:33.667139843 +0000 UTC m=+667.082584051" watchObservedRunningTime="2026-07-02 00:28:33.66914036 +0000 UTC m=+667.084578026" Jul 02 00:28:34.747962 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:34.747927 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:35.242693 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:35.242618 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:35.973750 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:35.973723 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:36.031352 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:36.031316 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:41.640201 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:41.640169 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lzkdk" Jul 02 00:28:42.009720 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:42.009692 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:42.121251 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:42.121222 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:43.788073 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:43.788036 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:43.888663 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:43.888628 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:44.659573 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:44.659546 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fpj8x" Jul 02 00:28:45.465644 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:45.465614 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fpj8x"] Jul 02 00:28:45.466207 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:45.465791 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fpj8x" podUID="c9784289-9f6d-4d07-a275-754ef1d6b9e1" containerName="manager" containerID="cri-o://06862b7f3af10cafcaf16cd6e446cc92140ca68701c8f62598c1bced1d4fb369" gracePeriod=2 Jul 02 00:28:45.477643 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:45.477615 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fpj8x"] Jul 02 00:28:45.483143 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:28:45.483107 2581 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"c9784289-9f6d-4d07-a275-754ef1d6b9e1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-fpj8x\": pods \"limitador-operator-controller-manager-859d7b78bd-fpj8x\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fpj8x" Jul 02 00:28:45.493559 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:45.493538 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kp2b"] Jul 02 00:28:45.493875 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:45.493864 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9784289-9f6d-4d07-a275-754ef1d6b9e1" containerName="manager" Jul 02 00:28:45.493921 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:45.493877 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9784289-9f6d-4d07-a275-754ef1d6b9e1" containerName="manager" Jul 02 00:28:45.493956 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:45.493939 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9784289-9f6d-4d07-a275-754ef1d6b9e1" containerName="manager" Jul 02 00:28:45.496915 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:45.496893 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kp2b" Jul 02 00:28:45.503694 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:28:45.503671 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fpj8x\" is forbidden: User \"system:node:ip-10-0-130-30.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-30.ec2.internal' and this object" podUID="c9784289-9f6d-4d07-a275-754ef1d6b9e1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fpj8x" Jul 02 00:28:45.514490 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:45.514467 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kp2b"] Jul 02 00:28:45.607693 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:45.607660 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzjwt\" (UniqueName: \"kubernetes.io/projected/fa04dd83-c602-428c-9b15-1a839e55cd78-kube-api-access-rzjwt\") pod \"limitador-operator-controller-manager-859d7b78bd-9kp2b\" (UID: \"fa04dd83-c602-428c-9b15-1a839e55cd78\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kp2b" Jul 02 00:28:45.705033 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:45.705008 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fpj8x" Jul 02 00:28:45.707307 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:28:45.707280 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fpj8x\" is forbidden: User \"system:node:ip-10-0-130-30.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-30.ec2.internal' and this object" podUID="c9784289-9f6d-4d07-a275-754ef1d6b9e1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fpj8x" Jul 02 00:28:45.708253 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:45.708234 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzjwt\" (UniqueName: \"kubernetes.io/projected/fa04dd83-c602-428c-9b15-1a839e55cd78-kube-api-access-rzjwt\") pod \"limitador-operator-controller-manager-859d7b78bd-9kp2b\" (UID: \"fa04dd83-c602-428c-9b15-1a839e55cd78\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kp2b" Jul 02 00:28:45.708789 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:45.708765 2581 generic.go:356] "Generic (PLEG): container finished" podID="c9784289-9f6d-4d07-a275-754ef1d6b9e1" containerID="06862b7f3af10cafcaf16cd6e446cc92140ca68701c8f62598c1bced1d4fb369" exitCode=0 Jul 02 00:28:45.708862 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:45.708804 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fpj8x" Jul 02 00:28:45.708862 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:45.708854 2581 scope.go:117] "RemoveContainer" containerID="06862b7f3af10cafcaf16cd6e446cc92140ca68701c8f62598c1bced1d4fb369" Jul 02 00:28:45.711016 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:28:45.710994 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fpj8x\" is forbidden: User \"system:node:ip-10-0-130-30.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-30.ec2.internal' and this object" podUID="c9784289-9f6d-4d07-a275-754ef1d6b9e1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fpj8x" Jul 02 00:28:45.716568 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:45.716549 2581 scope.go:117] "RemoveContainer" containerID="06862b7f3af10cafcaf16cd6e446cc92140ca68701c8f62598c1bced1d4fb369" Jul 02 00:28:45.716841 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:28:45.716824 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06862b7f3af10cafcaf16cd6e446cc92140ca68701c8f62598c1bced1d4fb369\": container with ID starting with 06862b7f3af10cafcaf16cd6e446cc92140ca68701c8f62598c1bced1d4fb369 not found: ID does not exist" containerID="06862b7f3af10cafcaf16cd6e446cc92140ca68701c8f62598c1bced1d4fb369" Jul 02 00:28:45.716912 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:45.716850 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06862b7f3af10cafcaf16cd6e446cc92140ca68701c8f62598c1bced1d4fb369"} err="failed to get container status \"06862b7f3af10cafcaf16cd6e446cc92140ca68701c8f62598c1bced1d4fb369\": rpc error: code = NotFound desc = could not find container \"06862b7f3af10cafcaf16cd6e446cc92140ca68701c8f62598c1bced1d4fb369\": container with ID starting with 06862b7f3af10cafcaf16cd6e446cc92140ca68701c8f62598c1bced1d4fb369 not found: ID does not exist" Jul 02 00:28:45.717845 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:45.717827 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzjwt\" (UniqueName: \"kubernetes.io/projected/fa04dd83-c602-428c-9b15-1a839e55cd78-kube-api-access-rzjwt\") pod \"limitador-operator-controller-manager-859d7b78bd-9kp2b\" (UID: \"fa04dd83-c602-428c-9b15-1a839e55cd78\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kp2b" Jul 02 00:28:45.809182 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:45.809157 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzr5n\" (UniqueName: \"kubernetes.io/projected/c9784289-9f6d-4d07-a275-754ef1d6b9e1-kube-api-access-bzr5n\") pod \"c9784289-9f6d-4d07-a275-754ef1d6b9e1\" (UID: \"c9784289-9f6d-4d07-a275-754ef1d6b9e1\") " Jul 02 00:28:45.811148 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:45.811125 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9784289-9f6d-4d07-a275-754ef1d6b9e1-kube-api-access-bzr5n" (OuterVolumeSpecName: "kube-api-access-bzr5n") pod "c9784289-9f6d-4d07-a275-754ef1d6b9e1" (UID: "c9784289-9f6d-4d07-a275-754ef1d6b9e1"). InnerVolumeSpecName "kube-api-access-bzr5n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 00:28:45.851754 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:45.851723 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kp2b" Jul 02 00:28:45.910555 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:45.910530 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzr5n\" (UniqueName: \"kubernetes.io/projected/c9784289-9f6d-4d07-a275-754ef1d6b9e1-kube-api-access-bzr5n\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:28:45.977009 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:45.976987 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kp2b"] Jul 02 00:28:45.978766 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:28:45.978731 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa04dd83_c602_428c_9b15_1a839e55cd78.slice/crio-5f86a9e1317398f8b7cc58007cd3a0d71c9abbcbf54cafd3797ec99bd914c560 WatchSource:0}: Error finding container 5f86a9e1317398f8b7cc58007cd3a0d71c9abbcbf54cafd3797ec99bd914c560: Status 404 returned error can't find the container with id 5f86a9e1317398f8b7cc58007cd3a0d71c9abbcbf54cafd3797ec99bd914c560 Jul 02 00:28:46.021140 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:28:46.021113 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fpj8x\" is forbidden: User \"system:node:ip-10-0-130-30.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-30.ec2.internal' and this object" podUID="c9784289-9f6d-4d07-a275-754ef1d6b9e1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fpj8x" Jul 02 00:28:46.715764 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:46.715726 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kp2b" event={"ID":"fa04dd83-c602-428c-9b15-1a839e55cd78","Type":"ContainerStarted","Data":"d7366cc87c164ec3cc305a62b4fddf4782135be508c9698a191574af7fd496f5"} Jul 02 00:28:46.716214 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:46.715781 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kp2b" event={"ID":"fa04dd83-c602-428c-9b15-1a839e55cd78","Type":"ContainerStarted","Data":"5f86a9e1317398f8b7cc58007cd3a0d71c9abbcbf54cafd3797ec99bd914c560"} Jul 02 00:28:46.716214 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:46.715848 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kp2b" Jul 02 00:28:46.734802 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:46.734743 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kp2b" podStartSLOduration=1.734724005 podStartE2EDuration="1.734724005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:28:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:28:46.734175708 +0000 UTC m=+680.149613378" watchObservedRunningTime="2026-07-02 00:28:46.734724005 +0000 UTC m=+680.150161674" Jul 02 00:28:46.736305 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:28:46.736279 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fpj8x\" is forbidden: User \"system:node:ip-10-0-130-30.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-30.ec2.internal' and this object" podUID="c9784289-9f6d-4d07-a275-754ef1d6b9e1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fpj8x" Jul 02 00:28:47.065504 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:28:47.065456 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fpj8x\" is forbidden: User \"system:node:ip-10-0-130-30.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-30.ec2.internal' and this object" podUID="c9784289-9f6d-4d07-a275-754ef1d6b9e1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fpj8x" Jul 02 00:28:47.066489 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:47.066472 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9784289-9f6d-4d07-a275-754ef1d6b9e1" path="/var/lib/kubelet/pods/c9784289-9f6d-4d07-a275-754ef1d6b9e1/volumes" Jul 02 00:28:47.614156 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:47.614119 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:47.717358 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:47.716305 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:51.389958 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:51.389924 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:51.449829 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:51.449803 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:51.586929 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:51.586903 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:51.644296 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:51.644225 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:54.124540 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:54.124503 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:54.224604 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:54.224572 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:28:57.724354 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:28:57.724326 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kp2b" Jul 02 00:29:00.636027 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:00.635994 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:29:01.007108 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:01.007076 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:29:05.361562 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:05.361530 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:29:05.975859 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:05.975821 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:29:09.368786 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:09.368758 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:29:09.425144 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:09.425117 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:29:09.987326 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:09.987294 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:29:10.087407 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:10.087374 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:29:13.567349 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:13.567319 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:29:13.668710 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:13.668676 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:29:14.267544 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.267517 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8"] Jul 02 00:29:14.275140 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.275121 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:14.279362 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.279343 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-bzsjg\"" Jul 02 00:29:14.294043 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.294015 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8"] Jul 02 00:29:14.302359 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.302336 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:29:14.346492 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.346463 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-pvgz8\" (UID: \"1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:14.346581 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.346496 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-pvgz8\" (UID: \"1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:14.346581 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.346545 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pvgz8\" (UID: \"1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:14.346581 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.346565 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-pvgz8\" (UID: \"1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:14.346682 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.346583 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgfxt\" (UniqueName: \"kubernetes.io/projected/1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0-kube-api-access-fgfxt\") pod \"maas-default-gateway-openshift-default-56654dcf7-pvgz8\" (UID: \"1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:14.346682 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.346610 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-pvgz8\" (UID: \"1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:14.346749 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.346681 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-pvgz8\" (UID: \"1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:14.346749 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.346720 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-pvgz8\" (UID: \"1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:14.346749 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.346740 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pvgz8\" (UID: \"1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:14.447847 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.447812 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-pvgz8\" (UID: \"1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:14.448035 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.447854 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-pvgz8\" (UID: \"1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:14.448035 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.447873 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-pvgz8\" (UID: \"1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:14.448035 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.447892 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pvgz8\" (UID: \"1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:14.448035 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.447935 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-pvgz8\" (UID: \"1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:14.448035 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.447951 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-pvgz8\" (UID: \"1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:14.448035 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.447986 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pvgz8\" (UID: \"1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:14.448035 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.448008 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-pvgz8\" (UID: \"1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:14.448397 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.448178 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgfxt\" (UniqueName: \"kubernetes.io/projected/1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0-kube-api-access-fgfxt\") pod \"maas-default-gateway-openshift-default-56654dcf7-pvgz8\" (UID: \"1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:14.448397 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.448328 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-pvgz8\" (UID: \"1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:14.448397 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.448370 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-pvgz8\" (UID: \"1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:14.448616 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.448529 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pvgz8\" (UID: \"1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:14.448616 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.448577 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pvgz8\" (UID: \"1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:14.448749 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.448726 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-pvgz8\" (UID: \"1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:14.450182 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.450164 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-pvgz8\" (UID: \"1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:14.450634 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.450613 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-pvgz8\" (UID: \"1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:14.455354 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.455331 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-pvgz8\" (UID: \"1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:14.455608 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.455591 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgfxt\" (UniqueName: \"kubernetes.io/projected/1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0-kube-api-access-fgfxt\") pod \"maas-default-gateway-openshift-default-56654dcf7-pvgz8\" (UID: \"1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:14.536411 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.536343 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:29:14.585345 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.585321 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:14.717261 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.717223 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8"] Jul 02 00:29:14.718695 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:29:14.718667 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d2c57c1_d3f9_4957_bd7b_39b39b6bf4b0.slice/crio-53a1e5936ac0d8369a0bd400ae857349e7ff7e7f5a4b7d19dd644a398262fd81 WatchSource:0}: Error finding container 53a1e5936ac0d8369a0bd400ae857349e7ff7e7f5a4b7d19dd644a398262fd81: Status 404 returned error can't find the container with id 53a1e5936ac0d8369a0bd400ae857349e7ff7e7f5a4b7d19dd644a398262fd81 Jul 02 00:29:14.720804 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.720765 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 00:29:14.720917 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.720844 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 00:29:14.720917 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.720875 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 00:29:14.843644 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.843566 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" event={"ID":"1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0","Type":"ContainerStarted","Data":"30c18fc7c4275d3c8ce0dbd0a33ceaea8b30a404b7fa4ed1142c3e5237b19e8d"} Jul 02 00:29:14.843644 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.843629 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" event={"ID":"1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0","Type":"ContainerStarted","Data":"53a1e5936ac0d8369a0bd400ae857349e7ff7e7f5a4b7d19dd644a398262fd81"} Jul 02 00:29:14.864745 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:14.864686 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" podStartSLOduration=0.864666163 podStartE2EDuration="864.666163ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:29:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:29:14.864471936 +0000 UTC m=+708.279909606" watchObservedRunningTime="2026-07-02 00:29:14.864666163 +0000 UTC m=+708.280103826" Jul 02 00:29:15.585469 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:15.585438 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:15.590164 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:15.590143 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:15.848437 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:15.848326 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:15.849342 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:15.849320 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:29:18.848334 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:18.848234 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:29:19.615407 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:19.615374 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:29:19.715103 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:19.715071 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:29:24.374396 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:24.374369 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:29:24.480441 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:24.480387 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:29:27.933791 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:27.933730 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:29:28.038725 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:28.038690 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:29:28.089378 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:28.089349 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:29:28.757876 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:28.757838 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:29:28.819975 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:28.819934 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:29:28.894571 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:28.894547 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-njtzk"] Jul 02 00:29:28.899016 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:28.898998 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-njtzk" Jul 02 00:29:28.901301 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:28.901282 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-x2z6f\"" Jul 02 00:29:28.909372 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:28.909346 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-njtzk"] Jul 02 00:29:28.981615 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:28.981588 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v85j\" (UniqueName: \"kubernetes.io/projected/6de5e8f5-99a2-4b9f-a398-562a2c98ee67-kube-api-access-8v85j\") pod \"authorino-75d556bd77-njtzk\" (UID: \"6de5e8f5-99a2-4b9f-a398-562a2c98ee67\") " pod="kuadrant-system/authorino-75d556bd77-njtzk" Jul 02 00:29:29.082875 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:29.082810 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v85j\" (UniqueName: \"kubernetes.io/projected/6de5e8f5-99a2-4b9f-a398-562a2c98ee67-kube-api-access-8v85j\") pod \"authorino-75d556bd77-njtzk\" (UID: \"6de5e8f5-99a2-4b9f-a398-562a2c98ee67\") " pod="kuadrant-system/authorino-75d556bd77-njtzk" Jul 02 00:29:29.090010 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:29.089982 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v85j\" (UniqueName: \"kubernetes.io/projected/6de5e8f5-99a2-4b9f-a398-562a2c98ee67-kube-api-access-8v85j\") pod \"authorino-75d556bd77-njtzk\" (UID: \"6de5e8f5-99a2-4b9f-a398-562a2c98ee67\") " pod="kuadrant-system/authorino-75d556bd77-njtzk" Jul 02 00:29:29.214903 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:29.214877 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-njtzk" Jul 02 00:29:29.342543 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:29.342496 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-njtzk"] Jul 02 00:29:29.344808 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:29:29.344778 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6de5e8f5_99a2_4b9f_a398_562a2c98ee67.slice/crio-812cfd667a66ea93f6acc9fe81f34a4ef630894fd5fbef12d6352f491d56eeea WatchSource:0}: Error finding container 812cfd667a66ea93f6acc9fe81f34a4ef630894fd5fbef12d6352f491d56eeea: Status 404 returned error can't find the container with id 812cfd667a66ea93f6acc9fe81f34a4ef630894fd5fbef12d6352f491d56eeea Jul 02 00:29:29.914961 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:29.914927 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-njtzk" event={"ID":"6de5e8f5-99a2-4b9f-a398-562a2c98ee67","Type":"ContainerStarted","Data":"812cfd667a66ea93f6acc9fe81f34a4ef630894fd5fbef12d6352f491d56eeea"} Jul 02 00:29:32.934908 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:32.934820 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-njtzk" event={"ID":"6de5e8f5-99a2-4b9f-a398-562a2c98ee67","Type":"ContainerStarted","Data":"b6a7bd1f0e4c4d463410aac94a0f18e4fa88b8c5910ee3a60b21e656c85d39c7"} Jul 02 00:29:32.949667 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:32.949536 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-njtzk" podStartSLOduration=1.6265761159999998 podStartE2EDuration="4.949516852s" totalImagesPullingTime="3.322940736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:29:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:29:32.948991792 +0000 UTC m=+726.364429459" watchObservedRunningTime="2026-07-02 00:29:32.949516852 +0000 UTC m=+726.364954522" Jul 02 00:29:47.620588 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:29:47.620549 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:30:00.398277 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:00.398242 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:30:00.494057 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:00.494031 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:30:00.651104 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:00.651014 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:30:14.397822 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:14.397791 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:30:30.470116 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:30.470079 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:30:30.569446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:30.569392 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:30:30.879212 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:30.879183 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 00:30:30.882154 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:30.882136 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 00:30:30.884365 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:30.884346 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 02 00:30:30.884606 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:30.884586 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 02 00:30:30.885652 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:30.885632 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-hv4cm\"" Jul 02 00:30:30.885771 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:30.885758 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 02 00:30:30.891629 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:30.891607 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 00:30:31.002225 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:31.002198 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66bbp\" (UniqueName: \"kubernetes.io/projected/edf3ceac-f605-401f-9aa1-a5b61496cf77-kube-api-access-66bbp\") pod \"maas-keycloak-0\" (UID: \"edf3ceac-f605-401f-9aa1-a5b61496cf77\") " pod="keycloak-system/maas-keycloak-0" Jul 02 00:30:31.103661 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:31.103633 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66bbp\" (UniqueName: \"kubernetes.io/projected/edf3ceac-f605-401f-9aa1-a5b61496cf77-kube-api-access-66bbp\") pod \"maas-keycloak-0\" (UID: \"edf3ceac-f605-401f-9aa1-a5b61496cf77\") " pod="keycloak-system/maas-keycloak-0" Jul 02 00:30:31.112296 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:31.112267 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66bbp\" (UniqueName: \"kubernetes.io/projected/edf3ceac-f605-401f-9aa1-a5b61496cf77-kube-api-access-66bbp\") pod \"maas-keycloak-0\" (UID: \"edf3ceac-f605-401f-9aa1-a5b61496cf77\") " pod="keycloak-system/maas-keycloak-0" Jul 02 00:30:31.192556 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:31.192490 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 00:30:31.323106 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:31.323075 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 00:30:31.325337 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:30:31.325312 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedf3ceac_f605_401f_9aa1_a5b61496cf77.slice/crio-98159ed43e2fd1cc8f55797311b5932b3ed510cd2846bddb14e9d87d6187675d WatchSource:0}: Error finding container 98159ed43e2fd1cc8f55797311b5932b3ed510cd2846bddb14e9d87d6187675d: Status 404 returned error can't find the container with id 98159ed43e2fd1cc8f55797311b5932b3ed510cd2846bddb14e9d87d6187675d Jul 02 00:30:32.202147 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:32.202114 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"edf3ceac-f605-401f-9aa1-a5b61496cf77","Type":"ContainerStarted","Data":"98159ed43e2fd1cc8f55797311b5932b3ed510cd2846bddb14e9d87d6187675d"} Jul 02 00:30:38.243825 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:38.243792 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"edf3ceac-f605-401f-9aa1-a5b61496cf77","Type":"ContainerStarted","Data":"82c84845c9ef83aab4aa0c110a54cec17e8a982ebcd9ecae56812b72f8bb399d"} Jul 02 00:30:38.263480 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:38.263403 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.9042206849999999 podStartE2EDuration="8.263389045s" totalImagesPullingTime="6.35916836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:30:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:30:38.261269995 +0000 UTC m=+791.676707655" watchObservedRunningTime="2026-07-02 00:30:38.263389045 +0000 UTC m=+791.678826736" Jul 02 00:30:39.192861 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:39.192823 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 02 00:30:39.194606 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:39.194568 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="edf3ceac-f605-401f-9aa1-a5b61496cf77" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jul 02 00:30:40.193406 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:40.193354 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="edf3ceac-f605-401f-9aa1-a5b61496cf77" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jul 02 00:30:41.193052 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:41.193012 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 02 00:30:41.193435 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:41.193380 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="edf3ceac-f605-401f-9aa1-a5b61496cf77" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jul 02 00:30:42.193294 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:42.193230 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="edf3ceac-f605-401f-9aa1-a5b61496cf77" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jul 02 00:30:43.193810 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:43.193764 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="edf3ceac-f605-401f-9aa1-a5b61496cf77" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jul 02 00:30:44.193325 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:44.193283 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="edf3ceac-f605-401f-9aa1-a5b61496cf77" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jul 02 00:30:45.193928 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:45.193876 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="edf3ceac-f605-401f-9aa1-a5b61496cf77" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jul 02 00:30:46.193226 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:46.193187 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="edf3ceac-f605-401f-9aa1-a5b61496cf77" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jul 02 00:30:47.193830 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:47.193793 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="edf3ceac-f605-401f-9aa1-a5b61496cf77" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jul 02 00:30:48.193833 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:48.193718 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="edf3ceac-f605-401f-9aa1-a5b61496cf77" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jul 02 00:30:49.193514 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:49.193469 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="edf3ceac-f605-401f-9aa1-a5b61496cf77" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jul 02 00:30:50.193068 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:50.193019 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="edf3ceac-f605-401f-9aa1-a5b61496cf77" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.35:9000/health/started\": dial tcp 10.132.0.35:9000: connect: connection refused" Jul 02 00:30:51.319016 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:51.318982 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 02 00:30:51.337563 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:30:51.337512 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="edf3ceac-f605-401f-9aa1-a5b61496cf77" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 00:31:01.324863 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:01.324831 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 02 00:31:01.994117 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:01.994085 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:31:02.392015 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:02.391986 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:31:04.442230 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:04.442197 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-njtzk"] Jul 02 00:31:04.442678 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:04.442365 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-njtzk" podUID="6de5e8f5-99a2-4b9f-a398-562a2c98ee67" containerName="authorino" containerID="cri-o://b6a7bd1f0e4c4d463410aac94a0f18e4fa88b8c5910ee3a60b21e656c85d39c7" gracePeriod=30 Jul 02 00:31:04.694468 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:04.694384 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-njtzk" Jul 02 00:31:04.811216 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:04.811189 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8v85j\" (UniqueName: \"kubernetes.io/projected/6de5e8f5-99a2-4b9f-a398-562a2c98ee67-kube-api-access-8v85j\") pod \"6de5e8f5-99a2-4b9f-a398-562a2c98ee67\" (UID: \"6de5e8f5-99a2-4b9f-a398-562a2c98ee67\") " Jul 02 00:31:04.813132 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:04.813106 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6de5e8f5-99a2-4b9f-a398-562a2c98ee67-kube-api-access-8v85j" (OuterVolumeSpecName: "kube-api-access-8v85j") pod "6de5e8f5-99a2-4b9f-a398-562a2c98ee67" (UID: "6de5e8f5-99a2-4b9f-a398-562a2c98ee67"). InnerVolumeSpecName "kube-api-access-8v85j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 00:31:04.912458 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:04.912402 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8v85j\" (UniqueName: \"kubernetes.io/projected/6de5e8f5-99a2-4b9f-a398-562a2c98ee67-kube-api-access-8v85j\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:31:05.422402 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:05.422304 2581 generic.go:356] "Generic (PLEG): container finished" podID="6de5e8f5-99a2-4b9f-a398-562a2c98ee67" containerID="b6a7bd1f0e4c4d463410aac94a0f18e4fa88b8c5910ee3a60b21e656c85d39c7" exitCode=0 Jul 02 00:31:05.422402 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:05.422344 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-njtzk" Jul 02 00:31:05.422402 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:05.422358 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-njtzk" event={"ID":"6de5e8f5-99a2-4b9f-a398-562a2c98ee67","Type":"ContainerDied","Data":"b6a7bd1f0e4c4d463410aac94a0f18e4fa88b8c5910ee3a60b21e656c85d39c7"} Jul 02 00:31:05.422402 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:05.422395 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-njtzk" event={"ID":"6de5e8f5-99a2-4b9f-a398-562a2c98ee67","Type":"ContainerDied","Data":"812cfd667a66ea93f6acc9fe81f34a4ef630894fd5fbef12d6352f491d56eeea"} Jul 02 00:31:05.422789 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:05.422441 2581 scope.go:117] "RemoveContainer" containerID="b6a7bd1f0e4c4d463410aac94a0f18e4fa88b8c5910ee3a60b21e656c85d39c7" Jul 02 00:31:05.431012 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:05.430995 2581 scope.go:117] "RemoveContainer" containerID="b6a7bd1f0e4c4d463410aac94a0f18e4fa88b8c5910ee3a60b21e656c85d39c7" Jul 02 00:31:05.431253 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:31:05.431233 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6a7bd1f0e4c4d463410aac94a0f18e4fa88b8c5910ee3a60b21e656c85d39c7\": container with ID starting with b6a7bd1f0e4c4d463410aac94a0f18e4fa88b8c5910ee3a60b21e656c85d39c7 not found: ID does not exist" containerID="b6a7bd1f0e4c4d463410aac94a0f18e4fa88b8c5910ee3a60b21e656c85d39c7" Jul 02 00:31:05.431309 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:05.431265 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6a7bd1f0e4c4d463410aac94a0f18e4fa88b8c5910ee3a60b21e656c85d39c7"} err="failed to get container status \"b6a7bd1f0e4c4d463410aac94a0f18e4fa88b8c5910ee3a60b21e656c85d39c7\": rpc error: code = NotFound desc = could not find container \"b6a7bd1f0e4c4d463410aac94a0f18e4fa88b8c5910ee3a60b21e656c85d39c7\": container with ID starting with b6a7bd1f0e4c4d463410aac94a0f18e4fa88b8c5910ee3a60b21e656c85d39c7 not found: ID does not exist" Jul 02 00:31:05.442577 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:05.441302 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-njtzk"] Jul 02 00:31:05.445980 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:05.445956 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-njtzk"] Jul 02 00:31:07.066144 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:07.066102 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6de5e8f5-99a2-4b9f-a398-562a2c98ee67" path="/var/lib/kubelet/pods/6de5e8f5-99a2-4b9f-a398-562a2c98ee67/volumes" Jul 02 00:31:08.608383 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:08.608353 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:31:08.619453 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:08.619407 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6f89f798cf-6pmm4"] Jul 02 00:31:08.619807 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:08.619794 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6de5e8f5-99a2-4b9f-a398-562a2c98ee67" containerName="authorino" Jul 02 00:31:08.619869 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:08.619809 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6de5e8f5-99a2-4b9f-a398-562a2c98ee67" containerName="authorino" Jul 02 00:31:08.619921 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:08.619885 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6de5e8f5-99a2-4b9f-a398-562a2c98ee67" containerName="authorino" Jul 02 00:31:08.622320 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:08.622303 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f89f798cf-6pmm4" Jul 02 00:31:08.624728 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:08.624712 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 02 00:31:08.624861 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:08.624843 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-d2k6h\"" Jul 02 00:31:08.625685 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:08.625672 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 02 00:31:08.631517 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:08.631494 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f89f798cf-6pmm4"] Jul 02 00:31:08.709308 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:08.709279 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:31:08.741889 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:08.741864 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f41b21c-6349-4c71-ac7a-acad2050f39f-webhook-cert\") pod \"maas-controller-6f89f798cf-6pmm4\" (UID: \"9f41b21c-6349-4c71-ac7a-acad2050f39f\") " pod="opendatahub/maas-controller-6f89f798cf-6pmm4" Jul 02 00:31:08.742027 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:08.741972 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8shzk\" (UniqueName: \"kubernetes.io/projected/9f41b21c-6349-4c71-ac7a-acad2050f39f-kube-api-access-8shzk\") pod \"maas-controller-6f89f798cf-6pmm4\" (UID: \"9f41b21c-6349-4c71-ac7a-acad2050f39f\") " pod="opendatahub/maas-controller-6f89f798cf-6pmm4" Jul 02 00:31:08.788200 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:08.788170 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:31:08.791777 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:08.791751 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-59b85bfd9f-wsfrg"] Jul 02 00:31:08.794301 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:08.794283 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59b85bfd9f-wsfrg" Jul 02 00:31:08.805183 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:08.805164 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59b85bfd9f-wsfrg"] Jul 02 00:31:08.843014 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:08.842982 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjpjr\" (UniqueName: \"kubernetes.io/projected/5a06c21e-c165-47a3-9d6a-f0ab191627c1-kube-api-access-kjpjr\") pod \"maas-controller-59b85bfd9f-wsfrg\" (UID: \"5a06c21e-c165-47a3-9d6a-f0ab191627c1\") " pod="opendatahub/maas-controller-59b85bfd9f-wsfrg" Jul 02 00:31:08.843152 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:08.843030 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f41b21c-6349-4c71-ac7a-acad2050f39f-webhook-cert\") pod \"maas-controller-6f89f798cf-6pmm4\" (UID: \"9f41b21c-6349-4c71-ac7a-acad2050f39f\") " pod="opendatahub/maas-controller-6f89f798cf-6pmm4" Jul 02 00:31:08.843233 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:08.843150 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a06c21e-c165-47a3-9d6a-f0ab191627c1-webhook-cert\") pod \"maas-controller-59b85bfd9f-wsfrg\" (UID: \"5a06c21e-c165-47a3-9d6a-f0ab191627c1\") " pod="opendatahub/maas-controller-59b85bfd9f-wsfrg" Jul 02 00:31:08.843233 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:08.843194 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8shzk\" (UniqueName: \"kubernetes.io/projected/9f41b21c-6349-4c71-ac7a-acad2050f39f-kube-api-access-8shzk\") pod \"maas-controller-6f89f798cf-6pmm4\" (UID: \"9f41b21c-6349-4c71-ac7a-acad2050f39f\") " pod="opendatahub/maas-controller-6f89f798cf-6pmm4" Jul 02 00:31:08.845486 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:08.845464 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f41b21c-6349-4c71-ac7a-acad2050f39f-webhook-cert\") pod \"maas-controller-6f89f798cf-6pmm4\" (UID: \"9f41b21c-6349-4c71-ac7a-acad2050f39f\") " pod="opendatahub/maas-controller-6f89f798cf-6pmm4" Jul 02 00:31:08.849664 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:08.849631 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:31:08.851337 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:08.851316 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8shzk\" (UniqueName: \"kubernetes.io/projected/9f41b21c-6349-4c71-ac7a-acad2050f39f-kube-api-access-8shzk\") pod \"maas-controller-6f89f798cf-6pmm4\" (UID: \"9f41b21c-6349-4c71-ac7a-acad2050f39f\") " pod="opendatahub/maas-controller-6f89f798cf-6pmm4" Jul 02 00:31:08.933095 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:08.933030 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f89f798cf-6pmm4" Jul 02 00:31:08.944324 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:08.944299 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjpjr\" (UniqueName: \"kubernetes.io/projected/5a06c21e-c165-47a3-9d6a-f0ab191627c1-kube-api-access-kjpjr\") pod \"maas-controller-59b85bfd9f-wsfrg\" (UID: \"5a06c21e-c165-47a3-9d6a-f0ab191627c1\") " pod="opendatahub/maas-controller-59b85bfd9f-wsfrg" Jul 02 00:31:08.944446 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:08.944428 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a06c21e-c165-47a3-9d6a-f0ab191627c1-webhook-cert\") pod \"maas-controller-59b85bfd9f-wsfrg\" (UID: \"5a06c21e-c165-47a3-9d6a-f0ab191627c1\") " pod="opendatahub/maas-controller-59b85bfd9f-wsfrg" Jul 02 00:31:08.946605 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:08.946580 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a06c21e-c165-47a3-9d6a-f0ab191627c1-webhook-cert\") pod \"maas-controller-59b85bfd9f-wsfrg\" (UID: \"5a06c21e-c165-47a3-9d6a-f0ab191627c1\") " pod="opendatahub/maas-controller-59b85bfd9f-wsfrg" Jul 02 00:31:08.951905 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:08.951883 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjpjr\" (UniqueName: \"kubernetes.io/projected/5a06c21e-c165-47a3-9d6a-f0ab191627c1-kube-api-access-kjpjr\") pod \"maas-controller-59b85bfd9f-wsfrg\" (UID: \"5a06c21e-c165-47a3-9d6a-f0ab191627c1\") " pod="opendatahub/maas-controller-59b85bfd9f-wsfrg" Jul 02 00:31:09.064939 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:31:09.064910 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f41b21c_6349_4c71_ac7a_acad2050f39f.slice/crio-b47ed063fd7927797db491f3924ec4a429b70d87d828e7efc016fbbd9ae98fe3 WatchSource:0}: Error finding container b47ed063fd7927797db491f3924ec4a429b70d87d828e7efc016fbbd9ae98fe3: Status 404 returned error can't find the container with id b47ed063fd7927797db491f3924ec4a429b70d87d828e7efc016fbbd9ae98fe3 Jul 02 00:31:09.066862 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:09.066841 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f89f798cf-6pmm4"] Jul 02 00:31:09.104988 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:09.104967 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59b85bfd9f-wsfrg" Jul 02 00:31:09.231175 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:09.231153 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59b85bfd9f-wsfrg"] Jul 02 00:31:09.233475 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:31:09.233454 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a06c21e_c165_47a3_9d6a_f0ab191627c1.slice/crio-133fc15451fe50f9cc1d28980b9d126ac11c7f19fa1c66de9737412fc8c0f112 WatchSource:0}: Error finding container 133fc15451fe50f9cc1d28980b9d126ac11c7f19fa1c66de9737412fc8c0f112: Status 404 returned error can't find the container with id 133fc15451fe50f9cc1d28980b9d126ac11c7f19fa1c66de9737412fc8c0f112 Jul 02 00:31:09.441894 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:09.441815 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59b85bfd9f-wsfrg" event={"ID":"5a06c21e-c165-47a3-9d6a-f0ab191627c1","Type":"ContainerStarted","Data":"133fc15451fe50f9cc1d28980b9d126ac11c7f19fa1c66de9737412fc8c0f112"} Jul 02 00:31:09.442922 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:09.442898 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f89f798cf-6pmm4" event={"ID":"9f41b21c-6349-4c71-ac7a-acad2050f39f","Type":"ContainerStarted","Data":"b47ed063fd7927797db491f3924ec4a429b70d87d828e7efc016fbbd9ae98fe3"} Jul 02 00:31:11.928619 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:11.928531 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:31:12.025946 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:12.025909 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:31:12.472662 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:12.472629 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f89f798cf-6pmm4" event={"ID":"9f41b21c-6349-4c71-ac7a-acad2050f39f","Type":"ContainerStarted","Data":"3b468378100c7b9b4346e75faf4318da9276b888ecc58498527ee1a8f8f1a6b3"} Jul 02 00:31:12.472852 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:12.472731 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6f89f798cf-6pmm4" Jul 02 00:31:12.474131 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:12.474110 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59b85bfd9f-wsfrg" event={"ID":"5a06c21e-c165-47a3-9d6a-f0ab191627c1","Type":"ContainerStarted","Data":"88d1ec7eb7209280be2d5dc00841de00a3cf5d29b17437bef8c2a55f37b3ad42"} Jul 02 00:31:12.474246 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:12.474233 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-59b85bfd9f-wsfrg" Jul 02 00:31:12.490316 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:12.490272 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6f89f798cf-6pmm4" podStartSLOduration=1.87147712 podStartE2EDuration="4.490261272s" totalImagesPullingTime="2.618784152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:31:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:31:12.48845038 +0000 UTC m=+825.903888047" watchObservedRunningTime="2026-07-02 00:31:12.490261272 +0000 UTC m=+825.905698939" Jul 02 00:31:12.504688 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:12.504649 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-59b85bfd9f-wsfrg" podStartSLOduration=2.043619256 podStartE2EDuration="4.504637024s" totalImagesPullingTime="2.461017768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:31:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:31:12.504121415 +0000 UTC m=+825.919559085" watchObservedRunningTime="2026-07-02 00:31:12.504637024 +0000 UTC m=+825.920074690" Jul 02 00:31:21.517685 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:21.517651 2581 generic.go:356] "Generic (PLEG): container finished" podID="1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0" containerID="30c18fc7c4275d3c8ce0dbd0a33ceaea8b30a404b7fa4ed1142c3e5237b19e8d" exitCode=0 Jul 02 00:31:21.518087 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:21.517723 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" event={"ID":"1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0","Type":"ContainerDied","Data":"30c18fc7c4275d3c8ce0dbd0a33ceaea8b30a404b7fa4ed1142c3e5237b19e8d"} Jul 02 00:31:21.518087 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:21.518066 2581 scope.go:117] "RemoveContainer" containerID="30c18fc7c4275d3c8ce0dbd0a33ceaea8b30a404b7fa4ed1142c3e5237b19e8d" Jul 02 00:31:21.519043 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:21.519018 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 00:31:21.519099 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:21.519079 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 00:31:21.519135 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:21.519109 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 00:31:22.524041 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:22.524010 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" event={"ID":"1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0","Type":"ContainerStarted","Data":"0ab9c0c6a4bb424ed6ea51490686a35c4995f8f544fd2d36ceb9840ed2242d26"} Jul 02 00:31:22.585816 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:22.585783 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:31:22.586053 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:22.586032 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-pvgz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jul 02 00:31:22.586099 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:22.586077 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" podUID="1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jul 02 00:31:23.484011 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:23.483974 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-59b85bfd9f-wsfrg" Jul 02 00:31:23.484222 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:23.484051 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6f89f798cf-6pmm4" Jul 02 00:31:23.543769 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:23.543741 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f89f798cf-6pmm4"] Jul 02 00:31:23.548795 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:23.548757 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6f89f798cf-6pmm4" podUID="9f41b21c-6349-4c71-ac7a-acad2050f39f" containerName="manager" containerID="cri-o://3b468378100c7b9b4346e75faf4318da9276b888ecc58498527ee1a8f8f1a6b3" gracePeriod=30 Jul 02 00:31:23.586220 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:23.586191 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-pvgz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jul 02 00:31:23.586317 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:23.586234 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" podUID="1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jul 02 00:31:23.815521 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:23.815500 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f89f798cf-6pmm4" Jul 02 00:31:23.886360 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:23.886328 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f41b21c-6349-4c71-ac7a-acad2050f39f-webhook-cert\") pod \"9f41b21c-6349-4c71-ac7a-acad2050f39f\" (UID: \"9f41b21c-6349-4c71-ac7a-acad2050f39f\") " Jul 02 00:31:23.886564 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:23.886403 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8shzk\" (UniqueName: \"kubernetes.io/projected/9f41b21c-6349-4c71-ac7a-acad2050f39f-kube-api-access-8shzk\") pod \"9f41b21c-6349-4c71-ac7a-acad2050f39f\" (UID: \"9f41b21c-6349-4c71-ac7a-acad2050f39f\") " Jul 02 00:31:23.888680 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:23.888655 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f41b21c-6349-4c71-ac7a-acad2050f39f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9f41b21c-6349-4c71-ac7a-acad2050f39f" (UID: "9f41b21c-6349-4c71-ac7a-acad2050f39f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 00:31:23.888772 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:23.888707 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f41b21c-6349-4c71-ac7a-acad2050f39f-kube-api-access-8shzk" (OuterVolumeSpecName: "kube-api-access-8shzk") pod "9f41b21c-6349-4c71-ac7a-acad2050f39f" (UID: "9f41b21c-6349-4c71-ac7a-acad2050f39f"). InnerVolumeSpecName "kube-api-access-8shzk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 00:31:23.988181 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:23.988150 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8shzk\" (UniqueName: \"kubernetes.io/projected/9f41b21c-6349-4c71-ac7a-acad2050f39f-kube-api-access-8shzk\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:31:23.988181 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:23.988176 2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f41b21c-6349-4c71-ac7a-acad2050f39f-webhook-cert\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:31:24.555407 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:24.555367 2581 generic.go:356] "Generic (PLEG): container finished" podID="9f41b21c-6349-4c71-ac7a-acad2050f39f" containerID="3b468378100c7b9b4346e75faf4318da9276b888ecc58498527ee1a8f8f1a6b3" exitCode=0 Jul 02 00:31:24.555407 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:24.555432 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f89f798cf-6pmm4" Jul 02 00:31:24.555915 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:24.555450 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f89f798cf-6pmm4" event={"ID":"9f41b21c-6349-4c71-ac7a-acad2050f39f","Type":"ContainerDied","Data":"3b468378100c7b9b4346e75faf4318da9276b888ecc58498527ee1a8f8f1a6b3"} Jul 02 00:31:24.555915 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:24.555527 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f89f798cf-6pmm4" event={"ID":"9f41b21c-6349-4c71-ac7a-acad2050f39f","Type":"ContainerDied","Data":"b47ed063fd7927797db491f3924ec4a429b70d87d828e7efc016fbbd9ae98fe3"} Jul 02 00:31:24.555915 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:24.555549 2581 scope.go:117] "RemoveContainer" containerID="3b468378100c7b9b4346e75faf4318da9276b888ecc58498527ee1a8f8f1a6b3" Jul 02 00:31:24.565102 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:24.564898 2581 scope.go:117] "RemoveContainer" containerID="3b468378100c7b9b4346e75faf4318da9276b888ecc58498527ee1a8f8f1a6b3" Jul 02 00:31:24.565205 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:31:24.565186 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b468378100c7b9b4346e75faf4318da9276b888ecc58498527ee1a8f8f1a6b3\": container with ID starting with 3b468378100c7b9b4346e75faf4318da9276b888ecc58498527ee1a8f8f1a6b3 not found: ID does not exist" containerID="3b468378100c7b9b4346e75faf4318da9276b888ecc58498527ee1a8f8f1a6b3" Jul 02 00:31:24.565247 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:24.565214 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b468378100c7b9b4346e75faf4318da9276b888ecc58498527ee1a8f8f1a6b3"} err="failed to get container status \"3b468378100c7b9b4346e75faf4318da9276b888ecc58498527ee1a8f8f1a6b3\": rpc error: code = NotFound desc = could not find container \"3b468378100c7b9b4346e75faf4318da9276b888ecc58498527ee1a8f8f1a6b3\": container with ID starting with 3b468378100c7b9b4346e75faf4318da9276b888ecc58498527ee1a8f8f1a6b3 not found: ID does not exist" Jul 02 00:31:24.577200 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:24.577176 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f89f798cf-6pmm4"] Jul 02 00:31:24.581204 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:24.581185 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6f89f798cf-6pmm4"] Jul 02 00:31:24.586538 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:24.586519 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-pvgz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jul 02 00:31:24.586602 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:24.586562 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" podUID="1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jul 02 00:31:25.067045 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:25.067013 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f41b21c-6349-4c71-ac7a-acad2050f39f" path="/var/lib/kubelet/pods/9f41b21c-6349-4c71-ac7a-acad2050f39f/volumes" Jul 02 00:31:25.586244 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:25.586212 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-pvgz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jul 02 00:31:25.586659 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:25.586264 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" podUID="1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jul 02 00:31:26.589743 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:26.589716 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:31:26.590186 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:26.590079 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:31:26.590802 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:26.590782 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pvgz8" Jul 02 00:31:43.716363 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:43.716308 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:31:44.126358 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.126329 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:31:44.172634 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.172601 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-69f5665455-5x9d2"] Jul 02 00:31:44.173033 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.173015 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f41b21c-6349-4c71-ac7a-acad2050f39f" containerName="manager" Jul 02 00:31:44.173125 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.173037 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f41b21c-6349-4c71-ac7a-acad2050f39f" containerName="manager" Jul 02 00:31:44.173181 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.173160 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f41b21c-6349-4c71-ac7a-acad2050f39f" containerName="manager" Jul 02 00:31:44.179864 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.179845 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-69f5665455-5x9d2" Jul 02 00:31:44.182560 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.182541 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 02 00:31:44.182665 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.182582 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-92pj6\"" Jul 02 00:31:44.188674 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.188655 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-69f5665455-5x9d2"] Jul 02 00:31:44.262561 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.262534 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cc030ec-473b-4b4f-9a4a-8e3dad9bae29-maas-api-tls\") pod \"maas-api-69f5665455-5x9d2\" (UID: \"4cc030ec-473b-4b4f-9a4a-8e3dad9bae29\") " pod="opendatahub/maas-api-69f5665455-5x9d2" Jul 02 00:31:44.262721 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.262574 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cc030ec-473b-4b4f-9a4a-8e3dad9bae29-openshift-service-ca\") pod \"maas-api-69f5665455-5x9d2\" (UID: \"4cc030ec-473b-4b4f-9a4a-8e3dad9bae29\") " pod="opendatahub/maas-api-69f5665455-5x9d2" Jul 02 00:31:44.262721 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.262680 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkgd7\" (UniqueName: \"kubernetes.io/projected/4cc030ec-473b-4b4f-9a4a-8e3dad9bae29-kube-api-access-hkgd7\") pod \"maas-api-69f5665455-5x9d2\" (UID: \"4cc030ec-473b-4b4f-9a4a-8e3dad9bae29\") " pod="opendatahub/maas-api-69f5665455-5x9d2" Jul 02 00:31:44.363529 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.363488 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkgd7\" (UniqueName: \"kubernetes.io/projected/4cc030ec-473b-4b4f-9a4a-8e3dad9bae29-kube-api-access-hkgd7\") pod \"maas-api-69f5665455-5x9d2\" (UID: \"4cc030ec-473b-4b4f-9a4a-8e3dad9bae29\") " pod="opendatahub/maas-api-69f5665455-5x9d2" Jul 02 00:31:44.363706 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.363648 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cc030ec-473b-4b4f-9a4a-8e3dad9bae29-maas-api-tls\") pod \"maas-api-69f5665455-5x9d2\" (UID: \"4cc030ec-473b-4b4f-9a4a-8e3dad9bae29\") " pod="opendatahub/maas-api-69f5665455-5x9d2" Jul 02 00:31:44.363706 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.363701 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cc030ec-473b-4b4f-9a4a-8e3dad9bae29-openshift-service-ca\") pod \"maas-api-69f5665455-5x9d2\" (UID: \"4cc030ec-473b-4b4f-9a4a-8e3dad9bae29\") " pod="opendatahub/maas-api-69f5665455-5x9d2" Jul 02 00:31:44.363812 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:31:44.363789 2581 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 02 00:31:44.363868 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:31:44.363856 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cc030ec-473b-4b4f-9a4a-8e3dad9bae29-maas-api-tls podName:4cc030ec-473b-4b4f-9a4a-8e3dad9bae29 nodeName:}" failed. No retries permitted until 2026-07-02 00:31:44.863835273 +0000 UTC m=+858.279272932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4cc030ec-473b-4b4f-9a4a-8e3dad9bae29-maas-api-tls") pod "maas-api-69f5665455-5x9d2" (UID: "4cc030ec-473b-4b4f-9a4a-8e3dad9bae29") : secret "maas-api-serving-cert" not found Jul 02 00:31:44.364387 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.364369 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cc030ec-473b-4b4f-9a4a-8e3dad9bae29-openshift-service-ca\") pod \"maas-api-69f5665455-5x9d2\" (UID: \"4cc030ec-473b-4b4f-9a4a-8e3dad9bae29\") " pod="opendatahub/maas-api-69f5665455-5x9d2" Jul 02 00:31:44.371625 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.371606 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkgd7\" (UniqueName: \"kubernetes.io/projected/4cc030ec-473b-4b4f-9a4a-8e3dad9bae29-kube-api-access-hkgd7\") pod \"maas-api-69f5665455-5x9d2\" (UID: \"4cc030ec-473b-4b4f-9a4a-8e3dad9bae29\") " pod="opendatahub/maas-api-69f5665455-5x9d2" Jul 02 00:31:44.474538 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.474463 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:31:44.574992 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.574963 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:31:44.614065 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.614038 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-4lx6d"] Jul 02 00:31:44.617730 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.617710 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-4lx6d" Jul 02 00:31:44.620294 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.620277 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 02 00:31:44.620352 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.620278 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-b7kln\"" Jul 02 00:31:44.627238 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.627210 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-4lx6d"] Jul 02 00:31:44.666249 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.666215 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72q5s\" (UniqueName: \"kubernetes.io/projected/86161c7b-825c-4b6e-a766-83859c13fcfc-kube-api-access-72q5s\") pod \"payload-pre-processing-59f49fd4f6-4lx6d\" (UID: \"86161c7b-825c-4b6e-a766-83859c13fcfc\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-4lx6d" Jul 02 00:31:44.666399 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.666290 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86161c7b-825c-4b6e-a766-83859c13fcfc-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-4lx6d\" (UID: \"86161c7b-825c-4b6e-a766-83859c13fcfc\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-4lx6d" Jul 02 00:31:44.678255 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.678178 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:31:44.767429 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.767385 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86161c7b-825c-4b6e-a766-83859c13fcfc-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-4lx6d\" (UID: \"86161c7b-825c-4b6e-a766-83859c13fcfc\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-4lx6d" Jul 02 00:31:44.767803 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.767508 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72q5s\" (UniqueName: \"kubernetes.io/projected/86161c7b-825c-4b6e-a766-83859c13fcfc-kube-api-access-72q5s\") pod \"payload-pre-processing-59f49fd4f6-4lx6d\" (UID: \"86161c7b-825c-4b6e-a766-83859c13fcfc\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-4lx6d" Jul 02 00:31:44.768181 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.768161 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86161c7b-825c-4b6e-a766-83859c13fcfc-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-4lx6d\" (UID: \"86161c7b-825c-4b6e-a766-83859c13fcfc\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-4lx6d" Jul 02 00:31:44.775808 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.775782 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72q5s\" (UniqueName: \"kubernetes.io/projected/86161c7b-825c-4b6e-a766-83859c13fcfc-kube-api-access-72q5s\") pod \"payload-pre-processing-59f49fd4f6-4lx6d\" (UID: \"86161c7b-825c-4b6e-a766-83859c13fcfc\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-4lx6d" Jul 02 00:31:44.868560 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.868526 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cc030ec-473b-4b4f-9a4a-8e3dad9bae29-maas-api-tls\") pod \"maas-api-69f5665455-5x9d2\" (UID: \"4cc030ec-473b-4b4f-9a4a-8e3dad9bae29\") " pod="opendatahub/maas-api-69f5665455-5x9d2" Jul 02 00:31:44.871307 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.871280 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cc030ec-473b-4b4f-9a4a-8e3dad9bae29-maas-api-tls\") pod \"maas-api-69f5665455-5x9d2\" (UID: \"4cc030ec-473b-4b4f-9a4a-8e3dad9bae29\") " pod="opendatahub/maas-api-69f5665455-5x9d2" Jul 02 00:31:44.928333 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:44.928309 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-4lx6d" Jul 02 00:31:45.068340 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:45.068245 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-4lx6d"] Jul 02 00:31:45.070689 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:31:45.070662 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86161c7b_825c_4b6e_a766_83859c13fcfc.slice/crio-03668d67403456513101212f6ed13acb0ae88970c504bc15f6e6d9c714fe727d WatchSource:0}: Error finding container 03668d67403456513101212f6ed13acb0ae88970c504bc15f6e6d9c714fe727d: Status 404 returned error can't find the container with id 03668d67403456513101212f6ed13acb0ae88970c504bc15f6e6d9c714fe727d Jul 02 00:31:45.091924 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:45.091904 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-69f5665455-5x9d2" Jul 02 00:31:45.219580 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:45.219553 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-69f5665455-5x9d2"] Jul 02 00:31:45.221402 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:31:45.221370 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cc030ec_473b_4b4f_9a4a_8e3dad9bae29.slice/crio-28e6e07a856f155c843a9d748a61305a90c5fd35e94bcc0f8ac668734e90df60 WatchSource:0}: Error finding container 28e6e07a856f155c843a9d748a61305a90c5fd35e94bcc0f8ac668734e90df60: Status 404 returned error can't find the container with id 28e6e07a856f155c843a9d748a61305a90c5fd35e94bcc0f8ac668734e90df60 Jul 02 00:31:45.658778 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:45.658746 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-4lx6d" event={"ID":"86161c7b-825c-4b6e-a766-83859c13fcfc","Type":"ContainerStarted","Data":"03668d67403456513101212f6ed13acb0ae88970c504bc15f6e6d9c714fe727d"} Jul 02 00:31:45.660057 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:45.660026 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-69f5665455-5x9d2" event={"ID":"4cc030ec-473b-4b4f-9a4a-8e3dad9bae29","Type":"ContainerStarted","Data":"28e6e07a856f155c843a9d748a61305a90c5fd35e94bcc0f8ac668734e90df60"} Jul 02 00:31:48.677478 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:48.677448 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-4lx6d" event={"ID":"86161c7b-825c-4b6e-a766-83859c13fcfc","Type":"ContainerStarted","Data":"ea34151cd6b6851f6e60fbebf170d02a2cf373858ccae1d980e0bc915cdeb97c"} Jul 02 00:31:48.677940 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:48.677504 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-4lx6d" Jul 02 00:31:48.678899 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:48.678876 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-69f5665455-5x9d2" event={"ID":"4cc030ec-473b-4b4f-9a4a-8e3dad9bae29","Type":"ContainerStarted","Data":"825eb5f71b83a4e53782bd1cc2031bd25e8e19a8197df1b87974eaa250f74402"} Jul 02 00:31:48.679038 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:48.678927 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-69f5665455-5x9d2" Jul 02 00:31:48.694424 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:48.694377 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-4lx6d" podStartSLOduration=1.918855666 podStartE2EDuration="4.694363735s" totalImagesPullingTime="2.775508069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:31:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:31:48.693319623 +0000 UTC m=+862.108757293" watchObservedRunningTime="2026-07-02 00:31:48.694363735 +0000 UTC m=+862.109801401" Jul 02 00:31:48.711437 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:48.711380 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-69f5665455-5x9d2" podStartSLOduration=2.087579744 podStartE2EDuration="4.711367777s" totalImagesPullingTime="2.623788033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:31:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:31:48.709496468 +0000 UTC m=+862.124934136" watchObservedRunningTime="2026-07-02 00:31:48.711367777 +0000 UTC m=+862.126805443" Jul 02 00:31:54.689389 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:54.689360 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-69f5665455-5x9d2" Jul 02 00:31:56.061338 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:56.061303 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 00:31:56.061799 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:56.061487 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="edf3ceac-f605-401f-9aa1-a5b61496cf77" containerName="keycloak" containerID="cri-o://82c84845c9ef83aab4aa0c110a54cec17e8a982ebcd9ecae56812b72f8bb399d" gracePeriod=30 Jul 02 00:31:57.600274 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:57.600251 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 00:31:57.681527 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:57.681487 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66bbp\" (UniqueName: \"kubernetes.io/projected/edf3ceac-f605-401f-9aa1-a5b61496cf77-kube-api-access-66bbp\") pod \"edf3ceac-f605-401f-9aa1-a5b61496cf77\" (UID: \"edf3ceac-f605-401f-9aa1-a5b61496cf77\") " Jul 02 00:31:57.683597 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:57.683568 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edf3ceac-f605-401f-9aa1-a5b61496cf77-kube-api-access-66bbp" (OuterVolumeSpecName: "kube-api-access-66bbp") pod "edf3ceac-f605-401f-9aa1-a5b61496cf77" (UID: "edf3ceac-f605-401f-9aa1-a5b61496cf77"). InnerVolumeSpecName "kube-api-access-66bbp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 00:31:57.722170 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:57.722106 2581 generic.go:356] "Generic (PLEG): container finished" podID="edf3ceac-f605-401f-9aa1-a5b61496cf77" containerID="82c84845c9ef83aab4aa0c110a54cec17e8a982ebcd9ecae56812b72f8bb399d" exitCode=143 Jul 02 00:31:57.722170 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:57.722140 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"edf3ceac-f605-401f-9aa1-a5b61496cf77","Type":"ContainerDied","Data":"82c84845c9ef83aab4aa0c110a54cec17e8a982ebcd9ecae56812b72f8bb399d"} Jul 02 00:31:57.722170 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:57.722155 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 00:31:57.722345 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:57.722174 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"edf3ceac-f605-401f-9aa1-a5b61496cf77","Type":"ContainerDied","Data":"98159ed43e2fd1cc8f55797311b5932b3ed510cd2846bddb14e9d87d6187675d"} Jul 02 00:31:57.722345 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:57.722194 2581 scope.go:117] "RemoveContainer" containerID="82c84845c9ef83aab4aa0c110a54cec17e8a982ebcd9ecae56812b72f8bb399d" Jul 02 00:31:57.732685 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:57.732662 2581 scope.go:117] "RemoveContainer" containerID="82c84845c9ef83aab4aa0c110a54cec17e8a982ebcd9ecae56812b72f8bb399d" Jul 02 00:31:57.732938 ip-10-0-130-30 kubenswrapper[2581]: E0702 00:31:57.732917 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82c84845c9ef83aab4aa0c110a54cec17e8a982ebcd9ecae56812b72f8bb399d\": container with ID starting with 82c84845c9ef83aab4aa0c110a54cec17e8a982ebcd9ecae56812b72f8bb399d not found: ID does not exist" containerID="82c84845c9ef83aab4aa0c110a54cec17e8a982ebcd9ecae56812b72f8bb399d" Jul 02 00:31:57.732989 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:57.732947 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82c84845c9ef83aab4aa0c110a54cec17e8a982ebcd9ecae56812b72f8bb399d"} err="failed to get container status \"82c84845c9ef83aab4aa0c110a54cec17e8a982ebcd9ecae56812b72f8bb399d\": rpc error: code = NotFound desc = could not find container \"82c84845c9ef83aab4aa0c110a54cec17e8a982ebcd9ecae56812b72f8bb399d\": container with ID starting with 82c84845c9ef83aab4aa0c110a54cec17e8a982ebcd9ecae56812b72f8bb399d not found: ID does not exist" Jul 02 00:31:57.745372 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:57.745349 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 00:31:57.749326 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:57.749305 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 00:31:57.769755 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:57.769726 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 00:31:57.770140 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:57.770124 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edf3ceac-f605-401f-9aa1-a5b61496cf77" containerName="keycloak" Jul 02 00:31:57.770217 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:57.770143 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="edf3ceac-f605-401f-9aa1-a5b61496cf77" containerName="keycloak" Jul 02 00:31:57.770272 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:57.770250 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="edf3ceac-f605-401f-9aa1-a5b61496cf77" containerName="keycloak" Jul 02 00:31:57.774626 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:57.774608 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 00:31:57.777297 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:57.777277 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 02 00:31:57.777395 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:57.777368 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 02 00:31:57.777395 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:57.777374 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 02 00:31:57.777646 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:57.777629 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-hv4cm\"" Jul 02 00:31:57.777686 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:57.777652 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jul 02 00:31:57.782457 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:57.782405 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66bbp\" (UniqueName: \"kubernetes.io/projected/edf3ceac-f605-401f-9aa1-a5b61496cf77-kube-api-access-66bbp\") on node \"ip-10-0-130-30.ec2.internal\" DevicePath \"\"" Jul 02 00:31:57.782967 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:57.782947 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 00:31:57.883119 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:57.883091 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jvcm\" (UniqueName: \"kubernetes.io/projected/d5bdf623-4bb1-4752-8359-e5320f6ac91a-kube-api-access-4jvcm\") pod \"maas-keycloak-0\" (UID: \"d5bdf623-4bb1-4752-8359-e5320f6ac91a\") " pod="keycloak-system/maas-keycloak-0" Jul 02 00:31:57.883252 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:57.883143 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/d5bdf623-4bb1-4752-8359-e5320f6ac91a-test-realms\") pod \"maas-keycloak-0\" (UID: \"d5bdf623-4bb1-4752-8359-e5320f6ac91a\") " pod="keycloak-system/maas-keycloak-0" Jul 02 00:31:57.984527 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:57.984444 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jvcm\" (UniqueName: \"kubernetes.io/projected/d5bdf623-4bb1-4752-8359-e5320f6ac91a-kube-api-access-4jvcm\") pod \"maas-keycloak-0\" (UID: \"d5bdf623-4bb1-4752-8359-e5320f6ac91a\") " pod="keycloak-system/maas-keycloak-0" Jul 02 00:31:57.984527 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:57.984522 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/d5bdf623-4bb1-4752-8359-e5320f6ac91a-test-realms\") pod \"maas-keycloak-0\" (UID: \"d5bdf623-4bb1-4752-8359-e5320f6ac91a\") " pod="keycloak-system/maas-keycloak-0" Jul 02 00:31:57.985277 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:57.985250 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/d5bdf623-4bb1-4752-8359-e5320f6ac91a-test-realms\") pod \"maas-keycloak-0\" (UID: \"d5bdf623-4bb1-4752-8359-e5320f6ac91a\") " pod="keycloak-system/maas-keycloak-0" Jul 02 00:31:57.992408 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:57.992380 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jvcm\" (UniqueName: \"kubernetes.io/projected/d5bdf623-4bb1-4752-8359-e5320f6ac91a-kube-api-access-4jvcm\") pod \"maas-keycloak-0\" (UID: \"d5bdf623-4bb1-4752-8359-e5320f6ac91a\") " pod="keycloak-system/maas-keycloak-0" Jul 02 00:31:58.085139 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:58.085110 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 00:31:58.214927 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:58.214901 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 00:31:58.216358 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:31:58.216336 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5bdf623_4bb1_4752_8359_e5320f6ac91a.slice/crio-43b76038c4f8262828af9cb1541b09b02e1e12d7c1a0d7041da4f67776955862 WatchSource:0}: Error finding container 43b76038c4f8262828af9cb1541b09b02e1e12d7c1a0d7041da4f67776955862: Status 404 returned error can't find the container with id 43b76038c4f8262828af9cb1541b09b02e1e12d7c1a0d7041da4f67776955862 Jul 02 00:31:58.729429 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:58.729370 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d5bdf623-4bb1-4752-8359-e5320f6ac91a","Type":"ContainerStarted","Data":"43b76038c4f8262828af9cb1541b09b02e1e12d7c1a0d7041da4f67776955862"} Jul 02 00:31:59.067144 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:59.067103 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edf3ceac-f605-401f-9aa1-a5b61496cf77" path="/var/lib/kubelet/pods/edf3ceac-f605-401f-9aa1-a5b61496cf77/volumes" Jul 02 00:31:59.686605 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:59.686572 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-4lx6d" Jul 02 00:31:59.739600 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:59.739552 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d5bdf623-4bb1-4752-8359-e5320f6ac91a","Type":"ContainerStarted","Data":"daac167a17e8e9447cc2269b84ba016baeac44242b98e8bf6b10797d90553262"} Jul 02 00:31:59.758631 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:31:59.758501 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.097266088 podStartE2EDuration="2.75848025s" totalImagesPullingTime="661.214162ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:31:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:31:59.756832421 +0000 UTC m=+873.172270091" watchObservedRunningTime="2026-07-02 00:31:59.75848025 +0000 UTC m=+873.173917918" Jul 02 00:32:00.086045 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:00.086003 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 02 00:32:00.087716 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:00.087687 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d5bdf623-4bb1-4752-8359-e5320f6ac91a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.40:9000/health/started\": dial tcp 10.132.0.40:9000: connect: connection refused" Jul 02 00:32:01.085889 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:01.085844 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d5bdf623-4bb1-4752-8359-e5320f6ac91a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.40:9000/health/started\": dial tcp 10.132.0.40:9000: connect: connection refused" Jul 02 00:32:02.086376 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:02.086322 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d5bdf623-4bb1-4752-8359-e5320f6ac91a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.40:9000/health/started\": dial tcp 10.132.0.40:9000: connect: connection refused" Jul 02 00:32:03.086113 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:03.086064 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d5bdf623-4bb1-4752-8359-e5320f6ac91a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.40:9000/health/started\": dial tcp 10.132.0.40:9000: connect: connection refused" Jul 02 00:32:04.086641 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:04.086590 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d5bdf623-4bb1-4752-8359-e5320f6ac91a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.40:9000/health/started\": dial tcp 10.132.0.40:9000: connect: connection refused" Jul 02 00:32:05.085751 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:05.085705 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d5bdf623-4bb1-4752-8359-e5320f6ac91a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.40:9000/health/started\": dial tcp 10.132.0.40:9000: connect: connection refused" Jul 02 00:32:06.086304 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:06.086253 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d5bdf623-4bb1-4752-8359-e5320f6ac91a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.40:9000/health/started\": dial tcp 10.132.0.40:9000: connect: connection refused" Jul 02 00:32:07.085729 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:07.085675 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d5bdf623-4bb1-4752-8359-e5320f6ac91a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.40:9000/health/started\": dial tcp 10.132.0.40:9000: connect: connection refused" Jul 02 00:32:08.085469 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:08.085405 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 02 00:32:08.085969 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:08.085755 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d5bdf623-4bb1-4752-8359-e5320f6ac91a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.40:9000/health/started\": dial tcp 10.132.0.40:9000: connect: connection refused" Jul 02 00:32:09.086003 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:09.085961 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d5bdf623-4bb1-4752-8359-e5320f6ac91a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.40:9000/health/started\": dial tcp 10.132.0.40:9000: connect: connection refused" Jul 02 00:32:10.086474 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:10.086385 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d5bdf623-4bb1-4752-8359-e5320f6ac91a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.40:9000/health/started\": dial tcp 10.132.0.40:9000: connect: connection refused" Jul 02 00:32:11.086292 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:11.086246 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d5bdf623-4bb1-4752-8359-e5320f6ac91a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.40:9000/health/started\": dial tcp 10.132.0.40:9000: connect: connection refused" Jul 02 00:32:12.086327 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:12.086281 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d5bdf623-4bb1-4752-8359-e5320f6ac91a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.40:9000/health/started\": dial tcp 10.132.0.40:9000: connect: connection refused" Jul 02 00:32:13.215060 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:13.215022 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 02 00:32:13.236129 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:13.236087 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="d5bdf623-4bb1-4752-8359-e5320f6ac91a" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 00:32:23.220608 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:23.220528 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 02 00:32:27.087349 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:27.087318 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55kgg_3ea67bc7-0faa-4fa0-904c-adfea68a4992/ovn-acl-logging/0.log" Jul 02 00:32:27.088768 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:27.088742 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55kgg_3ea67bc7-0faa-4fa0-904c-adfea68a4992/ovn-acl-logging/0.log" Jul 02 00:32:30.340789 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:30.340753 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:32:36.494246 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:36.494212 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:32:36.593741 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:36.593712 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:32:44.772774 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:44.772744 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h"] Jul 02 00:32:44.777720 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:44.777701 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h" Jul 02 00:32:44.780717 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:44.780697 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 02 00:32:44.781480 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:44.781462 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 02 00:32:44.781577 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:44.781548 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-q4qgl\"" Jul 02 00:32:44.782246 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:44.782223 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 02 00:32:44.790548 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:44.790525 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h"] Jul 02 00:32:44.822096 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:44.822060 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:32:44.834666 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:44.834643 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d690118-ddb5-4a77-9a79-2c44c6880922-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h\" (UID: \"5d690118-ddb5-4a77-9a79-2c44c6880922\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h" Jul 02 00:32:44.834783 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:44.834684 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d690118-ddb5-4a77-9a79-2c44c6880922-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h\" (UID: \"5d690118-ddb5-4a77-9a79-2c44c6880922\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h" Jul 02 00:32:44.834783 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:44.834707 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d690118-ddb5-4a77-9a79-2c44c6880922-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h\" (UID: \"5d690118-ddb5-4a77-9a79-2c44c6880922\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h" Jul 02 00:32:44.834898 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:44.834783 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4k74\" (UniqueName: \"kubernetes.io/projected/5d690118-ddb5-4a77-9a79-2c44c6880922-kube-api-access-d4k74\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h\" (UID: \"5d690118-ddb5-4a77-9a79-2c44c6880922\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h" Jul 02 00:32:44.834944 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:44.834914 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d690118-ddb5-4a77-9a79-2c44c6880922-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h\" (UID: \"5d690118-ddb5-4a77-9a79-2c44c6880922\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h" Jul 02 00:32:44.834944 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:44.834940 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d690118-ddb5-4a77-9a79-2c44c6880922-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h\" (UID: \"5d690118-ddb5-4a77-9a79-2c44c6880922\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h" Jul 02 00:32:44.935341 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:44.935310 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d690118-ddb5-4a77-9a79-2c44c6880922-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h\" (UID: \"5d690118-ddb5-4a77-9a79-2c44c6880922\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h" Jul 02 00:32:44.935341 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:44.935346 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d690118-ddb5-4a77-9a79-2c44c6880922-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h\" (UID: \"5d690118-ddb5-4a77-9a79-2c44c6880922\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h" Jul 02 00:32:44.935583 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:44.935373 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d690118-ddb5-4a77-9a79-2c44c6880922-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h\" (UID: \"5d690118-ddb5-4a77-9a79-2c44c6880922\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h" Jul 02 00:32:44.935583 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:44.935401 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d690118-ddb5-4a77-9a79-2c44c6880922-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h\" (UID: \"5d690118-ddb5-4a77-9a79-2c44c6880922\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h" Jul 02 00:32:44.935583 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:44.935433 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d690118-ddb5-4a77-9a79-2c44c6880922-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h\" (UID: \"5d690118-ddb5-4a77-9a79-2c44c6880922\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h" Jul 02 00:32:44.935583 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:44.935465 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4k74\" (UniqueName: \"kubernetes.io/projected/5d690118-ddb5-4a77-9a79-2c44c6880922-kube-api-access-d4k74\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h\" (UID: \"5d690118-ddb5-4a77-9a79-2c44c6880922\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h" Jul 02 00:32:44.935881 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:44.935862 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d690118-ddb5-4a77-9a79-2c44c6880922-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h\" (UID: \"5d690118-ddb5-4a77-9a79-2c44c6880922\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h" Jul 02 00:32:44.935940 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:44.935903 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d690118-ddb5-4a77-9a79-2c44c6880922-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h\" (UID: \"5d690118-ddb5-4a77-9a79-2c44c6880922\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h" Jul 02 00:32:44.935998 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:44.935956 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d690118-ddb5-4a77-9a79-2c44c6880922-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h\" (UID: \"5d690118-ddb5-4a77-9a79-2c44c6880922\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h" Jul 02 00:32:44.937633 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:44.937614 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d690118-ddb5-4a77-9a79-2c44c6880922-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h\" (UID: \"5d690118-ddb5-4a77-9a79-2c44c6880922\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h" Jul 02 00:32:44.937912 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:44.937895 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d690118-ddb5-4a77-9a79-2c44c6880922-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h\" (UID: \"5d690118-ddb5-4a77-9a79-2c44c6880922\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h" Jul 02 00:32:44.943232 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:44.943209 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4k74\" (UniqueName: \"kubernetes.io/projected/5d690118-ddb5-4a77-9a79-2c44c6880922-kube-api-access-d4k74\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h\" (UID: \"5d690118-ddb5-4a77-9a79-2c44c6880922\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h" Jul 02 00:32:45.094658 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:45.094563 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h" Jul 02 00:32:45.226058 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:45.226018 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h"] Jul 02 00:32:45.228365 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:32:45.228327 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d690118_ddb5_4a77_9a79_2c44c6880922.slice/crio-6b3665ac9efb9b08369af5ee947ea907c7322e9151377acf46b29a273221e60d WatchSource:0}: Error finding container 6b3665ac9efb9b08369af5ee947ea907c7322e9151377acf46b29a273221e60d: Status 404 returned error can't find the container with id 6b3665ac9efb9b08369af5ee947ea907c7322e9151377acf46b29a273221e60d Jul 02 00:32:45.993881 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:45.993840 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h" event={"ID":"5d690118-ddb5-4a77-9a79-2c44c6880922","Type":"ContainerStarted","Data":"6b3665ac9efb9b08369af5ee947ea907c7322e9151377acf46b29a273221e60d"} Jul 02 00:32:47.000542 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:47.000507 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h" event={"ID":"5d690118-ddb5-4a77-9a79-2c44c6880922","Type":"ContainerStarted","Data":"2ef69404ed82b9e65fff2d6099db925ac20fff2762feb6c4272eb375df0da1ba"} Jul 02 00:32:47.021010 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:47.020960 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h" podStartSLOduration=1.972218889 podStartE2EDuration="3.020942984s" totalImagesPullingTime="1.048724095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:32:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:32:47.019443121 +0000 UTC m=+920.434880786" watchObservedRunningTime="2026-07-02 00:32:47.020942984 +0000 UTC m=+920.436380651" Jul 02 00:32:55.095240 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:55.095211 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h" Jul 02 00:32:55.095706 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:55.095276 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h" Jul 02 00:32:55.107361 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:55.107338 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h" Jul 02 00:32:56.060589 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:32:56.060559 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h" Jul 02 00:33:00.596837 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:00.596804 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-sfz6d"] Jul 02 00:33:00.600512 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:00.600491 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sfz6d" Jul 02 00:33:00.603112 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:00.603092 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 02 00:33:00.610398 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:00.610372 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-sfz6d"] Jul 02 00:33:00.624506 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:00.624481 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:33:00.776931 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:00.776894 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bdef8b6-a1b9-4350-a026-5576f5fa6c0a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sfz6d\" (UID: \"5bdef8b6-a1b9-4350-a026-5576f5fa6c0a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sfz6d" Jul 02 00:33:00.777104 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:00.776946 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bdef8b6-a1b9-4350-a026-5576f5fa6c0a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sfz6d\" (UID: \"5bdef8b6-a1b9-4350-a026-5576f5fa6c0a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sfz6d" Jul 02 00:33:00.777104 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:00.777001 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bdef8b6-a1b9-4350-a026-5576f5fa6c0a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sfz6d\" (UID: \"5bdef8b6-a1b9-4350-a026-5576f5fa6c0a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sfz6d" Jul 02 00:33:00.777104 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:00.777026 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bdef8b6-a1b9-4350-a026-5576f5fa6c0a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sfz6d\" (UID: \"5bdef8b6-a1b9-4350-a026-5576f5fa6c0a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sfz6d" Jul 02 00:33:00.777104 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:00.777081 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hrp5\" (UniqueName: \"kubernetes.io/projected/5bdef8b6-a1b9-4350-a026-5576f5fa6c0a-kube-api-access-8hrp5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sfz6d\" (UID: \"5bdef8b6-a1b9-4350-a026-5576f5fa6c0a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sfz6d" Jul 02 00:33:00.777344 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:00.777150 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bdef8b6-a1b9-4350-a026-5576f5fa6c0a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sfz6d\" (UID: \"5bdef8b6-a1b9-4350-a026-5576f5fa6c0a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sfz6d" Jul 02 00:33:00.878671 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:00.878589 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bdef8b6-a1b9-4350-a026-5576f5fa6c0a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sfz6d\" (UID: \"5bdef8b6-a1b9-4350-a026-5576f5fa6c0a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sfz6d" Jul 02 00:33:00.878671 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:00.878627 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bdef8b6-a1b9-4350-a026-5576f5fa6c0a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sfz6d\" (UID: \"5bdef8b6-a1b9-4350-a026-5576f5fa6c0a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sfz6d" Jul 02 00:33:00.878671 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:00.878668 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hrp5\" (UniqueName: \"kubernetes.io/projected/5bdef8b6-a1b9-4350-a026-5576f5fa6c0a-kube-api-access-8hrp5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sfz6d\" (UID: \"5bdef8b6-a1b9-4350-a026-5576f5fa6c0a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sfz6d" Jul 02 00:33:00.878942 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:00.878711 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bdef8b6-a1b9-4350-a026-5576f5fa6c0a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sfz6d\" (UID: \"5bdef8b6-a1b9-4350-a026-5576f5fa6c0a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sfz6d" Jul 02 00:33:00.878942 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:00.878868 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bdef8b6-a1b9-4350-a026-5576f5fa6c0a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sfz6d\" (UID: \"5bdef8b6-a1b9-4350-a026-5576f5fa6c0a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sfz6d" Jul 02 00:33:00.879068 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:00.878944 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bdef8b6-a1b9-4350-a026-5576f5fa6c0a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sfz6d\" (UID: \"5bdef8b6-a1b9-4350-a026-5576f5fa6c0a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sfz6d" Jul 02 00:33:00.879133 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:00.879088 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bdef8b6-a1b9-4350-a026-5576f5fa6c0a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sfz6d\" (UID: \"5bdef8b6-a1b9-4350-a026-5576f5fa6c0a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sfz6d" Jul 02 00:33:00.879198 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:00.879174 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bdef8b6-a1b9-4350-a026-5576f5fa6c0a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sfz6d\" (UID: \"5bdef8b6-a1b9-4350-a026-5576f5fa6c0a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sfz6d" Jul 02 00:33:00.879297 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:00.879278 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bdef8b6-a1b9-4350-a026-5576f5fa6c0a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sfz6d\" (UID: \"5bdef8b6-a1b9-4350-a026-5576f5fa6c0a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sfz6d" Jul 02 00:33:00.880798 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:00.880773 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bdef8b6-a1b9-4350-a026-5576f5fa6c0a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sfz6d\" (UID: \"5bdef8b6-a1b9-4350-a026-5576f5fa6c0a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sfz6d" Jul 02 00:33:00.881088 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:00.881072 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bdef8b6-a1b9-4350-a026-5576f5fa6c0a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sfz6d\" (UID: \"5bdef8b6-a1b9-4350-a026-5576f5fa6c0a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sfz6d" Jul 02 00:33:00.885999 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:00.885977 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hrp5\" (UniqueName: \"kubernetes.io/projected/5bdef8b6-a1b9-4350-a026-5576f5fa6c0a-kube-api-access-8hrp5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sfz6d\" (UID: \"5bdef8b6-a1b9-4350-a026-5576f5fa6c0a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sfz6d" Jul 02 00:33:00.911723 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:00.911701 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sfz6d" Jul 02 00:33:01.040834 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:01.040810 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-sfz6d"] Jul 02 00:33:01.042597 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:33:01.042562 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bdef8b6_a1b9_4350_a026_5576f5fa6c0a.slice/crio-9494592985f01ef459b6b661b2ade5bde8f67062fcd1f88567584d3167f1e56d WatchSource:0}: Error finding container 9494592985f01ef459b6b661b2ade5bde8f67062fcd1f88567584d3167f1e56d: Status 404 returned error can't find the container with id 9494592985f01ef459b6b661b2ade5bde8f67062fcd1f88567584d3167f1e56d Jul 02 00:33:01.077456 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:01.077397 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sfz6d" event={"ID":"5bdef8b6-a1b9-4350-a026-5576f5fa6c0a","Type":"ContainerStarted","Data":"9494592985f01ef459b6b661b2ade5bde8f67062fcd1f88567584d3167f1e56d"} Jul 02 00:33:02.083720 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:02.083687 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sfz6d" event={"ID":"5bdef8b6-a1b9-4350-a026-5576f5fa6c0a","Type":"ContainerStarted","Data":"d93df97086deac905f9842b90170ad56d9200c3f5a447d3839b361cab3db2012"} Jul 02 00:33:02.105709 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:02.105655 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sfz6d" podStartSLOduration=1.9189222240000001 podStartE2EDuration="2.105639728s" totalImagesPullingTime="186.717504ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:33:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:33:02.103759861 +0000 UTC m=+935.519197530" watchObservedRunningTime="2026-07-02 00:33:02.105639728 +0000 UTC m=+935.521077394" Jul 02 00:33:10.912843 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:10.912809 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sfz6d" Jul 02 00:33:10.913203 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:10.912873 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sfz6d" Jul 02 00:33:10.925776 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:10.925753 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sfz6d" Jul 02 00:33:11.140643 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:11.140616 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sfz6d" Jul 02 00:33:24.117375 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:24.117343 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:33:28.282371 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:28.282341 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg"] Jul 02 00:33:28.285994 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:28.285970 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg" Jul 02 00:33:28.288563 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:28.288536 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 02 00:33:28.295878 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:28.295854 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg"] Jul 02 00:33:28.316748 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:28.316723 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:33:28.331869 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:28.331838 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fb97e29-a46e-47f0-9957-e4e616b1d79e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg\" (UID: \"2fb97e29-a46e-47f0-9957-e4e616b1d79e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg" Jul 02 00:33:28.331964 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:28.331888 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fb97e29-a46e-47f0-9957-e4e616b1d79e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg\" (UID: \"2fb97e29-a46e-47f0-9957-e4e616b1d79e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg" Jul 02 00:33:28.331964 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:28.331911 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx9lv\" (UniqueName: \"kubernetes.io/projected/2fb97e29-a46e-47f0-9957-e4e616b1d79e-kube-api-access-vx9lv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg\" (UID: \"2fb97e29-a46e-47f0-9957-e4e616b1d79e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg" Jul 02 00:33:28.331964 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:28.331929 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fb97e29-a46e-47f0-9957-e4e616b1d79e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg\" (UID: \"2fb97e29-a46e-47f0-9957-e4e616b1d79e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg" Jul 02 00:33:28.331964 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:28.331944 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fb97e29-a46e-47f0-9957-e4e616b1d79e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg\" (UID: \"2fb97e29-a46e-47f0-9957-e4e616b1d79e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg" Jul 02 00:33:28.332147 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:28.332032 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fb97e29-a46e-47f0-9957-e4e616b1d79e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg\" (UID: \"2fb97e29-a46e-47f0-9957-e4e616b1d79e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg" Jul 02 00:33:28.432698 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:28.432661 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx9lv\" (UniqueName: \"kubernetes.io/projected/2fb97e29-a46e-47f0-9957-e4e616b1d79e-kube-api-access-vx9lv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg\" (UID: \"2fb97e29-a46e-47f0-9957-e4e616b1d79e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg" Jul 02 00:33:28.432848 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:28.432709 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fb97e29-a46e-47f0-9957-e4e616b1d79e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg\" (UID: \"2fb97e29-a46e-47f0-9957-e4e616b1d79e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg" Jul 02 00:33:28.432848 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:28.432728 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fb97e29-a46e-47f0-9957-e4e616b1d79e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg\" (UID: \"2fb97e29-a46e-47f0-9957-e4e616b1d79e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg" Jul 02 00:33:28.432848 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:28.432794 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fb97e29-a46e-47f0-9957-e4e616b1d79e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg\" (UID: \"2fb97e29-a46e-47f0-9957-e4e616b1d79e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg" Jul 02 00:33:28.432965 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:28.432854 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fb97e29-a46e-47f0-9957-e4e616b1d79e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg\" (UID: \"2fb97e29-a46e-47f0-9957-e4e616b1d79e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg" Jul 02 00:33:28.432965 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:28.432906 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fb97e29-a46e-47f0-9957-e4e616b1d79e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg\" (UID: \"2fb97e29-a46e-47f0-9957-e4e616b1d79e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg" Jul 02 00:33:28.433207 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:28.433186 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fb97e29-a46e-47f0-9957-e4e616b1d79e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg\" (UID: \"2fb97e29-a46e-47f0-9957-e4e616b1d79e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg" Jul 02 00:33:28.433277 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:28.433211 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fb97e29-a46e-47f0-9957-e4e616b1d79e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg\" (UID: \"2fb97e29-a46e-47f0-9957-e4e616b1d79e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg" Jul 02 00:33:28.433347 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:28.433293 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fb97e29-a46e-47f0-9957-e4e616b1d79e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg\" (UID: \"2fb97e29-a46e-47f0-9957-e4e616b1d79e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg" Jul 02 00:33:28.435039 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:28.435015 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fb97e29-a46e-47f0-9957-e4e616b1d79e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg\" (UID: \"2fb97e29-a46e-47f0-9957-e4e616b1d79e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg" Jul 02 00:33:28.435213 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:28.435198 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fb97e29-a46e-47f0-9957-e4e616b1d79e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg\" (UID: \"2fb97e29-a46e-47f0-9957-e4e616b1d79e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg" Jul 02 00:33:28.440832 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:28.440810 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx9lv\" (UniqueName: \"kubernetes.io/projected/2fb97e29-a46e-47f0-9957-e4e616b1d79e-kube-api-access-vx9lv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg\" (UID: \"2fb97e29-a46e-47f0-9957-e4e616b1d79e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg" Jul 02 00:33:28.597231 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:28.597137 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg" Jul 02 00:33:28.734676 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:28.734653 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg"] Jul 02 00:33:28.736037 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:33:28.736009 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fb97e29_a46e_47f0_9957_e4e616b1d79e.slice/crio-523e43d7e73d409109914dc1e843b3951a50e6150e4a599a66fd4685dcc98639 WatchSource:0}: Error finding container 523e43d7e73d409109914dc1e843b3951a50e6150e4a599a66fd4685dcc98639: Status 404 returned error can't find the container with id 523e43d7e73d409109914dc1e843b3951a50e6150e4a599a66fd4685dcc98639 Jul 02 00:33:28.737596 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:28.737581 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 00:33:29.210288 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:29.210206 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg" event={"ID":"2fb97e29-a46e-47f0-9957-e4e616b1d79e","Type":"ContainerStarted","Data":"457c6555a63e4451f4f4a0e602087e757e837720c59a86720b650719d8c68f11"} Jul 02 00:33:29.210288 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:29.210253 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg" event={"ID":"2fb97e29-a46e-47f0-9957-e4e616b1d79e","Type":"ContainerStarted","Data":"523e43d7e73d409109914dc1e843b3951a50e6150e4a599a66fd4685dcc98639"} Jul 02 00:33:29.226499 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:29.226450 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg" podStartSLOduration=1.050317956 podStartE2EDuration="1.226411486s" totalImagesPullingTime="176.09353ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 00:33:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:33:29.225769251 +0000 UTC m=+962.641206919" watchObservedRunningTime="2026-07-02 00:33:29.226411486 +0000 UTC m=+962.641849154" Jul 02 00:33:38.597508 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:38.597473 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg" Jul 02 00:33:38.597943 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:38.597554 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg" Jul 02 00:33:38.609379 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:38.609356 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg" Jul 02 00:33:39.273764 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:39.273735 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg" Jul 02 00:33:46.176932 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:46.176897 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:33:54.806881 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:33:54.806802 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:34:43.141490 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:34:43.141453 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:34:43.386043 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:34:43.386011 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:34:43.487733 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:34:43.487653 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:35:07.702008 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:35:07.701977 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:35:18.852889 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:35:18.852808 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:35:18.956676 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:35:18.956644 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:35:24.286665 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:35:24.286628 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:35:24.410030 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:35:24.410000 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:35:25.348754 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:35:25.348720 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:35:25.456011 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:35:25.455973 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:36:07.521234 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:07.521204 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-zjfxv_ef9956de-47b1-437d-85e7-c7925f04c86f/manager/0.log" Jul 02 00:36:07.638943 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:07.638905 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-vrxsm_960b9c81-3996-482b-9d0d-5b9a7d6c7870/manager/0.log" Jul 02 00:36:07.759123 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:07.759095 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-69f5665455-5x9d2_4cc030ec-473b-4b4f-9a4a-8e3dad9bae29/maas-api/0.log" Jul 02 00:36:07.875664 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:07.875580 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-59b85bfd9f-wsfrg_5a06c21e-c165-47a3-9d6a-f0ab191627c1/manager/0.log" Jul 02 00:36:08.415180 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:08.415150 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75d8df8c5b-72vqs_96c409a2-1057-4825-8877-7baf055ed7e3/manager/0.log" Jul 02 00:36:08.424196 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:08.424177 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75d8df8c5b-72vqs_96c409a2-1057-4825-8877-7baf055ed7e3/copy-manifests/0.log" Jul 02 00:36:10.129673 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:10.129646 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-lzkdk_c3f93978-ad5c-43ab-b3af-665c305ce400/manager/0.log" Jul 02 00:36:10.696615 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:10.696587 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9kp2b_fa04dd83-c602-428c-9b15-1a839e55cd78/manager/0.log" Jul 02 00:36:11.046362 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:11.046332 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4k9nj4_08f8a243-cecf-4ae5-887b-de38ae1f1bed/istio-proxy/0.log" Jul 02 00:36:11.501050 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:11.501005 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pvgz8_1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0/istio-proxy/1.log" Jul 02 00:36:11.614945 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:11.614915 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-4lx6d_86161c7b-825c-4b6e-a766-83859c13fcfc/payload-pre-processing/0.log" Jul 02 00:36:11.839020 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:11.838931 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bbf6dbcc-cbv22_e17f6a99-9ffb-4d7d-9031-a0939e588e14/router/0.log" Jul 02 00:36:12.171199 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:12.171115 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-tnl5h_5d690118-ddb5-4a77-9a79-2c44c6880922/main/0.log" Jul 02 00:36:12.279576 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:12.279545 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-sfz6d_5bdef8b6-a1b9-4350-a026-5576f5fa6c0a/main/0.log" Jul 02 00:36:12.496401 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:12.496376 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbwgcrg_2fb97e29-a46e-47f0-9957-e4e616b1d79e/main/0.log" Jul 02 00:36:17.013513 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:17.013480 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:36:17.102240 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:17.102197 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:36:19.898915 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:19.898883 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9rkkw_9ca43bb6-818e-4157-a77e-cbe116cdb95e/global-pull-secret-syncer/0.log" Jul 02 00:36:20.016468 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:20.016443 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" Jul 02 00:36:20.095920 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:20.095885 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-30.ec2.internal_557f70546d4dabad259953de7405c2f1/haproxy/0.log" Jul 02 00:36:24.279567 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:24.279530 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:36:24.335554 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:24.335518 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkqlf_96851348-608f-48dd-b01d-a88a53cf0ece/konnectivity-agent/0.log" limit=1024 Jul 02 00:36:24.481465 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:24.481411 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-lzkdk_c3f93978-ad5c-43ab-b3af-665c305ce400/manager/0.log" Jul 02 00:36:24.650323 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:24.650248 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9kp2b_fa04dd83-c602-428c-9b15-1a839e55cd78/manager/0.log" Jul 02 00:36:26.527337 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:26.527308 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-4jvrw_954d8cc8-f8a5-4b7c-8569-cead4287cbb5/cluster-monitoring-operator/0.log" Jul 02 00:36:26.561275 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:26.561252 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-r4fbj_35182afa-99f0-4ffd-ab82-e8b111076888/kube-state-metrics/0.log" Jul 02 00:36:26.581044 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:26.581021 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-r4fbj_35182afa-99f0-4ffd-ab82-e8b111076888/kube-rbac-proxy-main/0.log" Jul 02 00:36:26.602710 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:26.602692 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-r4fbj_35182afa-99f0-4ffd-ab82-e8b111076888/kube-rbac-proxy-self/0.log" Jul 02 00:36:26.655986 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:26.655969 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-prjgt_e201079c-fd71-4a27-8846-d04516933aca/monitoring-plugin/0.log" Jul 02 00:36:26.860748 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:26.860672 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f66ml_87deb294-03cf-4e01-94aa-90bc5e0e36bb/node-exporter/0.log" Jul 02 00:36:26.889568 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:26.889546 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f66ml_87deb294-03cf-4e01-94aa-90bc5e0e36bb/kube-rbac-proxy/0.log" Jul 02 00:36:26.921096 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:26.921078 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f66ml_87deb294-03cf-4e01-94aa-90bc5e0e36bb/init-textfile/0.log" Jul 02 00:36:27.048795 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:27.048768 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b24daeea-82e3-4f21-a73a-f971a35d5ace/prometheus/0.log" Jul 02 00:36:27.071142 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:27.071116 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b24daeea-82e3-4f21-a73a-f971a35d5ace/config-reloader/0.log" Jul 02 00:36:27.091813 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:27.091791 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b24daeea-82e3-4f21-a73a-f971a35d5ace/thanos-sidecar/0.log" Jul 02 00:36:27.113489 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:27.113431 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b24daeea-82e3-4f21-a73a-f971a35d5ace/kube-rbac-proxy-web/0.log" Jul 02 00:36:27.137617 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:27.137601 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b24daeea-82e3-4f21-a73a-f971a35d5ace/kube-rbac-proxy/0.log" Jul 02 00:36:27.159428 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:27.159394 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b24daeea-82e3-4f21-a73a-f971a35d5ace/kube-rbac-proxy-thanos/0.log" Jul 02 00:36:27.190023 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:27.190008 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b24daeea-82e3-4f21-a73a-f971a35d5ace/init-config-reloader/0.log" Jul 02 00:36:28.923576 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:28.923542 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cdb5968b9-8jnpt_2ae1d967-f1b0-4ddf-b5be-2055ed3b89c2/networking-console-plugin/0.log" Jul 02 00:36:30.719651 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:30.719625 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bfzvr/perf-node-gather-daemonset-5rsxp"] Jul 02 00:36:30.723685 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:30.723661 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bfzvr/perf-node-gather-daemonset-5rsxp" Jul 02 00:36:30.726081 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:30.726050 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bfzvr\"/\"default-dockercfg-zxlrm\"" Jul 02 00:36:30.726081 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:30.726051 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bfzvr\"/\"openshift-service-ca.crt\"" Jul 02 00:36:30.727052 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:30.727034 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bfzvr\"/\"kube-root-ca.crt\"" Jul 02 00:36:30.733580 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:30.733559 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bfzvr/perf-node-gather-daemonset-5rsxp"] Jul 02 00:36:30.765317 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:30.765275 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-69d9f679db-vr5kp_5c633374-db35-44a5-873e-fa69cc65215a/volume-data-source-validator/0.log" Jul 02 00:36:30.812071 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:30.812047 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9f168c5-ffe8-4ec4-941d-221ebaf68bc6-sys\") pod \"perf-node-gather-daemonset-5rsxp\" (UID: \"f9f168c5-ffe8-4ec4-941d-221ebaf68bc6\") " pod="openshift-must-gather-bfzvr/perf-node-gather-daemonset-5rsxp" Jul 02 00:36:30.812163 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:30.812079 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f9f168c5-ffe8-4ec4-941d-221ebaf68bc6-proc\") pod \"perf-node-gather-daemonset-5rsxp\" (UID: \"f9f168c5-ffe8-4ec4-941d-221ebaf68bc6\") " pod="openshift-must-gather-bfzvr/perf-node-gather-daemonset-5rsxp" Jul 02 00:36:30.812163 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:30.812113 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f9f168c5-ffe8-4ec4-941d-221ebaf68bc6-podres\") pod \"perf-node-gather-daemonset-5rsxp\" (UID: \"f9f168c5-ffe8-4ec4-941d-221ebaf68bc6\") " pod="openshift-must-gather-bfzvr/perf-node-gather-daemonset-5rsxp" Jul 02 00:36:30.812250 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:30.812228 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgfbh\" (UniqueName: \"kubernetes.io/projected/f9f168c5-ffe8-4ec4-941d-221ebaf68bc6-kube-api-access-sgfbh\") pod \"perf-node-gather-daemonset-5rsxp\" (UID: \"f9f168c5-ffe8-4ec4-941d-221ebaf68bc6\") " pod="openshift-must-gather-bfzvr/perf-node-gather-daemonset-5rsxp" Jul 02 00:36:30.812294 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:30.812276 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f9f168c5-ffe8-4ec4-941d-221ebaf68bc6-lib-modules\") pod \"perf-node-gather-daemonset-5rsxp\" (UID: \"f9f168c5-ffe8-4ec4-941d-221ebaf68bc6\") " pod="openshift-must-gather-bfzvr/perf-node-gather-daemonset-5rsxp" Jul 02 00:36:30.912799 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:30.912758 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f9f168c5-ffe8-4ec4-941d-221ebaf68bc6-lib-modules\") pod \"perf-node-gather-daemonset-5rsxp\" (UID: \"f9f168c5-ffe8-4ec4-941d-221ebaf68bc6\") " pod="openshift-must-gather-bfzvr/perf-node-gather-daemonset-5rsxp" Jul 02 00:36:30.912799 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:30.912805 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9f168c5-ffe8-4ec4-941d-221ebaf68bc6-sys\") pod \"perf-node-gather-daemonset-5rsxp\" (UID: \"f9f168c5-ffe8-4ec4-941d-221ebaf68bc6\") " pod="openshift-must-gather-bfzvr/perf-node-gather-daemonset-5rsxp" Jul 02 00:36:30.912989 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:30.912873 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9f168c5-ffe8-4ec4-941d-221ebaf68bc6-sys\") pod \"perf-node-gather-daemonset-5rsxp\" (UID: \"f9f168c5-ffe8-4ec4-941d-221ebaf68bc6\") " pod="openshift-must-gather-bfzvr/perf-node-gather-daemonset-5rsxp" Jul 02 00:36:30.912989 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:30.912921 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f9f168c5-ffe8-4ec4-941d-221ebaf68bc6-lib-modules\") pod \"perf-node-gather-daemonset-5rsxp\" (UID: \"f9f168c5-ffe8-4ec4-941d-221ebaf68bc6\") " pod="openshift-must-gather-bfzvr/perf-node-gather-daemonset-5rsxp" Jul 02 00:36:30.912989 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:30.912921 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f9f168c5-ffe8-4ec4-941d-221ebaf68bc6-proc\") pod \"perf-node-gather-daemonset-5rsxp\" (UID: \"f9f168c5-ffe8-4ec4-941d-221ebaf68bc6\") " pod="openshift-must-gather-bfzvr/perf-node-gather-daemonset-5rsxp" Jul 02 00:36:30.912989 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:30.912979 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f9f168c5-ffe8-4ec4-941d-221ebaf68bc6-podres\") pod \"perf-node-gather-daemonset-5rsxp\" (UID: \"f9f168c5-ffe8-4ec4-941d-221ebaf68bc6\") " pod="openshift-must-gather-bfzvr/perf-node-gather-daemonset-5rsxp" Jul 02 00:36:30.912989 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:30.912978 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f9f168c5-ffe8-4ec4-941d-221ebaf68bc6-proc\") pod \"perf-node-gather-daemonset-5rsxp\" (UID: \"f9f168c5-ffe8-4ec4-941d-221ebaf68bc6\") " pod="openshift-must-gather-bfzvr/perf-node-gather-daemonset-5rsxp" Jul 02 00:36:30.913172 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:30.913065 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgfbh\" (UniqueName: \"kubernetes.io/projected/f9f168c5-ffe8-4ec4-941d-221ebaf68bc6-kube-api-access-sgfbh\") pod \"perf-node-gather-daemonset-5rsxp\" (UID: \"f9f168c5-ffe8-4ec4-941d-221ebaf68bc6\") " pod="openshift-must-gather-bfzvr/perf-node-gather-daemonset-5rsxp" Jul 02 00:36:30.913172 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:30.913096 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f9f168c5-ffe8-4ec4-941d-221ebaf68bc6-podres\") pod \"perf-node-gather-daemonset-5rsxp\" (UID: \"f9f168c5-ffe8-4ec4-941d-221ebaf68bc6\") " pod="openshift-must-gather-bfzvr/perf-node-gather-daemonset-5rsxp" Jul 02 00:36:30.920573 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:30.920551 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgfbh\" (UniqueName: \"kubernetes.io/projected/f9f168c5-ffe8-4ec4-941d-221ebaf68bc6-kube-api-access-sgfbh\") pod \"perf-node-gather-daemonset-5rsxp\" (UID: \"f9f168c5-ffe8-4ec4-941d-221ebaf68bc6\") " pod="openshift-must-gather-bfzvr/perf-node-gather-daemonset-5rsxp" Jul 02 00:36:31.034538 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:31.034500 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bfzvr/perf-node-gather-daemonset-5rsxp" Jul 02 00:36:31.168557 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:31.168532 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bfzvr/perf-node-gather-daemonset-5rsxp"] Jul 02 00:36:31.170493 ip-10-0-130-30 kubenswrapper[2581]: W0702 00:36:31.170468 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf9f168c5_ffe8_4ec4_941d_221ebaf68bc6.slice/crio-f5c8fbc0255a114d79edd1f77bafaf215bb929331d0212fa4c4e081a1eef37ca WatchSource:0}: Error finding container f5c8fbc0255a114d79edd1f77bafaf215bb929331d0212fa4c4e081a1eef37ca: Status 404 returned error can't find the container with id f5c8fbc0255a114d79edd1f77bafaf215bb929331d0212fa4c4e081a1eef37ca Jul 02 00:36:31.900671 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:31.900637 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zn9z5_2a6a9ab0-db65-483f-8eb1-ad0220bb56a3/dns/0.log" Jul 02 00:36:31.922376 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:31.922355 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zn9z5_2a6a9ab0-db65-483f-8eb1-ad0220bb56a3/kube-rbac-proxy/0.log" Jul 02 00:36:31.946258 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:31.946240 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kcpxt_d32c2993-ca5d-4b91-9051-53784803a737/dns-node-resolver/0.log" Jul 02 00:36:32.114001 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:32.113967 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bfzvr/perf-node-gather-daemonset-5rsxp" event={"ID":"f9f168c5-ffe8-4ec4-941d-221ebaf68bc6","Type":"ContainerStarted","Data":"f1b4ef6d9ea3a5b60130e2163f45d116ae683c0a9deee3b4c9228e1558cda259"} Jul 02 00:36:32.114172 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:32.114014 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bfzvr/perf-node-gather-daemonset-5rsxp" event={"ID":"f9f168c5-ffe8-4ec4-941d-221ebaf68bc6","Type":"ContainerStarted","Data":"f5c8fbc0255a114d79edd1f77bafaf215bb929331d0212fa4c4e081a1eef37ca"} Jul 02 00:36:32.114172 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:32.114096 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bfzvr/perf-node-gather-daemonset-5rsxp" Jul 02 00:36:32.130972 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:32.130933 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bfzvr/perf-node-gather-daemonset-5rsxp" podStartSLOduration=2.130921703 podStartE2EDuration="2.130921703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 00:36:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 00:36:32.128984676 +0000 UTC m=+1145.544422344" watchObservedRunningTime="2026-07-02 00:36:32.130921703 +0000 UTC m=+1145.546359370" Jul 02 00:36:32.557042 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:32.556999 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-swljq_8a8c9b7b-235d-45e2-a810-d0db55313f20/node-ca/0.log" Jul 02 00:36:33.455757 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:33.455732 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4k9nj4_08f8a243-cecf-4ae5-887b-de38ae1f1bed/istio-proxy/0.log" Jul 02 00:36:33.593758 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:33.593734 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pvgz8_1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0/istio-proxy/1.log" Jul 02 00:36:33.593939 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:33.593865 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pvgz8_1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0/istio-proxy/0.log" Jul 02 00:36:33.612122 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:33.612097 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-4lx6d_86161c7b-825c-4b6e-a766-83859c13fcfc/payload-pre-processing/0.log" Jul 02 00:36:33.656662 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:33.656640 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bbf6dbcc-cbv22_e17f6a99-9ffb-4d7d-9031-a0939e588e14/router/0.log" Jul 02 00:36:34.267390 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:34.267361 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8gm58_ab4130b0-b250-4476-8c49-5c45b2d82f25/serve-healthcheck-canary/0.log" Jul 02 00:36:34.804066 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:34.804040 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-92c88_2e6a9de7-b7d1-44ad-b020-2f70773b582e/insights-operator/1.log" Jul 02 00:36:34.809950 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:34.809929 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-92c88_2e6a9de7-b7d1-44ad-b020-2f70773b582e/insights-operator/0.log" Jul 02 00:36:34.832829 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:34.832812 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-npfwr_7279cc09-e4af-498a-a45b-18d03393002b/kube-rbac-proxy/0.log" Jul 02 00:36:34.854318 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:34.854300 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-npfwr_7279cc09-e4af-498a-a45b-18d03393002b/exporter/0.log" Jul 02 00:36:34.876409 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:34.876393 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-npfwr_7279cc09-e4af-498a-a45b-18d03393002b/extractor/0.log" Jul 02 00:36:37.132074 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:37.132042 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-zjfxv_ef9956de-47b1-437d-85e7-c7925f04c86f/manager/0.log" Jul 02 00:36:37.163883 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:37.163853 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-vrxsm_960b9c81-3996-482b-9d0d-5b9a7d6c7870/manager/0.log" Jul 02 00:36:37.185214 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:37.185193 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-69f5665455-5x9d2_4cc030ec-473b-4b4f-9a4a-8e3dad9bae29/maas-api/0.log" Jul 02 00:36:37.218480 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:37.218457 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-59b85bfd9f-wsfrg_5a06c21e-c165-47a3-9d6a-f0ab191627c1/manager/0.log" Jul 02 00:36:37.410267 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:37.410189 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75d8df8c5b-72vqs_96c409a2-1057-4825-8877-7baf055ed7e3/manager/0.log" Jul 02 00:36:37.430916 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:37.430894 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75d8df8c5b-72vqs_96c409a2-1057-4825-8877-7baf055ed7e3/copy-manifests/0.log" Jul 02 00:36:38.129471 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:38.129439 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bfzvr/perf-node-gather-daemonset-5rsxp" Jul 02 00:36:38.804313 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:38.804276 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5db5fc4db4-st7dm_6cc925e4-b250-495d-a652-523c294ee2ed/manager/0.log" Jul 02 00:36:38.829191 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:38.829165 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-bkkdp_51314dd8-0b66-4d1d-a0da-34cbe68e4a03/openshift-lws-operator/0.log" Jul 02 00:36:40.553515 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:40.553486 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4k9nj4_08f8a243-cecf-4ae5-887b-de38ae1f1bed/istio-proxy/0.log" Jul 02 00:36:40.662585 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:40.662552 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pvgz8_1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0/istio-proxy/1.log" Jul 02 00:36:40.662881 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:40.662868 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pvgz8_1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0/istio-proxy/0.log" Jul 02 00:36:40.672366 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:40.672346 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-4lx6d_86161c7b-825c-4b6e-a766-83859c13fcfc/payload-pre-processing/0.log" Jul 02 00:36:40.701748 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:40.701722 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bbf6dbcc-cbv22_e17f6a99-9ffb-4d7d-9031-a0939e588e14/router/0.log" Jul 02 00:36:41.885123 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:41.885028 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4k9nj4_08f8a243-cecf-4ae5-887b-de38ae1f1bed/istio-proxy/0.log" Jul 02 00:36:42.006000 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:42.005974 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pvgz8_1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0/istio-proxy/1.log" Jul 02 00:36:42.006223 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:42.006208 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pvgz8_1d2c57c1-d3f9-4957-bd7b-39b39b6bf4b0/istio-proxy/0.log" Jul 02 00:36:42.018611 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:42.018585 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-4lx6d_86161c7b-825c-4b6e-a766-83859c13fcfc/payload-pre-processing/0.log" Jul 02 00:36:42.050761 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:42.050738 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bbf6dbcc-cbv22_e17f6a99-9ffb-4d7d-9031-a0939e588e14/router/0.log" Jul 02 00:36:44.233353 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:44.233321 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-dnpnt_8cde6005-b26c-46de-a354-f5842cc6d299/migrator/0.log" Jul 02 00:36:44.249652 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:44.249627 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-dnpnt_8cde6005-b26c-46de-a354-f5842cc6d299/graceful-termination/0.log" Jul 02 00:36:44.608092 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:44.608065 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-qq8c8_a769b185-fefb-40c7-a21f-137f612e9d66/kube-storage-version-migrator-operator/1.log" Jul 02 00:36:44.608863 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:44.608847 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-qq8c8_a769b185-fefb-40c7-a21f-137f612e9d66/kube-storage-version-migrator-operator/0.log" Jul 02 00:36:45.560170 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:45.560134 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5vxng_3f0e46ab-9141-42bb-a494-e96fa6d99107/kube-multus/0.log" Jul 02 00:36:45.583172 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:45.583149 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r76sc_3af39740-2e0a-41fd-ace2-f375968ce30d/kube-multus-additional-cni-plugins/0.log" Jul 02 00:36:45.607200 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:45.607180 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r76sc_3af39740-2e0a-41fd-ace2-f375968ce30d/egress-router-binary-copy/0.log" Jul 02 00:36:45.628875 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:45.628854 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r76sc_3af39740-2e0a-41fd-ace2-f375968ce30d/cni-plugins/0.log" Jul 02 00:36:45.654108 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:45.654091 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r76sc_3af39740-2e0a-41fd-ace2-f375968ce30d/bond-cni-plugin/0.log" Jul 02 00:36:45.677041 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:45.677023 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r76sc_3af39740-2e0a-41fd-ace2-f375968ce30d/routeoverride-cni/0.log" Jul 02 00:36:45.697747 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:45.697731 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r76sc_3af39740-2e0a-41fd-ace2-f375968ce30d/whereabouts-cni-bincopy/0.log" Jul 02 00:36:45.718328 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:45.718311 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r76sc_3af39740-2e0a-41fd-ace2-f375968ce30d/whereabouts-cni/0.log" Jul 02 00:36:46.128354 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:46.128327 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7tkzk_3c33c8e2-8b03-4815-8cd7-d72d4eb01015/network-metrics-daemon/0.log" Jul 02 00:36:46.148039 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:46.148014 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7tkzk_3c33c8e2-8b03-4815-8cd7-d72d4eb01015/kube-rbac-proxy/0.log" Jul 02 00:36:47.274303 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:47.274275 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55kgg_3ea67bc7-0faa-4fa0-904c-adfea68a4992/ovn-controller/0.log" Jul 02 00:36:47.293553 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:47.293527 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55kgg_3ea67bc7-0faa-4fa0-904c-adfea68a4992/ovn-acl-logging/0.log" Jul 02 00:36:47.293553 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:47.293539 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55kgg_3ea67bc7-0faa-4fa0-904c-adfea68a4992/ovn-acl-logging/1.log" Jul 02 00:36:47.313995 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:47.313967 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55kgg_3ea67bc7-0faa-4fa0-904c-adfea68a4992/kube-rbac-proxy-node/0.log" Jul 02 00:36:47.337057 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:47.337026 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55kgg_3ea67bc7-0faa-4fa0-904c-adfea68a4992/kube-rbac-proxy-ovn-metrics/0.log" Jul 02 00:36:47.352537 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:47.352519 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55kgg_3ea67bc7-0faa-4fa0-904c-adfea68a4992/northd/0.log" Jul 02 00:36:47.372832 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:47.372812 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55kgg_3ea67bc7-0faa-4fa0-904c-adfea68a4992/nbdb/0.log" Jul 02 00:36:47.395036 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:47.395018 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55kgg_3ea67bc7-0faa-4fa0-904c-adfea68a4992/sbdb/0.log" Jul 02 00:36:47.436690 ip-10-0-130-30 kubenswrapper[2581]: I0702 00:36:47.436660 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55kgg_3ea67bc7-0faa-4fa0-904c-adfea68a4992/ovnkube-controller/0.log"